About me

Welcome to my website where I provide an overview of my scientific work and photography. I am Dutch and currently living in Japan where I work at NTT Communication Science Laboratories. I have a background in human computer interfaces and visual perception. The last couple of years my research has been moving more towards computational neuroscience where I use various machine learning techniques to create models of our visual system. In my research I try to understand how we visually estimate properties of objects and stuff around us.

Next to my research I really enjoy photography and when I arrived in Japan I bought a medium format analog camera. A selection of my work can be found at the photography section.

If you have any questions please don’t hesitate to contact me at mail [at] janjaap [dot] info.

Research: Liquids

During my PhD at the department of Experimental Psychology at the Justus-Liebig-Universität Gießen I studied the visual perception of deformable materials. Supervised by Roland Fleming I studied how our visual system estimates the viscosity of liquids. At my current lab supervised by Shin’ya Nishida at NTT Communication Science Laboratories in Japan, I continue to research how we estimate material properties using machine learning techniques that are inspired by our visual system.

The studies

Fluids and other deformable materials have highly mutable shapes, which are visibly influenced by both intrinsic properties (e.g. viscosity, velocity) and extrinsic forces (e.g. gravity, object interactions). How is it possible that we achieve good viscosity constancy despite large differences in the retinal image? In my research I try to identify the image cues we use to estimate viscosity. We found that mid-level features (e.g. ripples, clumping, spread, piling up) are very important to achieve viscosity constancy across a wide range of contexts. It is hard to quantify these features with image statistics or 3D shape measurements because they can vary in orientation and scale, and occur locally on liquid shapes. Therefore we are now concentrating on deep learning models and try to learn more about higher order image-based feature extraction.

The stimuli

During my PhD I spend quite some time setting up a technical pipeline to generate stable, precise and realistic liquid stimuli. To be able to do this I followed a three month secondment in Madrid at Next Limit. Here I learned to work with their particle simulation software RealFlow made for the VFX industry. The stimuli were rendered using Maxwell Render. The computational costs of these stimuli are quite high. I wrote specific scripts to distribute the calculations over various systems and clusters. In 2018 I became a certified Realflow Xpert

Research: Gloss

For my Master degree I graduated on a research project studying gloss perception. The actual research took place in the Perceptual Intelligence Lab at Delft University of Technology with Sylvia Pont and Maarten Wijntjes.

The study

We investigated the influence of the spatial structure of the illumination on gloss perception. The inspiration came from various art works like the paintings of Vermeer, where much simpler highlight shapes are used to depict real world situations. We find that more complex highlight shapes were perceived to produce a less glossy appearance than simple highlight shapes such as a disk or square. These results show that, contradictory to some beliefs, the complexity of a highlight shape’s spatial structure alone is not the main criterion for increases in perceived glossiness.

The stimuli

A diffuse light box in combination with differently shaped masks were used to produce a set of 6 simple and more complex highlight shapes. In the box we placed spherical stimuli that were painted in 6 degrees of glossiness. This resulted in a stimulus set of 6 highlight shapes and 6 gloss levels, a total of 36 stimuli. Observers were asked to rate glossiness looking at the real scene in the light box, but we also performed experiments with photographs of the stimuli displayed on a monitor. The figure below shows a subset of the stimuli with the six different masks that were tested.

stimuli selectie

Publications

Papers

2018 Jan Jaap R. van Assen, Pascal Barla, & Roland W. Fleming. Visual features in the perception of liquids. Current Biology, 28(3), 452-458, doi:10.1016/j.cub.2017.12.037. [PDF]

2017 Filipp Schmidt, Vivian C. Paulun, Jan Jaap R. van Assen, & Roland W. Fleming. Inferring the stiffness of unfamiliar objects from optical, shape, and motion cues. Journal of vision, 17(3), 18-18, doi:10.1167/17.3.18. [PDF]

2017 Vivian C. Paulun, Filipp Schmidt, Jan Jaap R. van Assen, & Roland W. Fleming. Shape, motion, and optical cues to stiffness of elastic objects. Journal of vision, 17(1), 20-20, doi:10.1167/17.1.20. [PDF]

2016 Jan Jaap R. van Assen, & Roland W. Fleming. Influence of optical material properties on the perception of liquids. Journal of vision, 16(15), 12-12, doi:10.1167/16.15.12. [PDF]

2016 Jan Jaap R. van Assen, Maarten W. A. Wijntjes, & Sylvia C. Pont. Highlight shapes and perception of gloss for real and photographed objects. Journal of Vision, 16(6):6, 1–14, doi:10.1167/16.6.6. [PDF]

Please contact me for a full résumé at mail [at] janjaap [dot] info or by LinkedIn.

Photography

Since my arrival in Japan I switched to analog photography using a medium format camera (Mamiya 7). Below you will find a selection of my photos.

More work can be found on Behance. I recently switched to Behance and I will gradually add more work.