Perception of 3D motion in the presence of uncertainty

E P Simoncelli, D J Heeger and E H Adelson

Published in Investigative Opthalmology and Visual Science Supplement (ARVO), vol.31 pp. 173, May 1990.

The extraction of 3D motion from images is a difficult but important task for natural and artificial vision systems. Methods for recovering 3D motion from images typically compute optical flow fields from sequences of images, and then combine this information to obtain global estimates of rigid-body motion. These techniques often fail in the presence of noise or the aperture problem, and cannot be cast as physiologically plausible models.

We recast the problem in the framework of estimation theory, using probability distributions to describe successive intermediate representations of motion information. Previously, researchers have described a mapping from images to distribution of motion energy (analogous to the outputs of direction selective cortical cells), and then to distributed representations of of image velocity (analogous to the outputs of MT cells). We discuss an extension of the Heeger/Jepson algorithms that computes a distributed representation of image velocity, thus avoiding the biological implausibility of explicit velocity representations. Uncertainties and ambiguities due to noise or the aperture problem may be directly included in the distributions of motion energy, and propagated through the computation to alter the final distribution of the 3D motion parameters. We also discuss extensions to handle situations involving motion transparency, motion occlusion boundaries, and independently moving objects.


  • Listing of all publications