200 likes | 316 Vues
This paper explores how motion is perceived through the analysis of spatio-temporal patterns using counterphase sinusoidal gratings. It discusses key elements such as the Reichardt detector, spatiotemporal filters, and the response characteristics of receptive fields in biological vision systems. The work highlights the importance of motion detection in evolutionary terms and differentiates between higher and early processing stages. Theoretical models, including the use of Gabor functions and energy models, are presented to explain the directionally specific responses of motion perception.
E N D
Sensing and Perceiving Motion Cmput 610 Martin Jagersand 2001
How come perceived as motion? Im = sin(t)U5+cos(t)U6 Im = f1(t)U1+…+f6(t)U6
Counterphase sin grating • Spatio-temporal pattern • Time t, Spatial x,y
Counterphase sin grating • Spatio-temporal pattern • Time t, Spatial x,y Ignoring Phi: = +
Notes: • Only one term: Motion left or right • Mixture of both: Standing wave • Direction can flip between left and right
QT movie Reichardt detector
Gradient: in Computer Vision Correlation: In bio vision Spatiotemporal filters: Unifying model Severalmotion models
Spatial response:Gabor function • Definition:
Temporal response: Adelson, Bergen ’85 Note: Terms from taylor of sin(t) Spatio-temporal D=DsDt
Receptor response toCounterphase grating • Separable convolution
Simplified: • For our grating: (Theta=0) • Write as sum of components: = exp(…)*(acos… + bsin…)
Combined cells • Spat: Temp: • Both: • Comb:
Result: • More directionally specific response
Energy model: • Sum odd and even phase components • Quadrature rectifier
Conclusion • Evolutionary motion detection is important • Early processing modeled by Reichardt detector or spatio-temporal filters. • Higher processing poorly understood