Eye design in the plenoptic space of light rays

TitleEye design in the plenoptic space of light rays
Publication TypeConference Papers
Year of Publication2003
AuthorsNeumann J, Fermüller C, Aloimonos Y
Conference NameNinth IEEE International Conference on Computer Vision, 2003. Proceedings
Date Published2003/10/13/16
ISBN Number0-7695-1950-4
Keywords3D ego-motion estimation, Assembly, B-splines, Camera design, CAMERAS, captured image, compound eyes, Computer vision, data mining, eye, eye-carrying organism, Eyes, filter optimization, image representation, image resolution, Information geometry, Laboratories, light field reconstruction, light gathering power, light rays, mixed spherical-Cartesian coordinate system, Motion estimation, natural evolution process, natural eye designs, natural image statistics, optical nanotechnology, Optical signal processing, optimal eye design mathematical criteria, Organisms, plenoptic image formation, plenoptic space, plenoptic video geometry, sampling operators, sensory ecology, Signal design, Signal processing, signal processing framework, signal processing tool, square-summable sequences, visual acuity

Natural eye designs are optimized with regard to the tasks the eye-carrying organism has to perform for survival. This optimization has been performed by the process of natural evolution over many millions of years. Every eye captures a subset of the space of light rays. The information contained in this subset and the accuracy to which the eye can extract the necessary information determines an upper limit on how well an organism can perform a given task. In this work we propose a new methodology for camera design. By interpreting eyes as sample patterns in light ray space we can phrase the problem of eye design in a signal processing framework. This allows us to develop mathematical criteria for optimal eye design, which in turn enables us to build the best eye for a given task without the trial and error phase of natural evolution. The principle is evaluated on the task of 3D ego-motion estimation.