Image formation modeling and analysis of near‐eye light field displays

Near‐eye light field displays based on integral imaging through a microlens array provide attractive features like ultra‐compact volume and freedom of the vergence‐accommodation conflict to head‐mounted displays with virtual or augmented reality functions. To enable optimal design and analysis of such systems, it is desirable to have a physical model that incorporates all factors that affect the image formation, including diffraction, aberration, defocusing, and pixel size. Therefore, in this study, using the fundamental Huygens‐Fresnel principle and the Arizona eye model with adjustable accommodation, we develop an image formation model that can numerically calculate the retinal light field image with near‐perfect accuracy, and experimentally verify it with a prototype system. Next, based on this model, the visual resolution is analyzed for different field of views (FOVs). As a result, a rapid resolution decay with respect to FOV caused by off‐axis aberration is demonstrated. Finally, resolution variations as a function of image depth are analyzed based on systems with different central depth planes. Significantly, the resolution decay is revealed to plateau when the image depth is large enough, which is different from real‐image type light field displays. An image formation model with near‐perfect accuracy is developed for near‐eye light field displays by incorporating all factors affecting the image quality: diffraction, aberration, defocusing, pixel size, etc. Model‐based optimizations are performed to enhance the resolution from 6.9 to 15.4 PPD. The influences of field of view and image depth are quantitatively analyzed.