Research On 3D Localization And 3D Display Based On Light Field Camera

Accurate three-dimensional(3D)imaging is essential for machines to map and interact with the physical world.Traditional imaging and display devices can only capture and display on a two-dimensional plane.The light field imaging technology based on the microlens array optically encodes the spatial light field and records the optical position and angle information at the same time,which has received extensive attention from the academic community.The theory of light field imaging has become an important theoretical growth point in the field of digital imaging and computer vision,and has expanded the development direction of the next generation of imaging technology.At present,the domestic research on 3D computational imaging based on light field cameras is still in the preliminary stage.This article has carried out theoretical and application research on light field imaging,3D optical refocusing,4D light field data naked eye 3D display,panoramic 3D positioning and other technologies.Some scientific problems in light field imaging have been discussed and a series of innovative results have been achieved.The main research contents of this paper are as follows:1.A three-dimensional refocusing method based on adaptive delta array optics is proposed.First generate an A-PDFA kernel with an adaptively determined number of pulses,and then convolve this A-PDFA with an elemental image array(EIA)captured by an integral imaging system to obtain a depth-filtered EIA to finally refocus the object In the true depth of the object.Through Matlab two-dimensional plane numerical simulation and optical experiments,compared with other traditional 3D optical refocusing methods,the performance of the 3-D optical refocusing method based on A-PDFA obtains the widest effective processing area and the highest image quality.2.A new naked eye 3D display method based on light field camera with full parallax is proposed.Combining the light field camera and the depth-first integrated imaging display system,a three-dimensional acquisition and three-dimensional display scheme for real objects is proposed,and the three-dimensional image distortion and depth information distortion based on the light field camera acquisition process are studied,and a depth is proposed.Adjust the algorithm to adjust the objects of different depths to the correct depth and realize full-parallax naked-eye 3D display in the depth-first integrated imaging system.3.A new panoramic 3D positioning method based on light field camera is proposed.Starting from the imaging model of the light field camera,combining the general imaging projection model and the light field imaging model,the mapping relationship from the threedimensional space coordinates to the light field coordinates of the light field camera image sensor is established.The relationship between the disparity map and the sensor's light field coordinate distribution is analyzed in detail,and the mapping model between the threedimensional space coordinate and the light field image intermediate viewing angle disparity map is established,and the positioning accuracy,The relationship between depth resolution and axial distance of the model are analyzed at the same time.