Visually Impaired Assistance System Based On Binocular Stereo Vision

Due to its large population base,China has over 17 million people with visual impairments,making it the country with the highest number of visually impaired individuals.In order to provide a practical and effective auxiliary service for the visually impaired,this thesis proposes a visual impairment assistance system based on binocular stereoscopic vision.Based on the binocular stereoscopic vision algorithm,the system achieves the perception of three-dimensional objects and the block calculation and stitching of disparity images.A lightweight,mobile binocular vision system was built using the Raspberry Pi platform to perform real-time calculations and generate three-dimensional data of the surrounding environment.The wearable electrical stimulation system was designed and fabricated using an Arduino micro controller and MAX7219 driver board.By selecting appropriate stimulation intensities,the system delivers electrical stimulation to the human skin.The binocular stereoscopic vision-based visual impairment assistance system consists of three parts: binocular stereoscopic matching system,post-processing of disparity images,and electrical stimulation system.(1)Binocular stereoscopic matching system: The imaging principles and coordinate transformations of the camera are first introduced.Calibration correction is performed on the binocular camera,and the Raspberry Pi platform and binocular camera are used for optical imaging.Through coordinate transformation,the planar projection of the real-world three-dimensional object is obtained.The planar image is then processed by filtering and hole filling,and finally,the disparity image is obtained based on the principle of binocular disparity.(2)Post-processing of disparity images: Edge enhancement,image compression,and image segmentation and cropping are performed on the disparity image obtained by the binocular stereoscopic imaging system.The encoded image information is then transmitted to the electrical stimulation system designed and developed using the Arduino micro controller and MAX7219 driver board via serial communication technology.(3)Electrical stimulation system: The electrical stimulation system designed and developed using the Arduino micro controller and MAX7219 driver board decodes and stitches the encoded image information received through serial communication.The system converts this image information into hardware driver program inputs,which include a line-by-line scanning driver circuit,high and low voltage isolation circuit,and protection circuit.These circuits drive the electrical stimulation module to deliver electrical stimulation to the human skin.The binocular stereoscopic vision-based visual impairment assistance system developed in this thesis has achieved good experimental results in the laboratory.From theoretical foundation to experimental verification,this system’s feasibility has been demonstrated,and it has certain value for assisting people with visual impairments.