LookTel --- Computer Vision Applications for the Visually Impaired

The modern world is predominantly visual. While most people live and function with vision, many people live their lives with limited or no vision at all. The system presented in this dissertation aims to use computer vision techniques to improve the lives of individuals having severe visual impairments or blindness. By applying real-time image recognition in an accessible manner the system facilitates increased personal independence. The system presented here substantially advances the state of the art both in terms of the speed, accuracy, and robustness to the real-world variability. The real-time on-device recognition speed enables more than just object identification; it permits detection—finding the desired item among others. The high accuracy and robustness expands the ability for people to participate in commerce and expand roles for economic participation in multiple cultures. We present an extensive evaluation demonstration and a real-world public release of the system.