Research On Digital Interactive Exhibits Technology And System

To build a friendly human-computer environment is an important issue through the whole development of computer. Regarding museum exhibits as application background, the aim of this dissertation is to realize living information display and natural human-computer interaction in digital exhibits. In order to achieve natural display effects of exhibits, complex surface projection is widely used in recent decades, while the calibration can not be easily satisfied. Vision based interaction has been one of the best solution to enable visitors to interact with the exhibits content more naturally, while real-time and efficiency problems still exist. In the aspect of system implement, a simple, transparent and hardware-independent development software framework is needed.In response to issues mentioned above, digital interactive exhibits technology is focused on, which includes the following parts.First of all, review of the development course and current application situation is given. And then the current situation of some fundamental technical issues is analyzed, such as multi-projector calibration and alignment, vision based interaction, and exhibit awareness. These systematically provide novel ideas and methods for researches on digital interactive exhibit technology.Secondly, a scalable multi-projector calibration and alignment method for complex surfaces is proposed. Differing from the method based on homography transformation and surface equation solving, the method proposed could make an adaptive partition of the complex irregular surfaces, assure the calibration and alignment of multi-projector due to pin-hole model and perspective projection, and the work enables complex irregular surface to be used in the digital exhibit display. In addition, the method is much scalable, and therefore suitable for digital exhibits, especially for the portable digital exhibits.Thirdly, a natural interaction and awareness technology in the digital exhibit environment is proposed. Continuous feature of human movements is introduced in the prediction and feature matching of vision based interaction, which improves the accuracy of prediction and matching, and reduces space complexity of the feature searching. Meanwhile, a location-driven exhibit awareness technology is proposed, which maximizes users' awareness contribution in the resource-limited environment by making decisions for exhibit contents based on the location data by natural interaction.In addition, a real-time data fusion technology for interactive digital exhibits is also proposed. Using data estimates, it integrates disorder multi-source interaction data in real-time in under-constraint condition. Differing from those which wait and compute interaction data until sufficient constraint are gained, this method does not need rigid synchronization of cameras and exposure interval assumption of cameras. This method integrates data by estimating, which reduces latency of interaction data generation, is more suitable for real-time interactive exhibit application. Under the multi-projector system, a real-time parallel rendering protocol is proposed. It drives several computers and projectors in order to ensure the synchronization and real-time of display.Finally, a framework of digital interactive exhibit system is designed, which ensures the independency of exhibits application development and device configuration. Based on this framework, several digital interactive exhibit applications of precious heritages have been designed, such as Dunhuang Grottoes, Jinsha Site, Liangzhu Site, and Hemudu Site. Those applications are proved useful, and some are deployed in museums.