A Study Of Virtual Fitting Based On Augmented Reality

In recent years, virtual fitting technology has been a hot research direction with the development of human-computer interaction. Though virtual fitting technology based on somatosensory are matured enough to show the effect of clothing on users in a variety of positions, the applications based on virtual reality lack of usability, for the reason that users cannot get the distinct effect of the clothes are with theirs real bodies. Augmented reality is of great help of changing the way users feel about virtual fitting while shopping. At now, as a novel research direction, the related technologies of the AR fitting are under investigation. The AR fitting applications have used a solution of combining 2D clothing patch with human body in real scene. Thus, the lack of physical realism problem still remains.According to this problem, this paper outlined virtual fitting system in augmented reality, and designed a novel method of interaction between human and cloth, which uses collision body model built with the point cloud of a human body to interact with cloth instead of virtual human model. The cloth model used in the whole real-time interaction process was chosen to be the interactive cloth supported by most popular 3D engines.The method was demonstrated in an AR application. At first, a few feature points is obtained in the pre-process of point cloud of a user. Then a personalized collision model will be created with the feature points based on the structure of human body. By simulating the poses of the user in real time, the model can interact with a pre-defined cloth model in virtual scene, algorithms of collision detection and response has been applied in this step for acceleration. Finally, we merge the interacted cloth into the video frame of real scene as the result.The feasibility of this method has been proved with both theories and experiments in the paper. And a discussion has been made of the differences between our method and other ones used in popular virtual fitting applications. It shows that our method can give a very distinct feeling of users’ wearing the cloth, which means that a user can tell whether a cloth is fit his/her body from the feedback image playing in the screen. And the frame rate is raised by the collision model, for the human body reconstruction process can be omitted. For the simplicity of being integrated, this method can be the foundation of virtual fitting application based on augmented reality.