Design And Implementation Of Video Conference System With Screen Content Tracking Whiteboard

The development of network communication technology has changed the traditional work mode.Telecommuting has gradually penetrated into various industries and become one of the daily work mode in many enterprises.Among the tools for remote communication and collaboration,online video conference is the most efficient way.Limited by operating budgets and IT hardware conditions,most small and medium-sized enterprises choose standardized cloud conferencing products.However,standardized cloud conference products are difficult to meet the needs of special scenarios such as employee training and operation demonstration,and there are risks of internal data leakage by third-party platforms.To solve the above problems,this paper designs and implements a lightweight video conferencing system that supports private deployment.The system allows users to schedule meetings,view historical meetings,manage accounts,make audio and video calls,and share screens,to meet remote meeting requirements.In addition,the system integrates the screen whiteboard function,allowing users to draw marks on the screen when sharing screen,which meets the special requirements of operation demonstration meetings.Thesis firstly investigates the development status of video conference system and the research status of target tracking technology.And then combined with application scenario,the requirements of the system are put forward.Next,we complete the design and implementation of the system architecture,functional modules and business processes.The system is composed of client,signaling server and SFU server based on C/S architecture to provide conference service.In addition,in order to realize that the whiteboard handwriting moves with the screen content,we improve the traditional template matching algorithm and propose a screen image tracking algorithm based on block template matching.The proposed algorithm solves the problem of loss of targets caused by image layout changing by using traditional template matching algorithm.The test proves that the algorithm is feasible in the actual scenarios and OTB dataset.In the last stage of this thesis,the system is proved to operate efficiently and stably by a test on function and performance,which meets expectations.