Design And Implementation Of Human-machine Visual Interaction System For Bluetooth Devices

With the advent of the Internet of Things era,wireless devices have penetrated every corner of daily life,playing an increasingly significant role in smart homes,smart transportation,intelligent manufacturing,environmental detection,etc.With the advent of many IoT devices,traditional connection methods are too redundant,such as the form of interaction based on text connection lists is not convenient enough.When many connectable devices appear in the list,users cannot quickly and effectively select the Bluetooth devices that need to be connected.How to interact with it in an intuitive way,providing users with a convenient and operable interaction method is an urgent problem to be solved.Therefore,this paper introduces the direction-seeking function of Bluetooth devices and the semantic recognition function of computer vision technology into this study.The research ideas of this paper are as follows: Firstly,the opportunity of Ao A proposed by Bluetooth 5.1and the system support of existing mobile devices for hardware functions such as camera and level are used to explore a more stable and intuitive device identification and positioning method,and then the human-machine visual interaction prototype system for Bluetooth devices is constructed.The specific research work of this paper includes:(1)An angle estimation mechanism based on level: In this study,a practical and reliable azimuth and elevation estimation mechanism is realized using the direction-finding function in Bluetooth 5.1 protocol,the principle of camera pinhole imaging,and the detection method of equipment motion state by level.It simplifies the user’s operation process and improves the method’s robustness so that it has higher practicability.The user can sense the direction of the target device relative to the receiving device and locate the source of the signal on the camera screen.(2)A single matrix matching mechanism: in this paper,we study the homographic matrix in computer vision is used to match Ao A point cloud information and visual inspection of the two heterogeneous modal information,which can be the location of the signal source coupled with visual inspection to the semantic information,to provide users with more intuitive and accurate object interaction.Compared with the previous work,this paper not only realizes the device positioning function but also provides users with a novel visual device identification method to enhance the interactive user experience.This study builds a prototype system of human-computer visual interaction for Bluetooth devices based on these two mechanisms.In this paper,many experimental evaluations are carried out in many real-life scenarios such as laboratories and teaching and research departments.The experimental results can be verified in the following two aspects: i)the positioning accuracy error of wireless signal is 8.3cm.In this study,users’ operation steps are simplified while maintaining high positioning accuracy.The proposed system has more practical operability and robustness;ii)The device identification and positioning accuracy exceeds 90%.In order to verify the actual operability of the system,the system is deployed in several different environments and evaluated experimentally.Experimental results show that the system proposed in this paper can not only accurately identify the target device but also provide users with interactive objects with semantic information.This study promotes the related applications of intelligent device identification,positioning,and interaction and supports the construction of more extensive and convenient scenarios for IoT devices.