2024年第51卷第1期目录
|
|
封面故事:该文提出了一种利用高科技与人工结合实现“远程虚拟陪伴”的概念。在AI技术还不
能完美实现机器视觉和精准判断的当下,该系统借助远程无线网络通讯技术,利用前方人员随身
佩戴的微处理器、微型摄像头和超声波等多种传感器获取环境与佩戴者信息,通过云端将这些综
合信息传输到远方后台,使得在异地、异城、异国的后台服务人员能够远程、实时了解前方环境
与人员状态,并在各类AI技术辅助下,通过发出触觉编码指令、与前方人员实时语音交流,实现
对前方人员的出行陪伴、远程指导和导航,帮助盲人了解周边环境等远程虚拟陪伴功能。该系统
后台人工识别判断与AI技术并用,既为使用者提供人文关怀,又大大提高了远程盲人导航的安全
性,增强了用户体验的舒适性和灵活性。实测结果表明,这种远程虚拟陪伴装置与软件系统不仅
适用于陪伴指引视觉障碍者出行、购物、娱乐等,也适用于陪伴老人出行和居家生活,还可以作
为旅行、探险等活动的辅助工具,有广泛的应用前景。
(葛 松,黄轩拓,林衍旎,李沿橙,董问天,党卫民,徐晶晶,伊 鸣,许胜勇. 通过触觉编码和声音为视力
障碍者提供远程虚拟陪伴,本期第158~176 页)
Cover Story:Objective Existing artificial vision devices can be divided into two types: implanted devices and extracorporeal devices, both of which have some disadvantages. The former requires surgical implantation, which may lead to irreversible trauma, while the latter has some defects such as relatively simple instructions, limited application scenarios and relying too much on the judgment of artificial intelligence (AI) to provide enough security. Here we propose a system that has voice interaction and can convert surrounding environment information into tactile commands on head and neck. Compared with existing extracorporeal devices, our device can provide a larger capacity of information and has advantages such as lower cost, lower risk, suitable for a variety of life and work scenarios.Methods With the latest remote wireless communication and chip technologies, microelectronic devices, cameras and sensors worn by the user, as well as the huge database and computing power in the cloud, the backend staff can get a full insight into the scenario, environmental parameters and status of the user remotely (for example, across the city) in real time. In the meanwhile, by comparing the cloud database and in-memory database and with the help of AI-assisted recognition and manual analysis, they can quickly develop the most reasonable action plan and send instructions to the user. In addition, the backend staff can provide humanistic care and emotional sustenance through voice dialogs.Results This study originally proposes the concept of “remote virtual companion” and demonstrates the related hardware and software as well as test results. The system can not only achieve basic guide functions, for example, helping a person with visual impairment to shop in supermarkets, find seats at cafes, walk on the streets, construct complex puzzles, and play cards, but also can meet the demand for fast-paced daily tasks such as cycling.Conclusion Experimental results show that this “remote virtual companion” is applicable for various scenarios and demands. It can help blind people with their travels, shopping and entertainment, or accompany the elderlies with their trips, wilderness explorations, and travels.
|
综述与专论
研究报告
技术与方法
|
|