查询结果:   王增磊,张树生,白晓亮.面向协同装配的混合现实手眼交互技术研究[J].计算机应用与软件,2019,36(1):251 - 258.
中文标题
面向协同装配的混合现实手眼交互技术研究
发表栏目
图像处理与应用
摘要点击数
689
英文标题
MIXED REALITY HAND-EYE INTERACTION TECHNOLOGY FOR COLLABORATIVE ASSEMBLY
作 者
王增磊 张树生 白晓亮 Wang Zenglei Zhang Shusheng Bai Xiaoliang
作者单位
西北工业大学现代设计与集成制造教育部重点实验室 陕西 西安 710072     
英文单位
Key Laboratory of Contemporary Design and Integrated Manufacturing Technology, Ministry of Education, Northwestern Polytechnical University, Xi’an 710072,Shaanxi, China     
关键词
混合现实 协同 手眼交互 装配
Keywords
Mixed reality Collaboration Hand-eye interaction Assembly
基金项目
中央高校基本科研业务费专项(3102015BJ(II)MYZ21)
作者资料
王增磊,讲师,主研领域:AR技术在先进制造中的应用。张树生,教授。白晓亮,副教授。 。
文章摘要
针对MR协同装配工作中存在的复杂人机交互问题,提出一种基于眼动追踪和手势识别的多通道交互方法。采用注视线检测和注视点检测对目标物体进行预选取。通过手势识别完成对候选目标物体的确认和相关操作。实验结果表明,该方法能实现对遮挡、微小尺寸、远距离目标对象的选取和操作。同时,协同装配实验验证了该方法在协同工作中的可行性。〖KH*1/2D〗
Abstract
A multi-channel interaction method based on eye tracking and gesture recognition was proposed to solve the complex human-machine interaction problem in MR collaborative assembly work. The method pre-selected the target object by the gaze line detection and the gaze point detection. The gesture recognition was used to accomplish the confirmation and related operation of the target object. The experimental results show that the method can achieve the selection and operation of occlusion, micro-size and long distance target objects. Collaborative assembly experiment verifies the feasibility of the proposed method in collaborative work.
下载PDF全文