查询结果:   于鲲,殷继彬.基于头部姿态与面部特征混合手势的设计与研究[J].计算机应用与软件,2018,35(12):209 - 215,258.
中文标题
基于头部姿态与面部特征混合手势的设计与研究
发表栏目
图像处理与应用
摘要点击数
629
英文标题
DESIGN AND STUDY ON HYBRID GESTURES BASED ON HEAD GESTURES AND FACIAL FEATURES
作 者
于鲲 殷继彬 Yu Kun Yin Jibin
作者单位
昆明理工大学信息工程与自动化学院 云南 昆明 650000     
英文单位
Information Engineering and Automation Institution, Kunming University of Science and Technology, Kunming 650000, Yunnan, China     
关键词
面部手势 人机交互 人脸检测 生物特征 头部姿态
Keywords
Facial gesture Human-computer interaction Face detection Biological characteristic Head gesture
基金项目
国家自然科学基金项目(61741206)
作者资料
于鲲,硕士,主研领域:计算机人机交互。殷继彬,副教授。 。
文章摘要
目前国内外对于交互手势的研究趋势大多集中在对于手势的单一研究,而对于脸部手势和头部姿态作为输入量的研究区域涉及较少。将面部手势和头部姿态作为输入量,设计一套基于“脸表情+头部姿态”的混合交互手势,丰富了多通道交互。分析混合交互手势的定义、头部姿态的识别、面部手势识别以及面部手势和头部姿态处理流程。基于Face++的人脸关键点检测技术,根据检测出来的面部特征和头部姿态,设计混合交互手势,来实现与计算机的交互。用Java语言实现4组混合手势应用并对面部和头部姿态混合手势技术进行测试与分析。结果表明,“脸表情+头部姿态”的混合交互手势,有助于双手不便的残疾人士更加方便地与计算机进行交互,同时减轻双手的负担。
Abstract
At present, the research trends of interactive gestures at home and abroad mostly focus on the single study of hand gestures, while there are fewer involved areas in which face gestures and head gestures are taken as input. We used the facial gestures and head gestures as inputs to design a set of mixed interaction gestures based on face expression and head pose, which enriched multi-channel interaction. The paper analyzed the definition of mixed interactive gestures, recognition of head gestures and facial gestures, and the processing flow of facial gestures and head gestures. Face key point detection technology was based on Face++. According to the detected facial features and head posture, a hybrid interactive gesture was designed to achieve the interaction with the computer. Four mixed gesture applications were implemented in Java. We tested and analyzed the hybrid hand gestures based on facial and head gestures. The results show that the mixed interactive gestures based on face expression and head posture is more helpful for the handicapped with inconvenient hands to interact with the computer more conveniently and lighten the burden of hands.
下载PDF全文