Earticle

초록

영어

Human-computer interaction (HCI) has great potential for applications in many fields. A HCI method has been developed based on audio-visual perceptive features and dynamic interactive pooling. A mode analysis based fusion strategy is proposed to fuse the interactive responses from audio-visual modalities especially for the case there are deviations from the modalities at the same time. The developed approach can be applied with a better performance even in single modal with multiple interactive users in the scenario. The users in the scenario are endowed with a fair chance to perform HCI by their interactive priorities no matter how many modalities used, and the interactive authority and priority are updated dynamically according to the variation of HCI content. The scenario and multiple users altogether are regarded as a dynamic HCI pooling. The diversity of interactive habits among multiple users is considered in an ordinary hardware from a crowded scene without any hypothesis for the scenario contents in advance. The pooling is updated dynamically to meet the user demands with the most intentions preferentially. Comparative study with state-of-the-arts has indicated the superior performance of the proposed method.

목차

Abstract
 1. Introduction
 2. Visual-Audio Perceptive Features Based HCI
  2.1 Visual Features Based HCI
  2.2 Audio Features Based HCI
  2.3 Dynamic Interactive Pooling Based HCI
 3. Experimental Results and Analysis
  3.1 Parameter Analysis
  3.2 Experimental Results
 4. Conclusions
 Acknowledgements
 References

키워드

저자

• Yulong Li [ School of Communication and Information Engineering, Shanghai University ]
• Yepeng Guan [ Yepeng Guan1 | School of Communication and Information Engineering, Shanghai University, Key Laboratory of Advanced Displays and System Application, Ministry of Education ] Corresponding author
• Jinfeng Ma [ School of Communication and Information Engineering, Shanghai University ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Multimedia and Ubiquitous Engineering

• 간기

  월간

• pISSN

  1975-0080

• 수록기간

  2008~2016

• 등재여부

  SCOPUS

• 십진분류

  KDC 505 DDC 605