Earticle

초록

영어

To overcome the decrease in the recognition rate of voice recognition in noisy environments, the implementation of Audio Visual Speech Recognition (AVSR), which combines voice and lip information, has been attempted since the 1990s. This study aims to investigate the discrimination of various features extracted from lip image data using dynamic time warping (DTW) as an objective function to implement a robust lip-reading system as the core process of AVSR. The features taken from existing literature are grid-based features, including gray level, optical flow, and Sobel operator gradient, and various ratios of lip shapes calculated based on coordinates. According to the results of the application of DTW to respective feature generation methods using 180 pieces of data collected from ten study subjects who each uttered six isolated words three times, the mean recognition rate was found to be up to 60.55%. The feature that showed the highest recognition rate was the combined vector of a width/height ratio of the outer lip and the height of the inner lip, and grid-based features were found to outperform coordinate-based features in the recognition rate of certain words.

목차

Abstract
 1. Introduction
 2. Features of Mouth Shape for the Korean Language
 3. Generation of Various Mouth-Shape Features
 4. Experiment and Results
 5. Conclusions
 References Abstract
 1. Introduction
 2. Features of Mouth Shape for the Korean Language
 3. Generation of Various Mouth-Shape Features
 4. Experiment and Results
 5. Conclusions
 References

키워드

저자

• Yong-Ki Kim [ Dept. of Computer Engineering, Chungbuk National University, CheongJu, Korea ]
• Jong Gwan Lim [ Dept. of Mechanical Engineering, KAIST, Daejeon, Korea ]
• Sahngwoon Lee [ Systran International ]
• Mi-Hye Kim [ Dept. of Computer Engineering, Chungbuk National University, CheongJu, Korea ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Multimedia and Ubiquitous Engineering

• 간기

  월간

• pISSN

  1975-0080

• 수록기간

  2008~2016

• 등재여부

  SCOPUS

• 십진분류

  KDC 505 DDC 605