MyeungHoon Kim, JaRyeong Koo, Velda Vania, WonJun Yoon, MinHong Lee, Daewon Song
언어
영어(ENG)
URL
https://www.earticle.net/Article/A486508
※ 원문제공기관과의 협약기간이 종료되어 열람이 제한될 수 있습니다.
원문정보
초록
영어
In this paper, we present a novel AI-assisted IPTV broadcasting system (AIBS) for real-time automatic VOD subtitle generation. The proposed system generates subtitles using Digital TV-Closed Caption (DTV-CC) data and decides the display time of VOD subtitles via utilizing the latest AI technology. With this approach, the problems of subtitle accuracy and display time errors of existing STT systems can be resolved. First, we introduce a method for obtaining subtitle information through DTV-CC in the existing IPTV broadcasting system. Then, the align function of the Stable-TS is adopted to obtain the display time of the subtitles and, for a more accurate time, various noises other than voices in the input audio signal are filtered with deep learningbased background noise removal technology as pre-processing. Finally, if the subtitle display time provided by Stable-TS is abnormal, the display time information is corrected using an NLP-based post-processing technology that utilizes the speaker separation information and relative time information of DTV-CC. Experimental results shows that the average accuracy, which was 87% when using Stable-TS alone, improved by 7% to an average of 94% after applying AIBS on testing the accuracy of subtitle synchronization for approximately 3,000 sentences. In addition, by applying AIBS to the existing IPTV broadcasting system that generates quick-VOD based on linear channels, the problem of manually generating VOD subtitles that took 4 hours was reduced to less than 10 minutes, improving customer satisfaction.
목차
Abstract 1. Introduction 2. Related Works 2.1 Advancements and Challenges in STT Technology 2.2 Whisper Model and Latest Extention Technologies 3. The Proposed System 3.1 Integration with VoD Quick Delivery System and DTV-CC extraction 3.2 Audio Processing 3.3 Post-Processing with DTV-CC 4. The Experimental Results 5. Conclusions References