New Methodology and Software for Improving Subtitle Presentation in Movies and Videos


Grant Data
Project Title
New Methodology and Software for Improving Subtitle Presentation in Movies and Videos
Principal Investigator
Professor Wang, Wen Ping   (Project coordinator)
Co-Investigator(s)
Dr Chan Bin   (Co-Investigator)
Professor Yu Yizhou   (Co-Investigator)
Duration
7
Start Date
2015-06-04
Completion Date
2016-01-30
Amount
42630
Conference Title
Presentation Title
Keywords
New Methodology and Software, Improving Subtitle Presentation in Movies and Videos
Discipline
Others - Physical Sciences
Panel
Engineering
HKU Project Code
InP/099/15
Grant Type
Innovation and Technology Fund Internship Programme
Funding Year
2014/2015
Status
On-going
Objectives
A new technology will be developed in this project that improves upon the traditional subtitle presentation in movies and videos. In this improved presentation, subtitles associated with different speakers in a video will be placed right next to the associated speakers, so viewers can better understand what is spoken without having to move the eyeballs too much between the speaker and the subtitle, thus greatly reducing eyestrain. Furthermore, with the aid of the improved subtitle, viewers with hearing impairment can clearly associate the speaker with the spoken contents, therefore enhancing their video viewing experience. We shall apply advanced computer vision techniques to face detection and lip motion detection to identify speakers in a video scene. We shall also study the optimal placement of subtitles around an identified speaker. Finally, a prototype software system will be developed that takes a subtitled video in a standard format and produces a new video with the improved subtitle presentation. As indicated by our initial user study, the outcome of this project holds the promise of benefitting all the people viewing a subtitled video and in particular those with hearing difficulty.