18-899 Special Topics in Signal Processing
Midsemester Project Report
Group members:
Jie Huangfu, Bengliang Koh, Jon Nedel

Synchronized Captioning System
Using MPEG-4 and SPHINX


To implement a system that will encode a television signal with closed captioning information into an MPEG-4 compatible bitstream with the captions on a separate scaleable layer, and to implement the decoder to decode and display the bitstream while allowing the user to adjust the appearance of the captions.

In addition, SPHINX voice recognition software will be used to compensate for the time delay inherent in closed captioning for live broadcasts, so as to achieve better synchronization between the speech and the captions.

System Block Diagram


Upcoming work