Twenty-First Century Captioning Technology, Metrics and Usability (Captioning DRRP)

Captioned video is essential for the 36 million Americans who are deaf or hard of hearing, and access to the captioned video directly impacts participation in society.

In the twenty-first century, video is everywhere: entertainment, news, political engagement, government, schools, postsecondary education, at-home learning, social engagement, and much more.

Yet, captioning has not kept up with the shift from broadcast TV to video that can be produced by anyone. The technology and processes for creating captions are fundamentally the same as in the 1980s and 1990s. They do not serve the needs of consumers today.

Today, our personal devices have high-quality screens and can support customized captions. At the same time, automatic speech recognition can improve caption quality and the availability of captions. We are in the middle of a disruptive transition to captions that can be viewed anywhere, anytime.

These new technologies create different types of caption errors. This is compared with human captioning techniques that have evolved over 40 years. As a result, there has been much consumer frustration. With these new technologies, it is critical to understand how caption errors impact consumers who rely on captioned video.

We need a way to measure whether captions on a video are good enough for consumers. We also need to understand how modern consumer electronics could support better caption use and viewer experiences.

The Twenty-First Century Captioning Usability & Metrics project has two goals to support the technology transition:

• to develop consumer-focused metrics for caption quality.
• to improve caption usability on all devices.

We have formed a deaf-led five-year research partnership between Gallaudet University, Rochester Institute of Technology, and AppTek to achieve these goals. Our approach embraces the perspective of a diverse range of stakeholders, including consumers, caption providers, broadcasters, and other video distributors.