Apple Unveils On-Device Automatic Captioning for Personal Videos in iOS 27

Apple has previewed a groundbreaking accessibility feature arriving later this year: automatic captions for personal videos. The technology, powered by an on-device speech recognition model, will let users add subtitles to videos they record, receive, or stream—without uploading anything to the cloud. This move underscores Apple’s commitment to inclusive design and privacy-first innovation.

How Automatic Captions Will Work

The new feature is built into iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27. When a video lacks existing captions, the system automatically generates them by analyzing spoken audio in real time. Apple says the process is entirely local, so your data never leaves the device.

On-Device Speech Recognition

Unlike cloud-based captioning services, this solution uses a specialized on-device model optimized for speed and accuracy. It works with videos you shoot on your iPhone, clips friends share with you, and even streamed content from supported apps. The model currently supports English in the United States and Canada, with other languages expected in future updates.

Supported Content Types

Apple confirmed the following video sources will be compatible:

• Personal recordings made on iPhone, iPad, or Mac
• Videos received via Messages, AirDrop, or other sharing methods
• Streamed videos from websites or apps that lack embedded captions

The feature will not be limited to Apple’s own apps—third-party video players can adopt the captioning API as well.

Privacy and Customization

As with all Apple privacy initiatives, the captioning process remains completely private. Because speech recognition runs on the device, no audio or transcript data is sent to Apple’s servers. Users can also personalize the appearance of captions: choose font, size, color, and background opacity directly in the video playback menu or via the Settings app under Accessibility > Subtitles & Captioning.

“We believe technology should be usable by everyone,” said an Apple representative in a statement. “This feature empowers people with hearing impairments, those learning new languages, or anyone who wants to follow video dialogue in noisy environments.”

Availability and Device Compatibility

Automatic captions will roll out later this year across all major Apple platforms:

• iPhone and iPad running iOS 27 / iPadOS 27
• Mac with macOS 27
• Apple TV with tvOS 27
• Vision Pro with visionOS 27

Initial availability is English only for users in the U.S. and Canada, with regional expansions likely in subsequent updates. The feature will require devices with at least an A13 Bionic chip (iPhone 11 and later, iPad 7th gen and later) or Apple Silicon Macs.

What to Expect at WWDC 2026

Apple will officially unveil these automatic caption capabilities during the WWDC 2026 keynote, scheduled for Monday, June 8, 2026 at 10:00 a.m. Pacific Time. Developers will gain early access to the captioning APIs in the first beta of iOS 27, allowing app makers to integrate the feature ahead of the public release in September.

The company is also expected to demonstrate how the captioning system handles multiple speakers, background noise, and fast speech. Additional accessibility announcements—such as improved VoiceOver support and new Sound Recognition options—may accompany the caption preview.

Conclusion

By bringing on-device automatic captions to personal videos, Apple is closing a critical gap in digital inclusion. Whether you’re preserving family memories, sharing a lecture, or watching a live stream, this feature ensures that everyone can follow along. With a strong focus on privacy, customization, and cross-device support, iOS 27’s captioning tool promises to be one of the most impactful accessibility updates in recent memory. Stay tuned for full details during WWDC 2026.

This article first appeared on MacRumors.com. Discuss in our forums.