Apple announces Apple Intelligence powered accessibility feature updates
Quick Answer
Apple has unveiled new accessibility features powered by Apple Intelligence, enhancing VoiceOver, voice control, and real-time captioning for videos.
Quick Take
Apple has unveiled new accessibility features powered by Apple Intelligence, enhancing VoiceOver, voice control, and real-time captioning for videos. Vision Pro users can now control compatible wheelchairs with their eyes, while AI-generated subtitles and improved document handling in Reader cater to diverse disabilities. These updates are expected to roll out with iOS 27 later this year.
Key Points
- VoiceOver's image recognition can now read bills and describe photographs in detail.
- Live Recognition feature allows iPhone users to identify content and ask follow-up questions.
- AI-generated subtitles will be available for videos lacking pre-generated captions.
- Vision Pro users can control compatible wheelchairs using eye movements without recalibration.
- Name recognition now supports 50 languages for users with hearing disabilities.
📖 Reader Mode
~3 min readAhead of Google’s annual developer conference on Tuesday, Apple announced several new accessibility updates powered by Apple Intelligence to features like VoiceOver, voice control, live recognition, and real-time caption generation for videos. The company also said that Vision Pro users will be able to control a compatible wheelchair with their eyes using this update.
The company said that Apple Intelligence’s image recognition feature in VoiceOver will understand the image better and describe it in greater detail. For instance, it can look at a bill and read out the details such as the amount and due date. Apple said that the updated feature can also better describe photographs and personal records.
Users can now use an iPhone to activate the Live Recognition feature, which uses a camera to identify content in the frame, and also ask follow-up questions to know more. Users with low vision can also assign Magnifier to the action button, which presents content on a high-contrast interface. Plus, they can use voice commands such as “zoom in” or “turn on flashlight” to access features.
Loading the player…
The voice command update is not limited to the Magnifier app. Apple said that users can describe tasks in natural language to take action on what they see on the screen. For instance, in Apple Maps, they can say “tap the guide about best restaurants,” or in Files, they can say “tap the purple folder.”
The company is also updating Reader, which can now handle documents like scientific papers with multiple columns, images, and tables.
Users can get AI-powered summaries or read the text in the native language with custom fonts and colors retained. The company added that the updated reader can cater to different disabilities such as dyslexia and low vision.
What’s more, Apple is adding AI-generated subtitles for videos that don’t have pre-generated captions. This includes videos recorded on an iPhone or clips received from friends or family. These generated subtitles will work across iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, and users can control their appearance.
In addition, the company announced a new project where Vision Pro users can control their compatible wheelchairs with their eyes. Apple said that the feature can work under varying lighting conditions without recalibration. The feature will launch with Tolt and LUCI alternative drive systems in the U.S. with accessory support for both Bluetooth and wired connections.
Apple noted the name recognition feature, which notifies users with hearing disabilities when someone says their name, now supports 50 languages. Plus, the company will roll out large text support to tvOS. Apple also said that Made for iPhone hearing aids will handle handoff between different devices better.
The company said that these features will be available to users later this year. They are likely to be part of Apple’s upcoming iOS 27 release.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
Ivan covers global consumer tech developments at TechCrunch. He is based out of India and has previously worked at publications including Huffington Post and The Next Web.
You can contact or verify outreach from Ivan by emailing im@ivanmehta.com or via encrypted message at ivan.42 on Signal.
— Originally published at techcrunch.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from TechCrunch
See more →
Qualcomm wants to be the chip inside whatever replaces your smartphone, and it just announced two products toward that end
Qualcomm is developing over 40 new AI hardware designs aimed at becoming the core technology in devices that will replace smartphones. This strategic move highlights Qualcomm's ambition to lead in the next generation of mobile computing, focusing on AI integration across various platforms.
