Apple has released several new accessibility features for iPhone, Apple Watch and Mac, including a universal direct captioning tool, improved hearing and sight detection modes, and iOS access to the WatchOS apps. New opportunities will emerge “later this year” as updates apply across platforms.
The most commonly used tool is probably direct captioning, which is already very popular with tools like Ava, which raised $10 million the next day to expand its repertoire.
Apple’s tool will perform a similar function to Ava, essentially allowing writing of any spoken content the user encounters in real time, from videos and podcasts to FaceTime and other calls. Notably, FaceTime will have a special interface with a rewind transcription specific to video windows.
Captions can be enabled through the usual easy access settings and can be quickly toggled on and off or expanded or folded in the panel they appear in. And it’s all done using the device’s built-in ML acceleration technology, so it works if you have a weak or non-existent connection and you’re not worried about your privacy.
This feature can give wings to independent providers of similar services, as is often the case when companies traditionally deploy their own versions of third-party tools, but it can also increase quality and competition. Choosing between multiple carriers isn’t bad, and users can easily switch between them if it feels like Apple’s solution is better for FaceTime, while others, like Ava, may do better than others. situations. For example, Ava allows you to save call logs for later retrieval; This is not an option for Apple subtitles, but it is certainly useful in work situations.
Image Credits: apples
Apple Watch apps have improved access on two fronts. First, there are some extra hand gestures for people, for example. For amputees who struggle to handle small screens. Many new actions are available with gestures such as “Double Catch” that allow you to pause your workout, take a photo, answer a call and much more.
Second, WatchOS apps can be displayed on iPhone screens where other accessibility tools can be used. This is also useful for those who like Apple Watch-specific smartwatch use cases but find it difficult to interact with the device on their own terms.
Existing tools The magnifying glass and speech recognition also have new functions. The magnifying glass in the “detection mode” usually lets the user know if there is a person or something for them to read or describe: “Person, 1.5 meters ahead”. It now has a special “door recognition” mode that provides details about the building’s key features.
Image Credits: apples
The door mode, which can be turned on or off at will like any other, informs the user whether he sees the camera in front of the door, how far it is, whether it is open or closed, and all the relevant information put on it. † , Like the room number or address, the store is closed if an entrance is available.
Speech recognition is a useful option for the hearing impaired who want to be alert, for example when the doorbell rings or the oven rings. While the feature previously had a library of sound types it worked with, users can now practice the model locally to extract typical sounds from their home. Given the variety of alarms, buzzwords, and other sounds we all encounter on a regular basis, this should come in very handy.
Finally, there is a toy making feature called the Buddy Controller. This allows two controllers to act as one, so one person can play with the help of seconds if it’s difficult or stressful to do everything independently. Given the complexity of some games, even on mobile devices, this can be very useful. Sometimes I wish my gaming partner had a dedicated controller so I don’t have to deal with game cameras.
There are other minor updates, such as adjusting Siri’s wait time before answering a question (perfect for slow talkers) and an additional option for adjusting text in Apple Books. And VoiceOver is coming soon with 20 new languages and locales. We’ll learn more about exact timing and availability when Apple makes more specific announcements in the future.
John Cameron is a journalist at The Nation View specializing in world news and current events, particularly in international politics and diplomacy. With expertise in international relations, he covers a range of topics including conflicts, politics and economic trends.
