Blind users can now explore photos by touch with Microsoft’s Seeing AI

Posted on

Microsoft’s Seeing AI is an app that lets blind and limited-vision people convert visible information into audio suggestions, and it simply obtained a helpful new feature. Users can now use touch to explore the objects and people in photos.

It’s powered by machine studying, in fact, particularly object and scene recognition. All it's worthwhile to do is take a photo or open one up within the viewer and faucet anyplace on it.

“This new feature allows users to faucet their finger to an image on a touch-screen to listen to a description of objects inside an image and the spatial relationship between them,” wrote Seeing AI lead Saqib Shaikh in a weblog put up. “The app can even describe the bodily look of individuals and predict their temper.”

As a result of there’s facial recognition in-built as properly, you might very properly take a picture of your folks and listen to who’s doing what and the place, and whether or not there’s a canine within the picture (necessary) and so on. This was doable on an image-wide scale already, as you can see on this image:

However the app now lets users faucet round to search out the place objects are — clearly necessary to understanding the picture or recognizing it from earlier than. Different particulars that won't have made it into the general description might also seem on nearer inspection, similar to flowers within the foreground or a film poster within the background.

Along with this, the app now natively helps the iPad, which is definitely going to be good for the many individuals who use Apple’s tablets as their primary interface for media and interactions. Lastly, there are a number of enhancements to the interface so users can order issues within the app to their choice.

Seeing AI is free — you can download it for iOS devices here.

Source : TechCrunch