Android's TalkBack Now Describes Images

05/15/2025 Software

Google has significantly enhanced Android's accessibility features, particularly its built-in screen reader, TalkBack. Leveraging the power of its Gemini AI model, TalkBack now offers image description capabilities. This means users can ask questions about images, even those lacking alt text, receiving detailed answers about content, color, and other details. For instance, if a friend sends a picture of a guitar, the user can ask about its make, color, or even other objects in the image.

Beyond Images: Enhanced Accessibility Across the System

The Gemini integration extends beyond simple image description. The Q&A functionality works system-wide, allowing users to query information within any on-screen content. Online shopping becomes more accessible, as users can ask about product details like color or pricing directly through TalkBack.

Expressive Captions: More Emotion, More Nuance

Google also updated its Expressive Captions feature. This improves the accuracy and expressiveness of subtitles by including emotional cues like "[groaning]" or capturing the extended pronunciation of words, such as "gooooooooal!" in a sports broadcast. This enhancement provides a richer and more engaging experience for users with hearing impairments or those in noisy environments. The rollout initially targets English-speaking users in specific countries with Android 15 and above.