Google Launches Guided Vision to Assist Users With Low Vision

Google has introduced Guided Vision, a new feature within Gemini designed to assist users who are blind or have low vision. By integrating the tool into Gemini Live, the company allows users to point their smartphone camera at their surroundings to receive audio descriptions of objects, labels, or small text. The system also supports follow-up queries, such as asking the artificial intelligence to clarify an expiration date or specific product details.

Functionality and Integration

The feature is available today on compatible Android devices. Beyond the core Gemini application, it has been integrated into Google TalkBack. Users can also configure an accessibility shortcut via the settings menu for any device running Android 9 or later. The Scale Report understands that the system includes haptic or audio cues to help users align their camera if the object of interest is outside the current frame.

Comparison and Constraints

This development mirrors Apple's existing VoiceOver Live Recognition feature, which provides similar visual translation capabilities for iPhone and Vision Pro users. The tool was first unveiled during recent Pixel updates.

Despite the advancement, the company explicitly warns that Guided Vision is not a substitute for mobility aids like canes. It should not be utilized for obstacle detection or safe travel navigation. This distinction is critical as big tech companies continue to refine multimodal models for daily accessibility, balancing the potential of computer vision with the reality of current technical limitations in high-stakes environments.