AI tools for blind and low-vision people, explained: what Guided Vision, AI glasses and Be My Eyes can do
AI that describes the world out loud has gone from a novelty to something people use daily. Here's what today's phone and glasses tools can do, how they differ, and where to be careful.
By ScoviAI Team
Key points
- Google's Guided Vision in Gemini Live describes a live camera view and coaches you to aim it
- Ray-Ban Meta AI glasses read text and identify objects hands-free; a Milan museum now uses them for art tours
- Be My Eyes connects users with sighted volunteers through the phone or glasses
- AI descriptions can be wrong; double-check things like medication labels
For someone who is blind or has low vision, reading a menu, finding a dropped earbud or checking a jacket's color can mean asking for help. AI is starting to change that. October brought several new tools, and they work in different ways.
The three main types of tools
| Type | Example | How it works |
|---|---|---|
| Phone camera assistant | Google's Guided Vision in Gemini Live | Point your phone; the AI describes what it sees and answers questions |
| AI glasses | Ray-Ban Meta AI glasses | A camera in the frames; answers play through open-ear speakers |
| Human help | Be My Eyes | Connects you to a sighted volunteer through your phone or glasses |
Phone: Guided Vision in Gemini Live
Google's Guided Vision turns Gemini Live into a conversation about your surroundings. What sets it apart is reframing cues: if the camera is pointed too high or too close, Gemini tells you to pan right, tilt down or step back. It was built with Aira and tested by more than 1,000 people. It's available on compatible Android phones.
Good for: reading small print, finding objects, checking colors, getting a sense of an unfamiliar room.
Glasses: hands-free help
AI glasses put the camera at eye level and keep your hands free, which matters when you're also holding a cane or a guide dog's harness. Meta says its glasses help with reading text, identifying objects and describing surroundings. Two programs this month show where this is heading:
- In Milan, the Pinacoteca di Brera museum launched a pilot where the glasses recognize eight masterpieces and play audio descriptions.
- In Singapore, Meta is donating 1,000 pairs to disability organizations, plus funding for free training.
Read more in Meta's AI glasses become an accessibility tool.
Human help: Be My Eyes
AI isn't always the right answer. Be My Eyes connects you with sighted volunteers and trained operators in real time, and it's built into the Milan museum pilot alongside the AI tour. For tricky or high-stakes tasks, a person can be more reliable.
Where to be careful
AI descriptions can sound confident and still be wrong. A few rules of thumb:
- Double-check anything important, like medication labels, dosages, expiry dates or money.
- Don't rely on AI for safety at street crossings or on stairs; keep using your usual mobility tools.
- Think about privacy. Cameras capture other people too, and some features send images to the cloud.
Who else benefits
Google notes that tools like Guided Vision also help older adults, people with low literacy and anyone reading fine print in poor light. Many accessibility features end up being useful for everyone.
Sources
ScoviAI Team is the ScoviAI newsroom. We write every article ourselves from the original announcements and link our sources. Spotted a mistake? Tell us and we'll fix it.
ADVERTISEMENT
