ScribeMe Expands AI Accessibility Tools with Continuous “Live Assist” On New Smart Glasses Integration

Mark Murad, founder of ScribeMe, has confirmed to Double Tap new capabilities in the app’s AI-powered accessibility platform, including continuous scene description and integration with smart glasses.

Speaking on the podcast, Murad outlined how the latest updates aim to reduce reliance on repeated prompts and improve real-time environmental awareness.

ScribeMe, available on mobile after initially launching on PC, combines document accessibility, image recognition, and live AI assistance. Murad said the app can “scan documents… and also describe any images found inside the files while preserving the format,” addressing ongoing challenges with inaccessible PDFs and presentations.

A key feature is its enhanced image recognition system, which includes facial recognition. Users can upload photos of people they know, allowing the app to identify individuals by name rather than using generic descriptions such as “a man or a woman.”

The most significant development is the “Live Assist” feature. Murad described it as “a live AI that can see through your phone’s camera and also the meta glasses,” referring to integration with devices from Meta. Unlike traditional AI tools, Live Assist can continue describing surroundings after a single prompt. “You ask once and the AI can continuously describe your surroundings without needing to prompt every time,” he said.

Murad, who is blind, explained that the app’s development is driven by his own experiences navigating education and daily life. He created ScribeMe after encountering barriers to studying visual subjects, adding features based on “the problems I face in my life… and then hope to help others as well.”

The app has been available on mobile for around a year, with recent updates—particularly smart glasses integration—driving renewed interest.

The introduction of continuous AI description and wearable integration reflects a broader shift toward persistent, hands-free accessibility tools. For users, this could reduce friction in tasks such as navigation, social interaction, and document access, areas where existing solutions often require repeated input.

Resources

• ScribeMe official website https://scribeme-ai.com