PiccyBot Expands to Smart Glasses as Meta Opens Platform to Third-Party Apps

The developer behind the popular accessibility app PiccyBot, has confirmed that the service is now in beta testing for smart glasses.

Speaking on the Double Tap podcast, Martijn Van der Spek revealed that PickyBot can now integrate with Meta’s smart glasses, following the company’s decision to open its platform to third-party apps. This development could provide blind and partially sighted users with live image and video descriptions directly through wearable devices.

PiccyBot, originally designed to provide detailed image descriptions, has evolved to handle video, PDFs, and multi-source media. Martin explained that smart glasses are now treated as “another input device” for the app, provided they include a microphone, camera, and speakers. The beta integration currently relies on Google’s Gemini 2.5 Flash for live streaming descriptions, although users can still process recordings through PickyBot’s standard multi-model system.

“The first reaction is always, ‘this is amazing,’” Martijn said, “but there are still delays of a few seconds, so it’s not suitable for live navigation in traffic.” He also noted that Meta’s SDK remains in beta, limiting the functionality available to developers. While iOS devices currently offer smoother Meta integration, Android is better optimised for live AI processing, requiring developers to balance support across both platforms.

Martijn confirmed that PiccyBot’s live AI mode poses cost challenges, as continuous streaming consumes significant resources. He indicated that a credit-based or subscription model may be necessary for sustainable deployment once the smart glasses integration exits beta. Offline, on-device AI processing is also being explored to reduce server costs and improve privacy.

This expansion could significantly enhance daily usability for blind and partially sighted users, enabling hands-free access to media descriptions in real-time. With Meta’s platform opening to third-party apps and wearable AI models improving, PiccyBot’s integration signals an important step toward more accessible, mainstream smart glasses.

Resources:
– PiccyBot Official Website
https://piccybot.com