Three key components
AiSee comprises three fundamental components:
The eye: Vision engine computer software
AiSee incorporates a micro-camera that captures the user’s field of view. This software component, referred to as the ‘vision engine computer,’ is capable of extracting features such as text, logos, and labels from captured images for processing.
The brain: AI-powered image processing unit and interactive Q&A system
After taking a photo of the object of interest, AiSee utilizes advanced cloud-based AI algorithms to process and analyze the images for object identification. Users can also pose various questions about the object. AiSee excels in interactive question-and-answer exchanges thanks to its powerful language model.
The speaker: Bone conduction sound system
AiSee’s headphone employs bone conduction technology, allowing sound transmission through the skull bones. This ensures visually impaired individuals receive auditory information while remaining aware of external sounds, such as conversations or traffic noise. Environmental sounds are essential for decision-making, especially in safety-critical situations.
Unlike many wearable assistive devices requiring smartphone pairing, AiSee is a self-contained system operating independently without additional devices.
Empowering the visually impaired
AiSee’s potential impact on the visually impaired community is significant. Currently, individuals with visual impairment in Singapore lack access to assistive AI technology of this caliber. AiSee has the potential to empower them to perform tasks that typically require assistance independently. Ongoing efforts to make AiSee more affordable and accessible include ergonomic design enhancements and a faster processing unit.
Mark Myres, a visually impaired NUS student who tested AiSee, praised its inclusivity. He highlighted that AiSee strikes a balance, benefiting both visually impaired and blind individuals. The device’s versatility opens up new possibilities for a wide range of users.
Professor Suranga Nanayakkara’s team is currently collaborating with SG Enable in Singapore to conduct user testing with visually impaired individuals. The insights gained from this testing will help fine-tune AiSee’s features and performance.
