New AI app helps visually impaired users find everyday objects with greater speed
SMRTR summary
Bullseye, boom, you got it. That's how one test user described the moment NaviSense, a new smartphone app from Penn State researchers, successfully guided their hand to locate an everyday object. Unlike existing assistive tools that rely on preloaded object databases or human support teams, NaviSense connects to artificial intelligence systems that can identify any item in real time through voice commands alone.
The app listens to spoken requests, scans surroundings using the phone's camera, and provides audio and haptic cues to guide users toward their target. Its standout feature tracks hand movements to offer precise directional guidance, something users consistently requested but rarely found in commercial products.
During testing with 12 visually impaired participants, NaviSense outperformed existing tools in both speed and accuracy. "This technology is quite close to commercial release, and we're working to make it even more accessible," says researcher Vijaykrishnan Narayanan. The breakthrough earned recognition at a major accessibility conference in Denver, suggesting a significant step forward in digital assistance for people with visual impairments.
SMRTR provides this summary for quick context. The original article belongs to Interesting Engineering.
Read the original article