Designed an innovative approach to Augmentative and Alternative Communication (AAC) for non-verbal individuals through a mobile/AR app that uses predictive sentence construction, paired with gesture and eye-tracking control.
Many existing AAC apps are slow and frustrating for users. We applied human-centered design to create a faster, more intuitive, and accessible communication tool, tailored to user needs.
Collaborating with Speech-Language Pathologists, Applied Behavior Analysts, Special-Education Teachers, and non-verbal users, we developed a new word access method and predictive sentence construction method, improving communication speed and quality. We also introduced customizable voice profiles for user personalization.
To maximize accessibility, the app was developed for mobile, tablet, and AR headsets, including gesture, eye-tracking control, and an emoji symbol library for non-readers. After testing and iterating concepts, we achieved strong problem-solution fit and launched Speakprose in the App Store, improving communication for thousands non-verbal individuals.
"As a speech pathologist I have used a lot of different augmentative speech devises with both children and adults. The design of this app is super intuitive and the people that I've tried it with have been excited about how quickly they could use it to express themselves. Frustration is down. Smiles are up. The swipe or gesture to talk feature is great for people who have a hard time seeing, finding or tapping specific buttons."
