Problem ——
Goals ——
How to let hearing impaired people see, feel, and interact with sound?
- [Feel] Visualize sound through audio metrics
- [Create] Create virtual sound marks in AR
- [Explore] Explore and interact with other marks and people
AR | UI UX
Sound You Can See and Feel
Watch Sound is an AR technology-powered app designed to help hearing-impaired individuals see, feel, and interact with sound in an engaging and interactive way.
Hearing-impaired individuals represent a significant portion of the Bangladeshi population. Around one in ten people in Bangladesh suffer from hearing loss. While numerous products aim to help hearing-impaired individuals lead more convenient lives, our goal is to offer them a deeper sense of fulfillment and connectivity.
Watch Sound is an augmented reality platform that enables users to create and interact with virtual sound marks based on captured sounds, making these sounds visually accessible and interactive in real-world locations. Our mission is to enhance the lives of those who cannot hear by providing a unique, engaging, and inclusive experience.
How to let hearing impaired people see, feel, and interact with sound?
"We need to be more than accessible; we need to be connected," said Rebecca Knill in her TED Talk, "How technology has changed what it's like to be deaf." Inspired by her speech, Watch Sound aims to build an entertaining and social platform that reveals the hidden talents of the hearing-impaired through their imagination of sound. The app offers unlimited possibilities for each user's creations, connecting the hearing-impaired with others, exploring interesting sounds in the city, and adding value to their experiences.
1. Detecting background
2. Guiding animation
3. Create freehand, tap to place
4. Create in Presets
The [Create] mode provides 2 ways to create a virtual mark: Draw and Presets. When users chooses to draw, there is a guiding animation leads users to draw free hand with the control of brush size and backward buttons. Once the drawing is finished, users can simply tap "Done" and then tap anywhere on the screen to place the marks they drew. The placed mark would automatically be placed on the shared map and seen by other users.
1. Sound visualization of instruments
2. Sound Visualization of waterfall
3. Text placed in a fun park
4. hand-drawn noise sound visualization
Users are able to explore the world, sound, others through AR marks created by users.
Explore mode
User profile and creations
Detailed Info of an AR Mark
