This app turns your voice, hands, walls, and room into a playful spatial musical instrument.
Tap the Show Immersive Space button to enter an interactive spatial sound experience.
When you speak, colorful sound orbs are launched forward into your room. Each orb changes its color based on the pitch of your voice and its size based on the volume. When a sound orb bounces off the room collision mesh, that part of the room mesh temporarily becomes visible and plays a tone based on the orb’s color.
You can also interact with sound directly using your hands. Touch a sound orb to make it play a tone and disappear. Touch a wall, or use gaze and pinch toward a wall, to make the wall glow and play a pitch based on the height of the touched position.
The app also includes voice recording. Tap the Record button to record your voice. From the bottom area of the main menu, you can open the recorded audio list, play back your recordings, or tap the 3D Cube button to visualize a recording above your left palm. The recorded sound becomes a 3D audio sculpture, where thickness represents volume and color represents pitch. Turn your palm downward to detach the sculpture from your hand.
You can play the sculpture like a physical music object. Stroke the sculpture up and down with your left or right fingers, and the touched section will play back its corresponding sound, like pins on a music box or a playback bar moving through audio.
Turn on Comic Mode to transform speech into an American comic-style speech bubble experience. The app recognizes spoken language and launches 3D alphabet characters into space.
In Theremin Mode, your hand position and gestures generate sound in real time. Closing your hand lowers the volume. Theremin Mode can be toggled separately for the left and right hands.
