Sign Language is an interactive audiovisual piece that explores the perceptual experience of hearing loss. A combination of both hand gestures activates one of four simulated hearing conditions, with the left hand forming a fist and the right hand shaping sign language-inspired numbers one through four. Each gesture triggers a distinct transformation of sound, reflecting common symptoms of sensorineural loss, conductive loss, hyperacusis, and unilateral deafness.

 

The visuals respond to audio in real time, with the waveform grid subtly shifting in color and texture to reflect each hearing condition. By reimagining sign language as a tool for transforming perception rather than communication, the piece invites participants to engage with the invisible realities of hearing impairment through embodied interaction.

​

 

Built with: p5.js, ml5.js, Tone.js

​

​

​

​

​​

​