sense data: cellular noise— interaction prototype, one input signal, three synchronized renders

This prototype mirrors the pipeline where a single input signal's force field, propagated through fluid physics, visually reconstructs a body skeleton, mapped onto a spatial-audio ball field.

Here, the cursor stands in for the live bio-signal sensor and OSC data the original piece ran on.

The full system was a 49.4-channel spatial audio live performance, debuted at C-LAB Taiwan Sound Lab in 2023. It included a bio-signal sensor, OSC signal routing, TouchDesigner, IRCAM Spat in Max/MSP, and Ableton Live. Full case study in README.

Physics Lab

Fluid friction 0.024 Fluid particle count 1000

TouchDesigner 01 · Matter.js body tracking

move your cursor here — watch the 12 nodes turn red on physical collision

TouchDesigner — Front View 01 · elevation

Spat Viewer 02 · coordinate mapping

venue-accurate layout with 49 speakers — watch the 12 nodes travel through the space as live sound sources

Spat Viewer — Front View 02 · elevation

Topology — Speculative Rendering 03 · raymarched SDF metaballs

the same 12 nodes, connected as a body — watch it start to deform