Tonepainter, 2025

A multisensory installation evolving from the Soundbroidery concept, transforming sound into flowing visual gestures in real time.

Tonepainter is a multisensory installation created for the opening exhibition of the CODE Center of Digital Experiences. The work builds on the lineage of Soundbroidery v2.0 - an audio-visual tool originally conceived by Dániel Váczi, prototyped in 2015, and later developed into an installation for the House of Music, Hungary - which explored the intuitive relationships between sound, image, and numerical structure.

In this new iteration, tones played on a MIDI keyboard generate real‑time visual brushstrokes, transforming pitch, intensity, and timbre into flowing patterns. These gestures appear on a display, continuing the intermedial dialogue between sound and drawing present in the earlier Embroidery Ball project. Unlike the original holographic fan display, Tonepainter presents the visuals on a clean, high‑resolution portrait screen tailored for the exhibition environment.

Tonepainter offers both 2D and 3D sphere modes, allowing visitors to switch between flat and volumetric visual interpretations of their sound gestures. The installation also includes an interactive parameter panel — Speed, Duration, and Curve — which users can tweak in real time. These controls actively influence both the visual output (VFX) and the generated sound effects (SFX), creating a tightly linked audiovisual feedback system where each adjustment produces a distinct expressive result.

Original concept lineage:
Soundbroidery v2.0

credits
Design & Code: Flóra Petrók, Gáspár Hajdu, Sámuel Setényi
UI Design: Gita Elek
Concept: Dániel Váczi
Installation Design & Implementation: András Gross, Tóbiás Terebessy – MEDENCE DesignLab