S Y N E S T H E S I A

Liubo Borissov (FFT)

the performer moves and paints on a translucent canvas. the painting is captured in real time by a video camera. the camera image is analyzed by a jitter patch tracking color and movement. the data is used to drive a sound engine. parts of the image are used as direct sonic material through inverse fourier synthesis. other parts of the image are used for macroscopic and microscopic sound control such as pitch, volume, timbre, event density and tempo. for this to work there needs to be high contrast between the canvas and the paint. this can be achieved by proper lighting, and or using special pain, e.g. UV sensitive paint. the audience sees the peformer's shadow and his paiting. his actions are related directly to the produced sound. the relationship need not be obvious but must be expressive, leaving no doubt that the audience hears what it sees.


Video clip from the Tonic performance