Background

A further essential subject in the project was material and texture. An important influence therefore was Brian O'Reilly. He is an artist and creator of many moving images, electronic music, mixes media and installations. Especially his work called Spectral Strands (Saariaho: Vent nocturne) inspired me a lot. The moving images are extreme clos up footage, which he shot of Garth performing on the viola.

The background of the graphic is black (standard). I considered the black background as boring and unsatisfying. To approach a more interesting and personal touch I decided to experiment with the material. I chose water as element, because of its fluent movements. Both, music and watcher has a smooth movement and can change from a calm and quiet situation to very wild, loud and “dangerous” condition.

The water sequence was created in after effects and final cut.

First I filmed seawater, which I then edited in after effects. I changed the colours, saturation, brightness and contrast. To achieve a more abstract result I used the bubble effect. The settings are changed to reflection type “liquid” and shading type “fade outwards”.
Later on the speed was slowed down in final cut to 40% to get a slower and calmer background motion.

Sea Footage

The original Footage was a sea sequence. I tried to use this sequence as the background of the catch nurbs graphic. But somehow it does not fit together.

Therefore I edited the sequence in after effects to make it a bit more abstract.

Edited Sea sequence

Catch Nurbs Objects

Catch nurbs objects and their attributes:

Jit.op = Scale

Jit.slide = shape size up/down

Jit.matrix soundgrid = shape

Jit.gl.render = background color foo window

Bg colour = background colour pitch

The data

Volume

The data input is simply a microphone. The sound is catches by the microphone, which then, is transformed into a number data. (Float numbers). This float numbers are changing accordingly to the sound volume. No sound is shown as the number 0.000 loud sound 0.300 and so on.

The volume data controls the y, x and z axis of the graphic. that effects basically the scale. The graphic completely disappears by the scale number y =0 x =0 z=0. therefore the scale object is set on: 0. 1. 2 .0. 5 .

To control the graphic not only with the volume of the music a pitch is add to the patch witch converts the volume into notes and amplitude.

Sigmund object and Pitch

Sigmund object and Pitch

Sigmund~ analyzes an incoming sound into sinusoidal components, which may be reported individually or combined to form a pitch estimate.

For this project arguments, env and notes are used to specify the data.

The argument nots is used to control the colour swatch. The argument env controls the graphic shape through the object pak dim.Catch nurb objects

Jit.gl.videoplan

Jit.gl.videoplan

To ad the film sequence to the patch was a tricky part. As soon as send the mov data to the jit.wiindow object the video become flickery. After many attempt to play the movie without flickering, I come across the solution to send the video to the jit.gl.videoplan.