Brainpipe: Sonic Navigation / Synesthesia at Play

September 16th, 2009
research

From website “Create Digital Music”

Brainpipe is a psychedellic journey down the neural pathways, a long, strange trip into the minds of an unusual band of independent game designers. And while some games demand muscular graphics cards or brilliant flat panels, this is one that requires playing with headphones. The immersive sense of the descent down this brain’s pathway is entirely dependent on its sound. While even big development houses often license sound engines, the band of hard-core designers at Digital Eel also rolled their own interactive audio code to make the sounds fully seamless…..

Peter: Let’s talk about the game mechanic. Some of it feels familiar – this descent through a cylindrical pipe – but there’s something quirky and unique about your take on it. How did you settle on the interaction mechanic?

Iikka: This was quite literally the first thing I programmed for Brainpipe. We were trying to come up with a new “short” game after putting another larger project on the back burner because we didn’t have enough free time to work on it. Within a few hours I had the basic control scheme and the moving pipe running on the screen. This is similar to how some of our other short games (Plasmaworm, Dr. Blob’s Organism) got started; the first prototype is something you can play with. After that there were tweaks of course, but the feel stayed much the same…

We were talking about music right away and how the sound, the intensity of the patterns and colors on the pipe walls, and the speed of traveling through the pipe should all work together. [We wanted] a kind of triple whammy to suck the player in deeper and deeper — a strong, cumulative effect…

Making sure each obstacle has a sustained sound so you can hear it coming in the distance in front of you and then hear it pass by and recede with Doppler shift certainly adds to the audio illusion.
I think the kicker is the way the intensity ramps in the game. It’s sort of like a rising sawtooth waveform-shaped thing. During each level, the intensity, the speed increases, Then, between each level, the intensity drops to give you a breather before the next level begins. Each time the intensity drops, it is still at a higher intensity level than during the previous level break, and all of this ramps upward.

The sensation of synesthesia is something a handful of game designers have tried to achieve. What are some of the games that have inspired you? Are there games you feel have reached that fusion of sound and visuals?

Iikka: My personal influence is the “demoscene” that I was a part of when I was younger; it’s a subculture of programmers and artists using computers to create non-interactive but real time audio-visual experiences.

Rich: For me, LucasArts’ adventure game, The Dig, with its seamless looping of various Wagner themes and so on. The music would morph as scenes changed. It was an amazing piece of work.

The music from Star Control II innovated with music and visuals, and it directly inspired the music for Strange Adventures in Infinite Space and Weird Worlds: Return to Infinite Space. The idea that each alien race should have their own theme music came from there (though this kind of thing is less unusual now than it was when SC2 was originally released), as did the idea to attach separate and distinctly different music to each thing, category of thing, item, window, pop up announcement –every action in the game and every flick of the interface … like a toddler’s “busy box” of sound.

Back to Brainpipe, other areas of music outside of games inspired us as well. Aleatoric, musique concrete, avant garde — stuff Bill just naturally creates and stuff I’ve always loved since I was a kid. [I checked] out the LP’s at the library by Stockhausen, Varese, Morton Subotnick, Ussachevsky, all these wonderful pre-synthsizer electronic sound and found sound composers. And the records were awesome because they were always in pristine condition — relatively few others ever checked them out.

Tags: ambiance, haunted, immersion, noise, optic, sound, toy