Powered by a Raspberry Pi with custom software, the Roboband translates game play audio into the sound played by actual instruments.
This system allows for Nintendo gameplay audio to be played through an acoustic player piano and robotically controlled percussive instruments. The piano and percussion play live during actual gameplay, mirroring the sounds that would normally be created electronically. All audio, including music and sound effects, is translated in realtime so that it is produced by the instrument most closely resembling the characteristics of the original electronic sound.
For those interested in the technical details, both the piano and the percussion use solenoids to drive their player mechanisms. The piano uses Yamaha's Disklavier system to strike keys, and the percussion uses a custom solution to strike the drum sticks. Both the piano and percussion are each controlled by Raspberry Pis which have custom software to control each instrument. The software is responsible for translating the gameplay audio to instructions which ultimately define which solenoid should be actuated. In full disclosure, there is normally a half-second audio delay that was removed in editing, but it's still very playable live. The piano is controlled through the Disklavier's MIDI interface, while the percussion's solenoids are directly controlled through the Pi's GPIO interface.
|Terry Cavanagh's Free Indie Games Blog|
|Half-Life 2: Civil Protection: FRIDAY|
|LEGO Spongebob Terminator|
|Chat Chat: Multiplayer Chat Room and Game About Being a Cat|
|“This 160-step biochemical process is very well studied, and surprisingly inefficient.”|
|“Eliminating the time needed to stop and re-charge a conventional electric car’s battery.”|
|“Nobody is forcing the participants to stay, of course, but if they leave, they won’t be paid.”|
|Making a Movie Inside a Video Game|
|“Our Internet handlers, not government, are using operant conditioning to modify our behaviour today.”|
|“During this phase of decline, the US was likely to go through a phase of reactionary 'fascism'.”|
|Google Map Shows You the Most Photographed Areas of the World|
|“We’re going to start to see chip implants get the same realm of acceptance as piercings and tattoos.”|
|“Within 30 years, half of humanity won't have a job. It could get ugly — there could be a revolution.”|
|“The shift from fuel and pistons to batteries and electric motors is unlikely to take that long.”|
|“After 78 years, the helicopter has been reinvented.”|
|Defacing Street Signs Can Send Self-Driving Cars Crashing|