Powered by a Raspberry Pi with custom software, the Roboband translates game play audio into the sound played by actual instruments.
This system allows for Nintendo gameplay audio to be played through an acoustic player piano and robotically controlled percussive instruments. The piano and percussion play live during actual gameplay, mirroring the sounds that would normally be created electronically. All audio, including music and sound effects, is translated in realtime so that it is produced by the instrument most closely resembling the characteristics of the original electronic sound.
For those interested in the technical details, both the piano and the percussion use solenoids to drive their player mechanisms. The piano uses Yamaha's Disklavier system to strike keys, and the percussion uses a custom solution to strike the drum sticks. Both the piano and percussion are each controlled by Raspberry Pis which have custom software to control each instrument. The software is responsible for translating the gameplay audio to instructions which ultimately define which solenoid should be actuated. In full disclosure, there is normally a half-second audio delay that was removed in editing, but it's still very playable live. The piano is controlled through the Disklavier's MIDI interface, while the percussion's solenoids are directly controlled through the Pi's GPIO interface.
|How Jeremy Bell Got Arrested by the SWAT Team Last Night...|
|Ghostbusters' Ecto-1 Built Out of LEGOs|
|Halfblock: Open-Source Clone of Minecraft Done in HTML5|
|LEGO Spongebob Terminator|
|'Halo player' used as political smear|
|Google's Self-Driving Cars Giving Rides to the Public|
|"It’s appealing to imagine a world where artificial wombs grow babies."|
|"Frozen brains could be thawed and inserted into a donor body."|
|"Academics who study basic income said the pilot gives a chance to see how the idea plays in a changed economy."|
|"You look in the mirror and see your body and your face and you think that’s you—but that’s really just the machine you’re riding in."|
|"This created a bubble, and like housing, that bubble has now burst."|
|Religious Loophole to Turn Lights On and Off During Shabbat|
|Where AI is Currently At|
|"Super-detailed scans of actual human brains that run as models on computers"|
|"A spacecraft may be possible that could maintain a steady acceleration into and through interstellar space without the need to carry along propellants."|
|"John Deere is the largest operator of autonomous vehicles."|