Powered by a Raspberry Pi with custom software, the Roboband translates game play audio into the sound played by actual instruments.
This system allows for Nintendo gameplay audio to be played through an acoustic player piano and robotically controlled percussive instruments. The piano and percussion play live during actual gameplay, mirroring the sounds that would normally be created electronically. All audio, including music and sound effects, is translated in realtime so that it is produced by the instrument most closely resembling the characteristics of the original electronic sound.
For those interested in the technical details, both the piano and the percussion use solenoids to drive their player mechanisms. The piano uses Yamaha's Disklavier system to strike keys, and the percussion uses a custom solution to strike the drum sticks. Both the piano and percussion are each controlled by Raspberry Pis which have custom software to control each instrument. The software is responsible for translating the gameplay audio to instructions which ultimately define which solenoid should be actuated. In full disclosure, there is normally a half-second audio delay that was removed in editing, but it's still very playable live. The piano is controlled through the Disklavier's MIDI interface, while the percussion's solenoids are directly controlled through the Pi's GPIO interface.
|Star Wars + The Hidden Fortress = Samurai Wars|
|First Person View Drone Racing|
|AIREAL: Expressive Tactile Sensations in Mid Air by Disney Research|
|"A Reign of Missiles." Gaza War, Now a Board Game|
|"What Flappy Birds teaches us about what 'the people' want."|
|Unboxing a Factory Sealed IBM Compatible PC from 1988|
|Termite-Inspired Autonomous Robotic Construction Crew|
|The Unknown Reader|
|Reviewing Counterfeit Toys Made in China|
|James Charles' Pop Culture Dollars|
|"This very internationalism that contributed to the apocalyptic disaster that ended the Bronze Age."|
|The Spaceship Propulsion Compendium|
|“There was not only automation but where the suggestion that humans had any control [...] was absent too.”|
|"Most of what kids currently learn at school will probably be irrelevant by the time they are 40."|
|“The release of methane from hydrate may be apocalyptic.”|
|"Fossil fuel executives want to get a piece of the clean-energy business."|