This is as insane as it is cool. According to this article on NPR, researchers at Berkeley were able to monitor the minds of subjects while they watched various videos. The system was then able to reconstruct what the subject had been watching by putting together a new video made from pieces of YouTube videos. In other words: "this breakthrough paves the way for reproducing the movies inside our heads that no one else sees, such as dreams and memories."
This YouTube video shows how it works:
And this article on the UC Berkeley's Newscenter explains how the system works in greater detail:
Nishimoto and two other research team members served as subjects for the experiment, because the procedure requires volunteers to remain still inside the MRI scanner for hours at a time.
They watched two separate sets of Hollywood movie trailers, while fMRI was used to measure blood flow through the visual cortex, the part of the brain that processes visual information. On the computer, the brain was divided into small, three-dimensional cubes known as volumetric pixels, or "voxels."
"We built a model for each voxel that describes how shape and motion information in the movie is mapped into brain activity," Nishimoto said.
The brain activity recorded while subjects viewed the first set of clips was fed into a computer program that learned, second by second, to associate visual patterns in the movie with the corresponding brain activity.
Brain activity evoked by the second set of clips was used to test the movie reconstruction algorithm. This was done by feeding 18 million seconds of random YouTube videos into the computer program so that it could predict the brain activity that each film clip would most likely evoke in each subject.
Finally, the 100 clips that the computer program decided were most similar to the clip that the subject had probably seen were merged to produce a blurry yet continuous reconstruction of the original movie.
|NASA: Civilization As We Know It to Collapse in a Few Decades|
|Volunteers for One-Way Trip to Mars Pass 1st Cut|
|DRONENET: Using a Network of Drones to Deliver Packages|
|"Think about what a child born today could plausibly expect to witness in her or his lifetime."|
|A Day Made of Glass: Corning's Vision of the Future|
|“That science fiction future where robots can do what people and animals do may be closer than you think.”|
|“Nobody is forcing the participants to stay, of course, but if they leave, they won’t be paid.”|
|“Human and animal cells can be 3D printed into high-resolution tissue.”|
|Making a Movie Inside a Video Game|
|“Eliminating the time needed to stop and re-charge a conventional electric car’s battery.”|
|“We’re going to start to see chip implants get the same realm of acceptance as piercings and tattoos.”|
|“During this phase of decline, the US was likely to go through a phase of reactionary 'fascism'.”|
|“Our Internet handlers, not government, are using operant conditioning to modify our behaviour today.”|
|“The shift from fuel and pistons to batteries and electric motors is unlikely to take that long.”|
|“This 160-step biochemical process is very well studied, and surprisingly inefficient.”|
|“The algorithm chose; Max attended.”|
|Google Map Shows You the Most Photographed Areas of the World|