September 23, 2011
Brain imaging reveals the movies in our mind
From PhysOrg:
Imagine tapping into the mind of a coma patient, or watching one's own dream on YouTube. With a cutting-edge blend of brain imaging and computer simulation, scientists at the University of California, Berkeley, are bringing these futuristic scenarios within reach. Using functional Magnetic Resonance Imaging (fMRI) and computational models, UC Berkeley researchers have succeeded in decoding and reconstructing people's dynamic visual experiences – in this case, watching Hollywood movie trailers. As yet, the technology can only reconstruct movie clips people have already viewed. However, the breakthrough paves the way for reproducing the movies inside our heads that no one else sees, such as dreams and memories, according to researchers. "This is a major leap toward reconstructing internal imagery," said Professor Jack Gallant, a UC Berkeley neuroscientist and coauthor of the study to be published online Sept. 22 in the journal Current Biology. "We are opening a window into the movies in our minds."
PICTURE: This set of paired images provided by Shinji Nishimoto of the University of California, Berkeley on Wednesday, Sept. 21, 2011 shows original video images, upper row, and those images reconstructed by computer from brain scans. While volunteers watched movie clips, a scanner watched their brains. And from their brain activity, a computer made rough reconstructions of what they viewed. Scientists reported that result Thursday, Sept. 22, 2011 and speculated such an approach might be able to reveal dreams and hallucinations someday. In the future, it might help stroke victims or others who have no other way to communicate, said Jack Gallant, a neuroscientist at the University of California, Berkeley, and co-author of the paper.
More here.
Posted by Azra Raza at 05:27 AM | Permalink




















Comments
Pseudo-science. Does anyone really buy this, and if they do, what is wrong with them?
Posted by: James Saunders | Sep 23, 2011 1:03:12 PM
One word: INCREDIBLE!
Posted by: Norman Costa | Sep 23, 2011 1:14:44 PM
Pseudo-science. Does anyone really buy this, and if they do, what is wrong with them?
Why do you say that? We've known for a long time that different regions of the visual field map to regions of the visual cortex in a pretty straightforward way, why should it be so surprising that you can reconstruct the basic forms someone is seeing by looking at which areas of the visual cortex are lighting up?
Here's my capsule summary of how it worked. First, they showed a few movie trailers to a person while scanning their brain, then the computer program was fed both the visual information from the trailers and the information about the brain activity, and it tried to figure out the correlations between them. Then based on that, the computer made predictions about what the brain activity might look like for a huge set of 1-second segments of youtube videos it had in its archive--these youtube clips weren't actually shown to the person. After that, they then showed the person a different set of movie trailers, and this time the computer had no access to visual information from the trailers themselves, it was only given information about the person's brain activity while watching them. For each 1-second segment of brain activity, the computer compared the real activity during this time to the simulated brain activity it had predicted for all the 1-second youtube clips. Based on this, for each segment it picked the 100 youtube clips where the simulated brain activity best matched what was actually going on in the person's brain when they watched the second set of movie trailers, and averaged those 100 youtube clips together to get the final result.
Posted by: Jesse M. | Sep 23, 2011 7:38:54 PM
Post a comment