Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
MattsworknameAndrew: If the new ghostbusters bombs, I cant help but feel it'll be cause it removed the origonal cast and changed the formula to much08/01/2015 - 8:31pm
Andrew EisenNot the best look but that appears to be a PKE meter hanging from McCarthy's belt.08/01/2015 - 7:34pm
Matthew Wilsonwhy, let me guess it runes like crap?08/01/2015 - 7:29pm
Andrew EisenInteresting. These throwers are different than the ones we saw in the earlier Ghostbusters prop pics. https://twitter.com/feigfans/status/62754147689817702508/01/2015 - 7:28pm
PHX Corphttp://www.neogaf.com/forum/showthread.php?t=1088640 NeoGAF: Warning: Don't buy Binding of Isaac Rebirth on 3DS08/01/2015 - 7:26pm
MattsworknameYou know what game is a lot of fun? rocket league. It' s a soccer game thats actually fun to play cause your A Freaking CAR!08/01/2015 - 7:02pm
MattsworknameNomad colossus did a little video about it, showing the world and what can be explored in it's current form. It's worth a look, and he uses text for commentary as not to break the immerison08/01/2015 - 5:49pm
MattsworknameI feel some more mobility would have made it more interesting and I feel that a larger more diverse landscape with better graphiscs would help, but as a concept, it interests me08/01/2015 - 5:48pm
Andrew EisenHuh. I guess I'll have to check out a Let's Play to get a sense of the game.08/01/2015 - 5:47pm
MattsworknameIt did, I found the idea of exploring a world at it's end, exploring the abandoned city of a disappeared alien race and the planets various knooks and crannies intriqued me.08/01/2015 - 5:46pm
Andrew EisenDid it appeal to you? If so, what did you find appealing?08/01/2015 - 5:43pm
MattsworknameIts an interesting concept, but it's not gonna appeal to everyone thats for sure,08/01/2015 - 5:40pm
Andrew EisenThat sounds horrifically boring. Doesn't sound like an interesting use of its time dilation premise either. 08/01/2015 - 5:36pm
Mattsworknamean observer , seeing this sorta frozen world and being able to explore without any restriction other then time. no enimes, no threats, just the chance to explore08/01/2015 - 5:34pm
MattsworknameAndrew: I meant lifeless planet, Time frame is an exploration game. Your dropped onto a world which is gonna be hit by a metor in 10 seconds, but due to time dilation ,you actually have ten minutes, so you can explore the world, in it's last moments, as08/01/2015 - 5:32pm
Andrew EisenLP is 20, TF is 8 and has an old build available as a demo.08/01/2015 - 5:32pm
MattsworknameLast I checked zip, Lifeless planet was 10 bucks on steam I think08/01/2015 - 5:29pm
Andrew EisenMatt - Which one? Time Frame? How exactly does that play? What exactly do you DO in that one?08/01/2015 - 5:29pm
Andrew EisenZip - Neither game is above $20.08/01/2015 - 5:28pm
Mattsworknamefinished it, great game all the same.08/01/2015 - 5:22pm
 

Be Heard - Contact Your Politician