Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

How do you feel about Amazon buying Twitch?:

Shout box

You're not permitted to post shouts.
Papa MidnightI could say the same about race. I certainly enjoyed being on the receiving end of this while playing StarCraft II this past week: http://i.imgur.com/mIZA1QB.png (and this is actually mild compared to what I usually see). Report players? What a joke...08/29/2014 - 12:29am
AvalongodWhether you approve of Sarkeesian's view or not, no woman deserves to be the target of that kind of harassment and it won't stop until men tell each other it's not appropriate under any circumstance.08/28/2014 - 8:44pm
AvalongodI'm guessing the twitter account was a troll, but come on, I'm sorry, it's just disgusting someone is saying those things to Sarkeesian whether serious or a joke.08/28/2014 - 8:43pm
ZippyDSMleesocial movement that is bringing most of these issue to the spot light to be nothing but trend mongering white knighting bullies who are not much better than the hateful moronic bullies on the other side.08/28/2014 - 5:20pm
ZippyDSMleereflects the world we live in while the rest is the worst stuff that should be focused on. Leaving whats reflected in the same boat as everything else that's exaggerated and skewed by media/fiction and happliy consumed by current society. I find the socia08/28/2014 - 5:20pm
ZippyDSMleemales live off the power fantasy but once you realize as a male you will never reach what fiction or media calls perfect it demoralizes you just the same. And I would not call female negative stereotypes rampant and out of control not when 70-80% of it re08/28/2014 - 5:19pm
ZippyDSMleeNot saying that there is not a difference in the treatment of males and females in media, but males are begin painted as near perfect superhumans with cliched flaws it dose as much damage to the psyche as how females are treated. Sure you could claim that08/28/2014 - 5:19pm
ZippyDSMleeNeeneko:As I said if you do not 100% belive it then you are a Neanderthal. Theres more gray to everything than black and white.08/28/2014 - 1:27pm
NeenekoMeh, the "PCism" is just trotted out when people do not know their place and dare to complain about things the speakers think are fine. How dare people complain about how they are treated/portrayed, it is not like it bother us, our feelings matter!08/28/2014 - 1:13pm
ZippyDSMleeNeeneko I do not think its against feminism but rather against PCisim’s and that most things are offensive since if you do not believe that you are a Neanderthal that beats women,ect..08/28/2014 - 12:48pm
Neenekocomplete with the standard 'she is a lying and attacking the game industry! threats are wrong but she did it to herself' comments.08/28/2014 - 11:28am
Neenekosad, but not surprising. the backlash against feminism has been growing the last few years.08/28/2014 - 11:25am
PHX Corphttp://www.rawstory.com/rs/2014/08/27/feminist-video-game-critic-forced-to-leave-her-home-after-online-rape-and-death-threats/ Feminist video game critic forced to leave her home after online rape and death threats08/28/2014 - 9:43am
Uncharted NEShttp://kotaku.com/once-again-atlus-doesnt-want-you-to-spoil-the-new-pers-162782610808/28/2014 - 5:17am
Uncharted NESOnce Again, Atlus Doesn't Want You to Spoil the New Persona08/28/2014 - 5:16am
lomdrPretty much, Andrew. And hell, it helps that it is a bit reasonably priced too. $8 for 1, $12 for both at once08/28/2014 - 3:43am
Andrew EisenMP - Probably not and for good reason. That term holds a lot of deserved negative baggage.08/27/2014 - 10:02pm
Uncharted NESApprently there is still a classic mode, but...08/27/2014 - 9:34pm
MaskedPixelanteSo, there's been massive positive reception to the Mario Kart 8 DLC bundle. Somehow, I doubt it would have gotten as much positive buzz if they called it a "Season Pass".08/27/2014 - 9:34pm
Uncharted NEShttp://m.pcgamer.com/2014/08/27/quake-live-makes-newbie-friendly-changes-in-latest-update-people-get-mad/08/27/2014 - 9:19pm
 

Be Heard - Contact Your Politician