Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Which Feminist Frequency video are you looking forward to most?:

Shout box

You're not permitted to post shouts.
Andrew EisenNot sure what GamerGate could do to dissuade people from buying a game they'd otherwise be interested in or why it would even want to but I agree, I think the premise is interesting and look forward to learning more about how it actually plays.01/30/2015 - 2:58pm
Goth_SkunkAnd for what it's worth, I saw Life is Strange advertised today on XBL, and the premise looks very, very intriguing. I'm going to buy it today and give it a shot.01/30/2015 - 2:42pm
Goth_SkunkI'm hearing rumours that the recently released game Life is Strange is not selling very well on Steam, and that GamerGate is being blamed as a result. It's just a rumour though.01/30/2015 - 2:42pm
Matthew Wilsonhttp://smashboards.com/threads/apex-2015-venue-changed-competition-will-restart-tomorrow.388991/ twitch saves apex2015 tournament after original location gets condemned.01/30/2015 - 2:37pm
prh99Probably not unless you can prove they knew and did nothing. ianal01/30/2015 - 12:16pm
InfophileIs it possible to sue advertisers for breach of contract or something if they do that? Or sue the ad providers if they don't take reasonable measures to enforce their rules on advertisers?01/30/2015 - 12:06pm
prh99AdBlock fixes the problem :) Since these ad network do a terrible job at screening. With the recent exploits for Java and Flash, it's just a mess.01/30/2015 - 11:46am
Neo_DrKefkaHad my browser hijacked five times in a row well trying to view this site.01/30/2015 - 11:18am
Wonderkarpafter deep thought, I can live in a world with 2 Ghostbusters Franchises. Though I highly doubt the new film will top the original(And still wish it were a sequal), The new film's cast won me over hardcore.01/30/2015 - 10:43am
PHX Corphttp://www.tssznews.com/2015/01/30/former-sega-of-america-employees-voice-mistreatment-greed-racism/ there is alot of problems with sega but this is new01/30/2015 - 9:33am
Matthew WilsonI cant say anything though I am stupid lucky. I have a 75/75 line01/29/2015 - 11:27pm
Matthew Wilsonthat isnt awful 1.2MBs, but yeah 100bucks a month is over priced to all hell. ps 8mbs=1MBs01/29/2015 - 11:24pm
ZippyDSMleehttp://www.speedtest.net/my-result/410086446201/29/2015 - 9:12pm
ZippyDSMleeMatthew Wilson Dunlap, TN, its the only game in town and they only started in 08 or so.01/29/2015 - 9:12pm
MechaCrashThe explanation for the misanthropy of the character in Hatred comes from "we want to be super edgy and get those controversy dollars."01/29/2015 - 8:34pm
Andrew EisenI'm interested in giving it a try. I think it has some cool ideas but I haven't been "feeling it" when watching continuous gameplay.01/29/2015 - 8:04pm
Matthew Wilsonif you dont know, the code name STEAM demo is out, and it it downloading very slowly. It might be more popular that I thought, or it could just be the eshop.01/29/2015 - 8:02pm
Goth_SkunkPlayer/Playable Character, yes. As opposed to the NPC.01/29/2015 - 7:36pm
Andrew EisenOh, Player Character! Heh, that one took me a few moments!01/29/2015 - 7:29pm
Goth_SkunkIt really bothers me that there is no explanation for the PC's misanthropy. Even the Saw movie series, despite the level of violence in them, had a premise that fascinated me. The only thing about Hatred that fascinates me is the controversy.01/29/2015 - 7:27pm
 

Be Heard - Contact Your Politician