Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Which video game platform are you most thankful for?:

Shout box

You're not permitted to post shouts.
MaskedPixelanteMSS is Murdered: Soul Suspect.11/26/2014 - 8:34pm
Andrew EisenWhy the interest in Ghomeshi? Is it relevant to something we've been discussing? (Not saying it's not but it seems a rather random thing to bring up.)11/26/2014 - 6:39pm
WonderkarpJian Ghomeshi arrested on sex assault charges, released on $100K bail http://www.citynews.ca/2014/11/26/jian-ghomeshi-arrested-on-sex-assault-charges-released-on-100k-bail/11/26/2014 - 5:55pm
WonderkarpJian Ghomeshi to #Gamergate: Our culture’s toxic masculinity crisis on display http://www.salon.com/2014/10/27/jian_ghomeshi_to_gamergate_americas_toxic_masculinity_crisis_on_display/11/26/2014 - 5:55pm
WonderkarpI saw that. Amiibos are pretty awesome. I have 10 now :P11/26/2014 - 5:49pm
Matthew Wilsonon a weird side of smash news, a level 50 Amiibo almost won a tournament. http://www.siliconera.com/…/story-fox-amiibo-nearly-won-su…/ I guess Nintendo made the cpu ai better.11/26/2014 - 5:44pm
WonderkarpAny of you guys watch Game Grumps? They have an episode detailing alot of the bugs in the hilariously bad Sonic Boom https://www.youtube.com/watch?v=O3Jb3A0HLe4&list=UU9CuvdOVfMPvKCiwdGKL3cQ11/26/2014 - 4:19pm
Andrew EisenI'm blanking. What's MMS?11/26/2014 - 4:16pm
james_fudgeI keep an eye on it for really good deals11/26/2014 - 4:00pm
MaskedPixelanteEhh, MSS is only half off, I can wait for it to go under 1011/26/2014 - 3:48pm
NeenekoWhich is why I completely ignore the site.11/26/2014 - 3:15pm
james_fudgeAHHH Someone bar the door and keep the kids away from the credit cards!11/26/2014 - 3:14pm
Neo_DrKefkaThe Ralph Retort is a toxic mess and the guy is literally building his career on the back of the GamerGate movement. Whether you believe GamerGate is right or wrong this is a man profiteering on this war.11/26/2014 - 2:56pm
WonderkarpTHE STEAM SALES HAVE BEGUN!11/26/2014 - 2:16pm
MaskedPixelanteUnless you have said DLC already, then you can get the equally broken FarCry 4.11/26/2014 - 2:15pm
WonderkarpI love Boogie. He's awesome.11/26/2014 - 2:02pm
PHX Corphttp://kotaku.com/ubisoft-apologizes-for-assassins-creed-unity-with-free-1663768202 [Sarcasm]Ubisoft Apologizes for making a broken game, gives out free dlc for said broken game[/sarcasm]11/26/2014 - 1:53pm
Andrew EisenIt's a cute joke to make but it’s important to note that the person's view is not gendered. It's not about not supporting a female dev, it's about not supporting GamerGate. Gender is irrelevant in this case.11/26/2014 - 1:10pm
Neo_DrKefkaToo add what Andrew said about the The Ralph Retort it is no different from what you read at Gawker. I remember reading The Ralph Retort on how Boogie was the bad guy from being on the fence until he jumped to the GamerGate side.11/26/2014 - 12:42pm
Wonderkarpthat, I do not know the answer too. I see some people saying they wont vote for her because of it. I'm pointing out the irony.11/26/2014 - 12:31pm
 

Be Heard - Contact Your Politician