Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
MechaTama31When you say "youtuber", I picture some sort of customizable potato...09/22/2014 - 10:48pm
Matthew Wilsonthis change will only give youtubers more power.09/22/2014 - 9:54pm
prh99Steam has added a curator system. You can follow your favorites and see their recommendations http://store.steampowered.com/curators/09/22/2014 - 9:07pm
MaskedPixelantePlus there's the whole "we don't use accounts" thing that means if you lose your 3DS and have to get a new one, you have to deal with Nintendo customer service to get your downloads back instead of, you know, logging in and downloading them.09/22/2014 - 8:39pm
MonteIndeed. Their wallet system, the lack of sales, applying tax, the lack of price cuts, the eshop is pretty terrible. Only use it for indie games.09/22/2014 - 8:29pm
Andrew EisenThat's the one I'm eyeballing. Really dug the demo. Didn't care as much for EOIV though.09/22/2014 - 8:19pm
MaskedPixelanteOoh, an Atlus sale, it must be a day that ends in "y". I'd much rather get physical 3DS games because of Nintendo's outdated digital distribution policies, but EOU is near impossible to find anywhere nowadays... conflicted.09/22/2014 - 7:48pm
Andrew EisenOooh, Atlus sale in the 3DS eShop. I might have to bust open my piggy bank. http://www.siliconera.com/2014/09/22/shin-megami-tensei-iv-atlus-games-sale/09/22/2014 - 7:21pm
Matthew Wilsonhttp://www.pcgamer.com/2014/09/23/steam-update/ steam finally adds content Curation. I like that the user can pick which peoples recommendations they want to see.09/22/2014 - 7:16pm
MaskedPixelanteNintendo put three dual-gendered characters in Smash Bros 4.09/22/2014 - 7:13pm
Andrew EisenWhat did Nintendo do thrice in one game?09/22/2014 - 6:48pm
MaskedPixelanteYou know it's a bogus defense when Nintendo of all companies does it THREE TIMES in one game.09/22/2014 - 6:29pm
E. Zachary KnightIt is stupid that they went with the "It would be too much work to add a woman assassin" defense rather than just being honest and admiting they didn't think about it until it was brought up.09/22/2014 - 6:06pm
E. Zachary KnightYeah, this is a different game and it is not out of the ordinary for them. THey did the same for the pirate one.09/22/2014 - 6:05pm
MaskedPixelanteTurns out it's less "impossible", more "part of the season pass, but only in an exclusive game that's separate from ACU proper".09/22/2014 - 6:01pm
MaskedPixelantehttp://www.joystiq.com/2014/09/22/assassins-creed-unitys-season-pass-includes-game-set-in-china/ Remember how Ubisoft said it was impossible to have playable females in Assassin's Creed Unity?09/22/2014 - 5:59pm
ZippyDSMleeIf publishers didn't play the region lock game then it would not be an issue.Tho I have seen more russian/chec games than asia ones on ebay.If they do not like it then mabye lower thier region prices to make alitte vrs none.09/22/2014 - 9:54am
MaskedPixelantehttp://hexus.net/gaming/news/industry/74981-pc-game-code-stripping-widespread-says-report/ Thievery, or perhaps the very idea of capitalism? You decide!09/22/2014 - 9:47am
MaskedPixelantehttps://www.youtube.com/watch?v=oDPCmmZifE8 John Oliver exposes Miss America.09/22/2014 - 9:00am
james_fudgeI reiterate now - not one email to-date.09/22/2014 - 8:37am
 

Be Heard - Contact Your Politician