Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

How do you usually divide up your Humble Bundle payments?:

Shout box

You're not permitted to post shouts.
Matthew WilsonI have said it before net nutrality will not be made in to law until Google or Netflix is blocked, or they do what they did for sopa and pull their sites down in protest.04/23/2014 - 8:02pm
Andrew EisenGee, I guess putting a former cable industry lobbyist as the Chairman of the FCC wasn't that great of an idea. http://www.nytimes.com/2014/04/24/technology/fcc-new-net-neutrality-rules.html?_r=204/23/2014 - 7:26pm
Andrew EisenIanC - I assume what he's getting at is the fact that once PS3/360 development ceases, there will be no more "For Everything But Wii U" games.04/23/2014 - 5:49pm
Andrew EisenMatthew - Yes, obviously developers will eventually move on from the PS3 and 360 but the phrase will continue to mean exactly what it means.04/23/2014 - 5:45pm
IanCAnd how does that equal his annoying phrase being meaningless?04/23/2014 - 5:09pm
Matthew Wilson@Andrew Eisen the phrase everything but wiiu will be meaningless afer this year becouse devs will drop 360/ps3 support.04/23/2014 - 4:43pm
Andrew EisenFor Everything But... 360? Huh, not many games can claim that title. Only three others that I know of.04/23/2014 - 3:45pm
MaskedPixelantehttp://www.joystiq.com/2014/04/23/another-world-rated-for-current-consoles-handhelds-in-germany/ Another World fulfills legal obligations of being on every gaming system under the sun.04/23/2014 - 12:34pm
Matthew Wilsonhttp://arstechnica.com/gaming/2014/04/steam-gauge-do-strong-reviews-lead-to-stronger-sales-on-steam/?comments=1 Here is another data driven article using sales data from steam to figure out if reviews effect sales. It is stats heavy like the last one.04/23/2014 - 11:33am
Andrew EisenI love RPGs but I didn't much care for Tales of Symphonia. I didn't bother with its sequel.04/23/2014 - 11:21am
InfophileIt had great RPGs because MS wanted to use them to break into Japan. (Which had the side-effect of screwing NA PS3 owners out of Tales of Vesperia. No, I'm not bitter, why do you ask?)04/23/2014 - 10:52am
RedMageI'm still disappointed the 360 never broke into Japan either. It had a bevy of great RPGs in the late 2000s.04/23/2014 - 9:48am
TheSmokeyhttp://www.huffingtonpost.com/2014/04/22/call-of-duty-swatting-hoax_n_5195659.html?utm_hp_ref=canada&ir=Canada CoD loser calls SWAT on person who beat him04/23/2014 - 7:13am
MaskedPixelantehttp://www.joystiq.com/2014/04/23/xbox-one-reaches-japan-on-september-4/ Just give it up, Microsoft. You're NEVER going to be big in Japan, especially now that the notoriously clunky in Japan Kinect is MANDATORY.04/23/2014 - 7:10am
Cheater87Has this been posted yet? http://www.destructoid.com/blogs/Lord+Spencer/ssv-saudi-arabia-bans-bravely-default-because-it-promotes-pedophilia--272016.phtml04/22/2014 - 9:31pm
ZippyDSMleehttp://www.escapistmagazine.com/news/view/133898-Fatal-Frame-V-Coming-Exclusively-to-Wii-U04/22/2014 - 8:50pm
Matthew Wilsonit is a game worth playing if you have a pc/360/ps304/20/2014 - 9:34pm
MaskedPixelantehttps://twitter.com/IGLevine/status/457552538343325696 The Lutece Twins show up in some of the most unlikely of places.04/20/2014 - 2:44pm
Andrew EisenAs it happens, Chinatown Wars is the only GTA game I've played.04/19/2014 - 10:43am
Papa MidnightWith GTA5 (to date) failing to even provide indication of a PC release, I'm realising that this might be the first GTA game that I have not played (outside of Chinatown Wars) since the series inception.04/19/2014 - 8:14am
 

Be Heard - Contact Your Politician