Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Should 'Hatred' have been removed from Steam Greenlight?:

Shout box

You're not permitted to post shouts.
PHX Corp@Adam802 We'll break out the popcorn in June12/19/2014 - 9:23pm
ZippyDSMleeMaskedPixelante: I'm itching to start it too but I will wait till the patch goes live. >>12/19/2014 - 7:52pm
Adam802Leland Yee and Jackson get trial date: http://sfbay.ca/2014/12/18/leland-yee-keith-jackson-get-trial-date/12/19/2014 - 5:24pm
MaskedPixelanteNevermind. Turns out when they said "the patch is now live", they meant "it's still in beta".12/19/2014 - 5:07pm
MaskedPixelanteSo I bought Dark Souls PC, and it's forcing me to log into GFWL. Did I miss something?12/19/2014 - 5:00pm
Matthew Wilsonhttp://arstechnica.com/tech-policy/2014/12/republicans-may-have-plan-to-save-internet-providers-from-utility-rules/ this is intreasting. congress may put net nutrality in to law to avoid title 2 classification12/19/2014 - 2:45pm
Matthew Wilsonhttp://www.polygon.com/2014/12/19/7421953/bullshit-cards-against-humanity-donated-250k-sunlight-foundation I have to admit I like the choice o organization. congrats to CAH.12/19/2014 - 1:51pm
E. Zachary KnightIf you are downloading a copy in order to bypass the DRM, then you are legally in the wrong. Ethically, if you bought the game, it doesn't matter where you download it in the future.12/19/2014 - 12:06pm
InfophileEZK: Certainly better that way, though not foolproof. Makes me think though: does it count as piracy if you download a game you already paid for, just not from the place you paid for it at? Ethically, I'd say no, but legally, probably yes.12/19/2014 - 11:20am
ZippyDSMleeAnd I still spent 200$ in the last month on steam/GOG stuff sales get me nearly every time ><12/19/2014 - 10:55am
ZippyDSMleeMaskedPixelante:And this is why I'm a one legged bandit.12/19/2014 - 10:51am
ZippyDSMleeE. Zachary Knight: I buy what I can as long as I can get cracks for it...then again it I could have gotton Lords of the Fallen for 30 with DLC I would have ><12/19/2014 - 10:50am
MaskedPixelantehttp://www.joystiq.com/2014/12/19/marvel-vs-capcom-origins-leaving-online-storefronts-soon/ Speaking of "last chance to buy", Marvel vs. Capcom Origins is getting delisted from all major storefronts. Behold the wonders of the all digital future.12/19/2014 - 9:59am
MaskedPixelanteSeriously, the so-called "Last Chance" sale was up to 80% off, while this one time only return sale goes for a flat 85% off with a 90% off upgrade if you buy the whole catalogue.12/19/2014 - 9:37am
E. Zachary KnightInfophile, Tha is why I buy only DRM-free games.12/19/2014 - 9:37am
MaskedPixelanteNordic is back on GOG for one weekend only. And at 85% off no less, which is kind of a slap in the face to people who paid more during the "NORDIC IS LEAVING FOREVER BUY NOW OR FOREVER HOLD YOUR PEACE" sale, but whatever...12/19/2014 - 9:28am
InfophileRe PHX's link: This is one of the reasons the digital revolution isn't all it's cracked up to be. There's also the flip side where Sony can block access to games you've bought if they ban your account for unrelated reasons. All power is theirs.12/19/2014 - 8:52am
MaskedPixelantehttp://uplay.ubi.com/#!/en-US/events/uplay-15-days You can win FREE GAMES FOR A YEAR! Unfortunately, they're Ubisoft games.12/18/2014 - 6:29pm
Papa MidnightAh, so it was downtime. I've been seeing post appear in my RSS feed, but I was unable to access GamePolitics today across several ISPs.12/18/2014 - 6:06pm
james_fudgeSorry for the downtime today, folks.12/18/2014 - 5:54pm
 

Be Heard - Contact Your Politician