Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

What do you think about Bill Paxton taking on the film role of Jack Thompson?:

Shout box

You're not permitted to post shouts.
PHX Corphttp://www.extremetech.com/computing/203654-leaked-sony-emails-show-mpaas-opposition-to-fair-use-confirms-users-are-viewed-as-thieves Leaked Sony emails show MPAA’s opposition to fair use, confirms users are viewed as thieves04/18/2015 - 10:49am
prh99I'd happily run DBAN on all their servers and back up with a 7 pass wipe.04/18/2015 - 1:07am
Matthew Wilsonmetaphorically speaking of course04/17/2015 - 9:40pm
Matthew Wilsonhttps://soundcloud.com/totalbiscuit/brevity-is-the-soul-of-twit I agree with TB twiter is not good for anything more their links. twiter is a toxic wasteland, and I wish I can nuke it from orbit.04/17/2015 - 9:38pm
MechaCrashI can understand why Sony wants the Pokemon and Smash movie rights, but it's not hard to see why Nintendo wouldn't want to sell to them. Kinda their competitors in the console arena.04/17/2015 - 8:01pm
PHX Corp@MW We won't know until the nintendo General Shareholders meeting if the leaks(From Sony Pictures) is true or not04/17/2015 - 7:55pm
MechaCrashIn GG news: they got kicked out of Calgary Expo for getting a booth under false pretenses and disrupting panels. http://www.themarysue.com/calgary-expo-gamergate-evicted/ How long before they get thrown under the No True Scotsman bus?04/17/2015 - 7:53pm
MechaTama31EZK: Because what if I want to see that website I was looking at a while ago? Well, just keep scanning through my tabs til I see it! There's an aspect of archaeology to it, too. "Oh yeah, I was looking up how to build my own pizza oven. Good times..."04/17/2015 - 6:52pm
Matthew Wilsondo it in the art style of those trailers, and I am on board.04/17/2015 - 5:24pm
PHX Corphttp://mynintendonews.com/2015/04/17/sony-were-apparently-trying-to-get-the-rights-to-a-pokemon-and-super-smash-bros-movie/ Sony Were Apparently Trying To Get The Rights To A Pokemon And Super Smash Bros Movie04/17/2015 - 4:14pm
E. Zachary KnightCan't wait to see the new digs on Saturday.04/17/2015 - 1:41pm
Andrew EisenBy the by, I moved this week so if I dropped a comment thread or two, my apologies for leaving you hanging.04/17/2015 - 12:22pm
Andrew EisenIf I were going to buy Mortal Kombat X, I'd wait for the inevitable Game of the Year edition that includes all the DLC for an overall cheaper price.04/17/2015 - 12:22pm
PHX CorpMortal Kombat X: On Disc DLC Confirmed Read more at http://gamingbolt.com/mortal-kombat-x-on-disc-dlc-confirmed04/17/2015 - 12:17pm
james_fudgeme04/17/2015 - 8:37am
Ryan RardinWho else would like to see The Misadventures of Tron Bonne on PlayStation Classics?04/17/2015 - 2:21am
ZippyDSMleeso I can save my bookmarks and nuke it with a ree install put my bookmarks back reget all my plugins and I am good to go04/17/2015 - 2:15am
ZippyDSMleeMechaTama31: I run 70 tabs and use a suspend plugin to suspend them. i have a folder in my bookmarks that have all my pluings in it04/17/2015 - 2:14am
E. Zachary KnightOnly one question: Why?04/16/2015 - 10:16pm
MechaTama31Most of which I could probably delete the bookmark for too, if I had the inclination to wade through them.04/16/2015 - 9:16pm
 

Be Heard - Contact Your Politician