Researchers Use Video Game to Crack the 'Language Code'

May 18, 2011 -

Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda are using video game training with a mock "alien" language to replicate the challenges of learning languages as an infant. The research found that listeners were to quick recognize word-like units. The study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond.

To uncover how spoken sounds are decoded by the brain, the research team designed a video game narrated in deliberately distorted speech. The soundtrack (unintelligible babble in any language) was the only source of instruction for the 77 adult players in the study. After only two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that using video games is a promising new way to explore language learning.

"This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

The research has the potential to help researchers better understand and effectively treat a number of conditions including dyslexia and improving second language learning.

Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English.

"Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said

Holt, director of CMU's Speech Perception and Learning Laboratory, is interested in taking the study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid learning. The next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view real-time brain reactions to the video game.

Researchers will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

For more information on research at Carnegie Mellon, visit www.cmu.edu/research/brain.


Comments

Re: Researchers Use Video Game to Crack the 'Language Code'

I love this stuff.  I majored in CS and minored in linguistics; Watson's performance on Jeopardy was one of the most fascinating things I've ever seen.

Re: Researchers Use Video Game to Crack the 'Language Code'

That is just too cool 

Re: Researchers Use Video Game to Crack the 'Language Code'

This is really cool. Like really cool. I want to try doing that, play an unfamiliar game in an unfamiliar language, too bad imports won't work on my consoles.

-Austin from Oregon

Feel free to check out my blog.

 
Forgot your password?
Username :
Password :

Poll

Is King right? Should all games adopt the free-to-play model?:

Shout box

You're not permitted to post shouts.
Andrew EisenAs it happens, Chinatown Wars is the only GTA game I've played.04/19/2014 - 10:43am
Papa MidnightWith GTA5 (to date) failing to even provide indication of a PC release, I'm realising that this might be the first GTA game that I have not played (outside of Chinatown Wars) since the series inception.04/19/2014 - 8:14am
IanCSo im guessing a bunch of edutainment games, which a lot of people elsewhere are going gaga over, dot count as classics? Okay. If you don't mind me, i have a sudden urge to play Putt Putt....04/19/2014 - 6:15am
MaskedPixelantehttp://www.joystiq.com/2014/04/18/playstation-99-cent-sale-discounts-tokyo-jungle-super-stardust/ Weekend long PSN flash sale. So much stuff is 99 cents for the rest of the weekend.04/18/2014 - 5:59pm
Adam802http://www.polygon.com/2014/4/18/5627928/newtown-video-game-addiction-forum04/18/2014 - 4:14pm
Matthew Wilsonit is a video talking about why certain games/products/consoles do well, and others do not. he back it up with solid research.04/18/2014 - 3:56pm
Andrew EisenI'm not keen on blind links. What is it?04/18/2014 - 3:45pm
Matthew Wilsonthis is worth a whatch https://www.youtube.com/watch?v=MyXcr6sDRtw&list=PL35FE5C4B157509C904/18/2014 - 3:43pm
MaskedPixelanteNumber 3: Night Dive was brought to the attention of the public by a massive game recovery, and yet most of their released catalogue consists of games that other people did the hard work of getting re-released.04/17/2014 - 8:46pm
MaskedPixelanteNumber 2: If Humongous Entertainment wanted their stuff on Steam, why didn't they talk to their parent company, which does have a number of games published on Steam?04/17/2014 - 8:45pm
MaskedPixelanteNumber 1: When Night Dive spent the better part of a year teasing the return of true classics, having their big content dump be edutainment is kind of a kick in the stomach.04/17/2014 - 8:44pm
Matthew Wilsonhttp://www.giantbomb.com/articles/jeff-gerstmann-heads-to-new-york-takes-questions/1100-4900/ He talks about the future games press and the games industry. It is worth your time even though it is a bit long, and stay for the QA. There are some good QA04/17/2014 - 5:28pm
IanCErm so they shouldn't sell edutainment at all? Why?04/17/2014 - 4:42pm
MaskedPixelanteNot that linkable, go onto Steam and there's stuff like Pajama Sam on the front-page, courtesy of Night Dive.04/17/2014 - 4:13pm
Andrew EisenOkay, again, please, please, PLEASE get in a habit of linking to whatever you're talking about.04/17/2014 - 4:05pm
MaskedPixelanteAnother round of Night Dive teasing and promising turns out to be stupid edutainment games. Thanks for wasting all our time, guys. See you never.04/17/2014 - 3:44pm
Matthew WilsonAgain the consequences were not only foreseeable, but very likely. anyone who understood supply demand curvs knew that was going to happen. SF has been a econ/trade hub for the last hundred years.04/17/2014 - 2:45pm
Andrew EisenMixedPixelante - Would you like to expand on that?04/17/2014 - 2:43pm
MaskedPixelanteWell, I am officially done with Night Dive Studios. Unless they can bring something worthwhile back, I'm never buying another game from them.04/17/2014 - 2:29pm
PHX Corphttp://www.msnbc.com/ronan-farrow/watch/video-games-continue-to-break-the-mold-229561923638 Ronan Farrow Daily on Video games breaking the mold04/17/2014 - 2:13pm
 

Be Heard - Contact Your Politician