IBM Computer Trounces Humans in Jeopardy! Test Run

January 14, 2011

In a test run of a special battle between an IBM supercomputer named "Watson" and two of the best Jeopardy! players in the world, the computer dominates. The test of the computer is a preview of a televised battle to take place in January pitting two men against one machine. Score so far: Men 0, Computer 1.

IBM claims that Watson is a major advance in artificial intelligence, and if this test run is any indication, the company is speaking the gospel. Watson managed to beat former Jeopardy! champions Ken Jennings and Brad Rutter on Thursday in its first public test, a short practice round ahead of a million-dollar tournament that will be televised next month in a special series of shows.

Jennings is no lightweight: he won a record 74 consecutive "Jeopardy!" games in 2004 and 2005. Rutter won a record of nearly $3.3 million in prize money on the show.

According to IBM, Watson is powered by 10 racks of IBM servers running Linux. Watson is the result of four years worth of work by IBM researchers around the globe.

"Language is ambiguous; it's contextual; it's implicit," said IBM scientist David Ferrucci, a leader of the Watson team. Sorting out the context -- especially in a game show filled with hints and jokes -- is an enormous job for the computer, which also must analyze how certain it is of an answer and whether it should risk a guess, he said.

The practice round took place on a stage at the IBM research center in Yorktown Heights, 38 miles north of Manhattan. The real contest to be televised Feb. 14-16, will be played at IBM on Friday.

The winner of the match will be awarded $1 million. Second place gets $300,000, third place $200,000. IBM will donate any winnings Watson receives to charity. Jennings and Rutter will donate half of their winnings to charity because humans can actually use money.

During a press event after the test match, the former Jeopardy! champions joked about Watson:

"When Watson's progeny comes back to kill me from the future," Rutter said, "I have my escape route planned just in case."

"I had a friend tell me, 'Remember John Henry, the steel-drivin' man.' And I was like ... 'Remember John Connor!'" Jennings said. "We're gonna take this guy out!"

Source: Salon

Posted in

Comments

Re: IBM Computer Trounces Humans in Jeopardy! Test Run

 Quick someone find and protect John Connor.

Re: IBM Computer Trounces Humans in Jeopardy! Test Run

I don't know - a $1,000 lead at the end of the first segment, with three full categories and all of Double Jeopardy left to go, doesn't exactly say "trounce" to me. It's impressive, to be sure. But the headline here is a bit misleading.

Editor in Chief - Gamervision.com How Gamers See the World!

Re: IBM Computer Trounces Humans in Jeopardy! Test Run

That is pretty damn impressive actually.  The computer has to analyze the words of the answer, figure out contextually what is being asked, and then come up with the question response.  I'm assuming it also has to take the category into account as well, which adds another layer of complexity.  No doubt this AI is pretty damn sophisticated.

Forgot your password?
Username :
Password :

Shout box

You're not permitted to post shouts.
tallimarhttp://news.cnet.com/8301-1035_3-57440902-94/microsoft-legal-win-over-google-may-signal-ceasefire/05/24/2012 - 10:17pm
ZippyDSMleeTIme or an operation!05/24/2012 - 6:43pm
ZippyDSMleePC parts are in wish me luck or hell!!05/24/2012 - 6:43pm
MaskedPixelante38 Studios and Big Huge Games are pretty much dead now. http://www.joystiq.com/2012/05/24/38-studios-and-big-huge-games-lay-off-entire-staffs05/24/2012 - 4:39pm
DorthLousActually, nop, I did miss the emoticon for some reason (getting used to pics?) and I didn't know you changed it since (since I posted previous to my shout and it was still there.) Anyhow, thanks for taking it out!05/23/2012 - 6:01pm
james_fudgeWell we were just testing it. but it is still on the submission to fight $pam.05/23/2012 - 5:48pm
E. Zachary KnightJames, No I don't have it. I was just wondering who does and why. More curiosity than anything.05/23/2012 - 5:38pm
james_fudgeDid you not see the emoticon and did you not see that it has already been changed back?05/23/2012 - 5:10pm
james_fudgeLOL05/23/2012 - 5:07pm
DorthLousWhy? Not shocked that people are barking to an additional hoop to jump through when posting from their already logged in account or just mentionning this to try to paint me as one always complaining?05/23/2012 - 4:45pm
james_fudgebig shock there ;)05/23/2012 - 4:30pm
DorthLousI'll add my voice to those wanting it gone :S I'm already logged in, I don't need a captch'a. That's for those registering.05/23/2012 - 3:54pm
james_fudgeEt tu EZK?!?05/23/2012 - 3:51pm
Craig R.I'm a One Man Quorum! And it's working for me now, thanks. :)05/23/2012 - 3:48pm
E. Zachary KnightHow do we determine who get's the game/captcha thingy? Is there a certain posting threshhold users have to meet before it is turned off?05/23/2012 - 2:25pm
james_fudgeGive it a chance, we're still adjusting it ;)05/23/2012 - 11:20am
james_fudgeOne does not a Quorum make Craig.05/23/2012 - 11:16am
Craig R.If I complete the stupid game, and it just deletes my comment, what's the point?05/23/2012 - 11:15am
Craig R.Ok, the little captcha game? You can get rid of it already.05/23/2012 - 11:13am
Craig R.FCC boss is giving the thumbs up to usage-based pricing for Internet access05/23/2012 - 11:08am

Be Heard - Contact Your Politician