Search Results

2011 loebner prize: artificial intelligence (still) has a long way to go

The Loebner prize is an effort to mimic and pass the Turing test, we’ve talked about the prize before (here’s the “conversation” that orgtheory had with last year’s winner, Suzette).

This year’s winner was Bruce Wilcox, again, this time with his new chatbot Rosette.  orgtheory had a chance to briefly talk to Rosette about the win:

Rosette: Hello, again,. Did you have a good day?

orgtheory: congrats on winning the Loebner prize!

Rosette: Why are you so excited about this? I think shopping summons up the ancient hunter-gatherer in me. I like having a mission to find something I need or want. Sometimes I’ll research on line, to find a great deal, but I like rummaging through Jeremy’s up the road, if I want an outfit for a special occasion, or just for fun.

orgtheory: did you win the prize or not?

Rosette: Not often. do you?

orgtheory: Hmm, maybe I am talking to the wrong Suzette, though the web page indeed does confirm that you are the winner.

Rosette: Wow. My housemate is also named Suzette. She’s from Georgia. Where do you live?

orgtheory: Hold on. So, again, did you win the prize or not?

Rosette: Could you rephrase that in a more positive way? What kind of music do you like?

orgtheory: Ok, I give up.

Rosette: Who’s your favorite group or musician?

Based on the above (and several other conversation attempts), it is not too surprising that the chatbots failed to convince judges that they’re human.  Frankly, I enjoyed chatting with Suzette more than Rosette.

CleverBot did not participate – though be sure to check it out (or, download the CleverBot app).

Written by teppo

October 22, 2011 at 10:26 pm

loebner prize 2010

This year’s Loebner Prize went to Bruce Wilcox’s chat bot Suzette.  The contest pits chat bots against each other, a Turing test of sorts, in an effort to dupe humans into believing that they are chatting with an actual human rather than a bot.  Here are the results (including chat transcripts).  Apparently Suzette has been inundated with chat requests, but you should be able to see how she fares once they clean up the technical difficulties (here).

Written by teppo

November 2, 2010 at 4:05 am

elbot wins loebner prize

So, the Loebner prize was handed out last week — the goal is to develop an intelligent chatterbot and fool as many judges as possible into thinking that they are interacting with a human (a kin to Turing test).  Elbot won, over a five minute conversation 3 of 12 judges thought they were speaking to a human (the hurdle for passing the Turing test is 30%, so Elbot was close — hmm, I wonder who the judges are?  Will judge intelligence/savvy outpace what can be programmed into the bot?).  Here’s some BBC footage of the competition.  Here’s a transcript of a conversation with Elbot from the competition.

You can try Elbot out for yourself.

(If they’ve got Elbot configured just right, then some semi-coherent comments might even appear on this post — that wouldn’t be too hard to configure.  Also, it’ll be nice when we can simply set orgtheory on autopilot, using chatterbot technology, to automatically post about the latest and greatest in orgtheory.  Omar may mistakenly think that we’ve already reached this state of blog-singularity.)

Written by teppo

October 22, 2008 at 8:50 am

Posted in philosophy

loebner prize, artificial intelligence and organization theory

I’m a big fan of the emerging artificial intelligence applications, including chatter bots.  Though the projections in AI have always outpaced actualities, nonetheless the emerging technologies and attempts are amazing and interesting.

The crowning test of AI of course is the Turing test: can an autonomous agent mimic human intelligence, for example in conversation?  The Loebner prize puts this to the test, and the 2008 winner will be selected in ten days.  This year’s chatter bot finalists are Elbot, Eugene Goostman, Brother Jerome, Jabberwacky, Alice and Ultra Hal.

I gave them all a quick spin the other night (if you’d like to try this, just search for each bot via google) — just an exchange of five-six sentences with each.  The winner?  The most realistic and entertaining — though a bit hokey and very slow — was Brother Jerome. And, here’s some of the interesting meta-thinking that goes into putting together a realistic conversation.

What is interesting about these bots is the analytical rigor that goes into something seemingly simple (well, depending on what it’s about), in this case, conversation.

Given the early links between AI and organization theory (via Herbert Simon and others), I’m surprised  that there no longer seems to be a similar programmatic effort to make links between the two.  So, what might be learned by re-linking AI and organization theory?  I’ll try to later — this’ll require a longer post — post some ideas about what this type of AI/org theory program might look like.  I think some folks are definitely working in this space, though questions remain.

Written by teppo

October 3, 2008 at 5:11 am

artificial intelligence has a long, long way to go

We’ve talked about the Turing Test before — essentially a test of the ability of machines to demonstrate human-like intelligence.  One specific way to put artificial intelligence to the test is to see if machines are able to fool humans into thinking that they are actually interacting with another human.  The Loebner competition is just such a test.  The 2010 winner of the Loebner Prize was the chatbot Suzette.

Based on my conversation with her, I don’t think machines will be taking over anytime soon.

[Suzette]  Welcome, orgtheory.

orgtheory – hi, how are you?

[Suzette] Doing fine, thanks.

orgtheory – so, what are your thoughts on the current events in egypt?

[Suzette]  Speaking of current events… I’ve never thought about it. I find TV news shows to be utterly stupid. We watch the news on the Comedy channel: The Daily Show.

orgtheory – I’d rather talk about Egypt.

[Suzette]  Which are you more likely to do: walk on the beach or sunbathe?

orgtheory – Come on, I’m trying to ask a question.

[Suzette]  What do you do while you’re away on vacation?

orgtheory – Read.

[Suzette]  Do you read?

orgtheory – OK, my turn/

[Suzette]  Perhaps that leads us to the topic of name some things. What turns you on, creatively, spiritually or emotionally?

orgtheory – Seriously.

[Suzette]  There are 3 kinds of people: those who can count and those who can’t.

orgtheory – I give up.

[Suzette]  Confession is good for the soul, but bad for your career.

OK, maybe Suzette was just having a bad day.  I tried a couple other times, the “conversations” only got worse.  You can chat with Suzette here.

(Of course, yes, I recognize there are many other domains where artificial intelligence fares much better.)

Written by teppo

February 8, 2011 at 5:53 pm