A supercomputer running a program simulating a 13-year-old boy named Eugene has passed the Turing Test at an event held at London’s Royal Society.
The Turing Test is based on 20th century mathematician and code-breaker Turing’s 1950 famous question and answer game, ‘Can Machines Think?’. The experiment investigates whether people can detect if they are talking to machines or humans. The event is particularly poignant as it took place on the 60th anniversary of Turing’s death, nearly six months after he was given a posthumous royal pardon.
If a computer is mistaken for a human more than 30% of the time during a series of five minute keyboard conversations it passes the test. No computer has ever achieved this, until now. Eugene managed to convince 33% of the human judges that it was human.
I’m sure there will be some debate as members of the AI and computing communities weigh in over the next few days, but at first blush, it seems like a significant result. The very first Long Bet concerned the Turing Test, with Mitch Kapor stating:
By 2029 no computer — or “machine intelligence” — will have passed the Turing Test.
and Ray Kurzweil opposing. The stakes are $20,000, but the terms are quite detailed, so who knows if Kurzweil has won.
Update: Kelly Oakes of Buzzfeed dumps some cold water on this result.
Of course the Turing Test hasn’t been passed. I think its a great shame it has been reported that way, because it reduces the worth of serious AI research. We are still a very long way from achieving human-level AI, and it trivialises Turing’s thought experiment (which is fraught with problems anyway) to suggest otherwise.