Skip to content

Turing Test Questions

Gunther Cox edited this page Jul 8, 2017 · 3 revisions

Good sources for Turing test questions:

Restricted VS Full Touring Test

TODO: Fill out this section

More semantic analysis is required from the bot.

Explain why the following story is funny/absurd: "A man walks into a bar and say 'Hello, it's me!' - but it wasn't him..."

Random thoughts

"What is the meaning of life?"

which is actually an invalid Turing test question. The problem with it is the assumption that the machine can't define the meaning of life because it isn't alive. In reality, producing a definition to answer a question is very easy to do.

At the moment, I believe that the best questions for a Turing test require the subject to express abstract application of their own knowledge. By this I mean that they have to be able to leverage their own knowledge toward an end result. An example I've been using for this is the following question:

Pretend you are Arnold Schwarzenegger.

This command should invoke some serious cognitive requirements to test the subject. This is because it requires self-recognition, knowledge of an existing subject, and the ability to apply that knowledge onto itself while using it to issue a response.

I'm in the process of researching more possibilities for valid Turing test questions. This is obviously a very long-term goal, but it is useful to have the idea out in the open so that it can be discussed.

  1. Testing awareness of own knowledge. In this case if the entity being tested confirms competency to answer a given question, then it should be able to answer the question when it is asked. This also could be modified to ask a more generalized version that questions if the entity knows how about a general subject, for instance do you know how to compute natural logs?
  • Q: Do you know how to compute the natural log of seven fifths?
  • A: Yes
  • Q: What is the natural log of seven fifths?
  • A: I do not know.
  1. Testing creative intelligence. "Make up a story about X." This tests the ability of the entity in question to hypothesize about the nature of a given object or situation. This also demonstrates how well an entity might be able theorize when dealing with incomplete information.
  2. Ability to resolve states of cognitive dissonance. A simple way to test this may be to lie to the entity in question at one point in a conversation. By giving it contradictory information where one of the two components is clearly false, the entity should assume the fact to be incorrect.
  3. Test grouping of information. Humans have a natural tendency to mentally group similar objects and ideas.
  • Which one of these things is not like the other...
  1. Can a concept of self be defined?
  • There is a problem when the intelligence comes from the brilliance of the programmer and not the power of the machine.
  • Emergent order in chaotic systems → Neurons in the brain
  • Test based: That playing a sound causes an activity in x part of the brain.

Double blind Turing test

This is kind of an interesting topic. This is a scenario where neither tester knows if the other is a robot or if they themselves are a robot. This is a bit of a stretch goal.