Skip to main content


AI Art Turing Test


I enjoyed this!

I got just over 50% correct, ie little better than chance. Clearly I don't know shit XD

Regardless of 'can you/can't you tell', my favourite pictures in this were all AI-generated, including both some I really thought were human, and some I correctly identified as AI.


astralcodexten.com/p/ai-art-tu…

in reply to Amber Dawn

70%. I did worst on the impressionist/abstract paintings and also the six where I had to explain my reasoning
in reply to Amber Dawn

  1. hands
  2. eyes
  3. look at edges and repetitive patterns, for... it's kinda hard to describe what, exactly, but a certain kind of weirdness (e.g. in the social preview image of the robot painting, check out the grid thing on the right)
  4. look below the semantic / representation level, at the medium: Are there brush strokes? Do they make sense?
in reply to Amber Dawn

Basically the same as Ben but adding:
- incoherent objects, especially in the background (eg. The grapes in the still life aren't organized into a bunch, there's a temple where some of the columns do a sort of Escher thing)
- re: edges and repetition: I think the specific signal here is often a sort of organic "blobbiness" or "spider-webbing" that doesn't match the expected style or subject matter. So like: varying line weights in a cartoon, windows that aren't actually square, embroidered detail on a tunic that doesn't look like anything, hair that doesn't attach to a person's head

I think it's easier to positively identify something as generated based on the presence of artefacts than it is to be sure something is human. The only one that I was >90% sure was human was the big spaceship.

in reply to Jen Blight

I was never >90% sure; my most confident guess was the "flailing limbs" one, on the basis that the medium seemed basically entirely self-consistent, and also seemed like the kind of thing that an AI would almost certainly not be familiar with / be able to model correctly.
in reply to Amber Dawn

I got 77%

I'm realizing a decent amount of real human art might involve strange out-of-place choices

in reply to kip

Correctly identified as AI: 18

Correctly identified as human: 19

Labeled human as AI: 4

Labeled AI as human: 7

(This might be off by 1 or 2, because 1 or 2 things in Scott's answer key didn't seem to perfectly line up with the test?? I think????)