AI-Generated Images Are Tricky to Spot

Sat, 11 Feb 2023 01:00:00 -0700

In December of 2022, I launched the human recognition of AI-generated imagery research quiz, often known simply as the AI Quiz. The quiz presented participants with thirty images randomly selected from a pool of both human-created and AI-generated art and photographs. The results I’ll discuss in this article were gathered between November 30, 2022 and December 8, 2022, inclusive.

The Setup

Participants were presented with the AI Quiz, which served them 30 questions. I kept the ratio of human-made to AI-generated images relatively balanced, and the images were randomly picked from a total pool of 143–113 AI-generated images and 30 human-made images (or photographs). For the AI-generated images, I used Stable Diffusion 1.5 and AniPlus v2 (a homegrown model based on a few other Stable Diffusion models) in AUTOMATIC1111’s Stable Diffusion WebUI (commit 98947d173e3f1667eba29c904f681047dea9de90) with the settings: eta: 0.69, steps: 15, sampler: DPM++ 2S a Karras. I also threw in 5 images from Midjourney’s popular page. Human-made images were grabbed from Artstation (before the place was invaded with AI-generated work) and Unsplash. There was no cherry-picking in sight too; I took everything the AI generated that looked even remotely like the prompt.

Midjourney on Undeleted Files

AI-Generated Images Are Tricky to Spot

The Setup