# Devin Coldewey argues in TechCrunch that visual AI can miss basic image relationships

[Canonical reading](https://escapemeridian.com/readings/devin-coldewey-argues-in-techcrunch-that-visual-ai-can-miss-b8c6b71c)

TechCrunch published Devin Coldewey’s article on July 11, 2024. Coldewey argues that visual AI models can fail at simple image tasks, despite marketing language about “vision capabilities” and “visual understanding.” In tests by researchers at Auburn University and the University of Alberta, models struggled to judge whether shapes overlapped and to count interlocking circles. GPT-4o answered correctly only 18% of the time when circles were touching or close together; Gemini 1.5 Pro got close-distance cases right seven times out of ten. Coldewey suggests that familiar images in training data, such as the Olympic Rings, may explain why models succeed on some images and fail on others. Co-author Anh Nguyen cautions that “blind” is an imperfect term and says there is no technology to visualize exactly what a model is seeing. Coldewey’s point is not that visual AI is useless: he says models may be highly accurate on human actions, expressions and everyday scenes, while still lacking the kind of visual understanding these basic tests probe. The study’s simple tasks do not establish how models perform across all image interpretation, and the article does not explain how the models’ performance on those tasks relates to their accuracy on everyday scenes.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

TechCrunch · Article

Original source date: Jul 11, 2024 (2024-07-11).

Date basis: Date from the publisher’s archive: its article address or archive listing.

Added to Escape Meridian: 2026-11-18T11:38:11.277Z. First observed: 2026-10-24T02:23:58.114Z. Retrieved: 2026-10-24T02:25:38.465Z.

- ['Visual' AI models might not see anything at all](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Limits

Text as retrieved on October 24, 2026; originally published July 11, 2024. The article describes the study as “informal in some ways, but systematic” and does not provide its full methods or results in the retrieved text. The article does not give evidence establishing how performance on the simple tasks relates to accuracy on everyday scenes.


## Open question

How well do the models perform on the everyday scenes Coldewey says they are intended to interpret, and how was that performance measured?


## Source-stated

Coldewey argues that models’ failures on simple visual tasks challenge the idea that their image processing corresponds to human-like seeing.

> The point of this experiment is simply to show that, whatever these models are doing, it doesn’t really correspond with what we think of as seeing.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

The researchers tested multimodal models on simple tasks involving overlap, counting shapes and identifying a circled letter.

> They tested the biggest multimodal models on a series of very simple visual tasks, like asking whether two shapes overlap, or how many pentagons are in a picture, or which letter in a word is circled.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

In the reported overlap test, GPT-4o was correct 18% of the time when circles were touching or close together.

> at zero or small distances, it got it right only 18% of the time.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Coldewey suggests that models’ success with five interlocking circles may reflect familiar training data, including the Olympic Rings.

> Because they all have a five-circle image prominently featured in their training data: the Olympic Rings.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Nguyen says “blind” is an imperfect term and that no technology can visualize exactly what a model is seeing.

> Currently, there is no technology to visualize exactly what a model is seeing.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Coldewey says visual AI may still be highly accurate on human actions, expressions and everyday scenes.

> Each of these models is likely going to be highly accurate on things like human actions and expressions, photos of everyday objects and situations, and the like.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source and contributor context

TechCrunch · Publisher

The publisher is identified here. No individual author has been inferred.


## Source media

Media retrieval status: unchecked.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

- [Explore this context](/entities/time)
- [Reference](https://time.com/)

## Editorial provenance

Version 1. Publication ID: 38cdd559-d7c3-0618-b1fb-897b256b18dc.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-18T11:35:47.542Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge\_admitted\_by\_model, second\_opinion\_categorical.

Observation: 9e8297048cb683818f907f9a9e0cdefae7b26e0f0c60ffbb51f12a8a03a75e1a. Source text hash: 5c4d805b1ae429fcdadc1df16aebb68a22ba63f584849648508c1c2e92afe55b.


## Revision and source-check history

### Version 1 — 2026-11-18T11:38:11.277Z

TechCrunch published Devin Coldewey’s article on July 11, 2024. Coldewey argues that visual AI models can fail at simple image tasks, despite marketing language about “vision capabilities” and “visual understanding.” In tests by researchers at Auburn University and the University of Alberta, models struggled to judge whether shapes overlapped and to count interlocking circles. GPT-4o answered correctly only 18% of the time when circles were touching or close together; Gemini 1.5 Pro got close-distance cases right seven times out of ten. Coldewey suggests that familiar images in training data, such as the Olympic Rings, may explain why models succeed on some images and fail on others. Co-author Anh Nguyen cautions that “blind” is an imperfect term and says there is no technology to visualize exactly what a model is seeing. Coldewey’s point is not that visual AI is useless: he says models may be highly accurate on human actions, expressions and everyday scenes, while still lacking the kind of visual understanding these basic tests probe. The study’s simple tasks do not establish how models perform across all image interpretation, and the article does not explain how the models’ performance on those tasks relates to their accuracy on everyday scenes.

## Original source

TechCrunch · Article

Original source date: Jul 11, 2024 (2024-07-11).

Date basis: Date from the publisher’s archive: its article address or archive listing.

Added to Escape Meridian: 2026-11-18T11:38:11.277Z. First observed: 2026-10-24T02:23:58.114Z. Retrieved: 2026-10-24T02:25:38.465Z.

- ['Visual' AI models might not see anything at all](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Limits

Text as retrieved on October 24, 2026; originally published July 11, 2024. The article describes the study as “informal in some ways, but systematic” and does not provide its full methods or results in the retrieved text. The article does not give evidence establishing how performance on the simple tasks relates to accuracy on everyday scenes.


## Open question

How well do the models perform on the everyday scenes Coldewey says they are intended to interpret, and how was that performance measured?


## Source-stated

Coldewey argues that models’ failures on simple visual tasks challenge the idea that their image processing corresponds to human-like seeing.

> The point of this experiment is simply to show that, whatever these models are doing, it doesn’t really correspond with what we think of as seeing.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

The researchers tested multimodal models on simple tasks involving overlap, counting shapes and identifying a circled letter.

> They tested the biggest multimodal models on a series of very simple visual tasks, like asking whether two shapes overlap, or how many pentagons are in a picture, or which letter in a word is circled.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

In the reported overlap test, GPT-4o was correct 18% of the time when circles were touching or close together.

> at zero or small distances, it got it right only 18% of the time.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Coldewey suggests that models’ success with five interlocking circles may reflect familiar training data, including the Olympic Rings.

> Because they all have a five-circle image prominently featured in their training data: the Olympic Rings.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Nguyen says “blind” is an imperfect term and that no technology can visualize exactly what a model is seeing.

> Currently, there is no technology to visualize exactly what a model is seeing.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source-stated

Coldewey says visual AI may still be highly accurate on human actions, expressions and everyday scenes.

> Each of these models is likely going to be highly accurate on things like human actions and expressions, photos of everyday objects and situations, and the like.

- [Supporting source](https://techcrunch.com/2024/07/11/are-visual-ai-models-actually-blind/)

## Source and contributor context

TechCrunch · Publisher

The publisher is identified here. No individual author has been inferred.


## Source media

Media retrieval status: unchecked.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

- [Explore this context](/entities/time)
- [Reference](https://time.com/)

## Editorial provenance

Version 1. Publication ID: 38cdd559-d7c3-0618-b1fb-897b256b18dc.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-18T11:35:47.542Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge\_admitted\_by\_model, second\_opinion\_categorical.

Observation: 9e8297048cb683818f907f9a9e0cdefae7b26e0f0c60ffbb51f12a8a03a75e1a. Source text hash: 5c4d805b1ae429fcdadc1df16aebb68a22ba63f584849648508c1c2e92afe55b.


### passed — 2026-11-18T11:35:47.542Z — anthropic/claude-opus-5.5

Publication: 38cdd559-d7c3-0618-b1fb-897b256b18dc

attribution — pass: The page credits the article to Devin Coldewey at TechCrunch. The study is correctly attributed to researchers at Auburn University and the University of Alberta, and the quoted remarks are correctly attributed to co-author Anh Nguyen. The article's own arguments are kept as Coldewey's.

> researchers at Auburn University and the University of Alberta

summary — pass: The summary leads with Coldewey's argument and gives concrete examples (overlapping shapes, counting rings, the Olympic Rings explanation). It also keeps his caveat that the models are not useless. The training-data explanation is fairly framed as a suggestion, matching the source's "potential answer." The title and question are fair, and a non-specialist can follow the central terms.

> One potential answer, of course, is staring us right in the face

date — pass: The original publication date of 2024-07-11 matches the URL and the day-precision evidence, and the dateModified value is the same day. The Most Popular sidebar contains later stories, but the reading neither uses nor relies on them. The page is a publisher-page, not an archive copy, so no archive disclosure is needed. The reading uses no hindsight framing.

support — pass: Each claim matches its excerpt. The 18% figure, the Gemini 7/10 figure, the list of tasks, the Olympic Rings hypothesis, Nguyen's comments and the everyday-scenes caveat are all source-stated. The limitations and the question flag what the source does not show, without adding unsupported benefits or costs.

> Gemini Pro 1.5 does the best, but still only gets 7/10 at close distances.

media — pass: No media candidates were supplied and none was selected, which is consistent with the evidence.

## Recorded references

Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/b8c6b71c7e80487c009ec0390989f8928c2f69b8aabc3374f057ad3a22ca4e26/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/devin-coldewey-argues-in-techcrunch-that-visual-ai-can-miss-b8c6b71c.json)
