Skip to content
Escape
Meridian

The future is still open.

· Sep 29, 2025

Ethan Mollick argues in One Useful Thing that AI’s value depends on how people use it

Markdown · JSON · Original source

’s piece was published September 29, 2025. He argues that AI can now perform economically valuable tasks, including reproducing research from existing data, but that doing tasks is not the same as replacing whole jobs. In his account, Sonnet 4.5 worked through replication files and results for several papers; Mollick says spot checks and a second AI model’s reproduction checked out, while some papers could not be accessed. He sees a possible way to scale checks on published research, while noting barriers including for accuracy and fairness. Mollick also warns that agents can multiply work people do not need: he asked Claude to turn a memo into presentations and received 17 versions. He argues that the important distinction is whether people use their judgment to decide what is worth doing, rather than simply producing more. He relays an paper’s suggested workflow: delegate a first pass, review it, try corrections if needed, and do the work oneself if that fails. The paper estimates this could make work faster and cheaper while retaining human control. Whether AI can reproduce research accurately and fairly at scale, and how organizations will choose to use agents, remain open questions.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

One Useful ThingArticle · oneusefulthing.orgOpen original source

Original source

· Article

Source details

Original source date: Sep 29, 2025 (2025-09-29T18:52:42.000Z).

Date basis: Date supplied by the publisher’s feed.

Added to Escape Meridian: 2026-11-12T01:03:23.472Z. First observed: 2026-09-23T05:45:06.331Z. Retrieved: 2026-10-23T20:15:35.062Z.

Referenced by

Recorded citations and public file attachments. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

Text as retrieved on October 23, 2026; originally published September 29, 2025. Mollick’s account of reproducing research describes his tests and spot checks; the piece does not report a systematic evaluation of accuracy or fairness across published papers.

Open question

What accuracy and fairness standards would be needed before AI could reproduce published research at scale?

Source-stated

Ethan Mollick argues that AI can perform economically valuable tasks, but that automating tasks does not by itself replace whole jobs.

AIs have quietly crossed a threshold: they can now perform real, economically relevant work.

Source-stated

Mollick reports that Claude Sonnet 4.5 worked through replication data for an economics paper and that his spot checks and a second AI model’s reproduction checked out.

I spot checked the results and had another AI model, GPT-5 Pro, reproduce the reproduction. It all checked out.

Source-stated

Mollick says some papers could not be tested because of file-size limits or problems with their replication data, and identifies accuracy and fairness benchmarking as barriers to broader use.

There are still barriers to doing this, including benchmarking for accuracy and fairness

Source-stated

Mollick warns that agents can produce unnecessary work, describing how Claude generated 17 PowerPoints from a corporate memo.

Until I got 17 different PowerPoints. That is too many PowerPoints.

Source-stated

Mollick argues that people’s judgment about what work is worth doing will shape whether AI makes them more capable or merely more productive.

By using our judgement in deciding what’s worth doing, not just what can be done, we can ensure these tools make us more capable, not just more productive.

Source-stated

The source is dated September 29, 2025.

Ethan Mollick Sep 29, 2025

Source and contributor context

One Useful Thing · Publisher

The publisher is identified here. No individual author has been inferred.

Source media

Media retrieval status: unchecked.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

Ethan Mollick

Ethan Mollick is a Wharton researcher and author exploring how AI changes work, learning and decision-making.

One Useful Thing

One Useful Thing is Ethan Mollick’s publication about AI in work, education and everyday practice.

Claude

Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.

OpenAI

OpenAI develops AI models and products and publishes research, release announcements and evaluations.

Editorial provenance

Version 1. Publication ID: fe9c690e-c71c-ed07-4a0e-690d05193565.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T00:58:42.374Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge_admitted_by_model.

Observation: 9d12fbda725b166a1b68975fcb938e9fd268763b6877a3caf9baafea26c6f91c. Source text hash: 0347a5d6dd15753c9220a5e56f8a8da9052cd955497cffbb9b27900b4f6ad425.

Revision and source-check history

Version 1 · 2026-11-12T01:03:23.472Z

Ethan Mollick argues in One Useful Thing that AI’s value depends on how people use it

’s piece was published September 29, 2025. He argues that AI can now perform economically valuable tasks, including reproducing research from existing data, but that doing tasks is not the same as replacing whole jobs. In his account, Sonnet 4.5 worked through replication files and results for several papers; Mollick says spot checks and a second AI model’s reproduction checked out, while some papers could not be accessed. He sees a possible way to scale checks on published research, while noting barriers including for accuracy and fairness. Mollick also warns that agents can multiply work people do not need: he asked Claude to turn a memo into presentations and received 17 versions. He argues that the important distinction is whether people use their judgment to decide what is worth doing, rather than simply producing more. He relays an paper’s suggested workflow: delegate a first pass, review it, try corrections if needed, and do the work oneself if that fails. The paper estimates this could make work faster and cheaper while retaining human control. Whether AI can reproduce research accurately and fairly at scale, and how organizations will choose to use agents, remain open questions.

Original source

· Article

Source details

Original source date: Sep 29, 2025 (2025-09-29T18:52:42.000Z).

Date basis: Date supplied by the publisher’s feed.

Added to Escape Meridian: 2026-11-12T01:03:23.472Z. First observed: 2026-09-23T05:45:06.331Z. Retrieved: 2026-10-23T20:15:35.062Z.

Limits

Text as retrieved on October 23, 2026; originally published September 29, 2025. Mollick’s account of reproducing research describes his tests and spot checks; the piece does not report a systematic evaluation of accuracy or fairness across published papers.

Open question

What accuracy and fairness standards would be needed before AI could reproduce published research at scale?

Source-stated

Ethan Mollick argues that AI can perform economically valuable tasks, but that automating tasks does not by itself replace whole jobs.

AIs have quietly crossed a threshold: they can now perform real, economically relevant work.

Source-stated

Mollick reports that Claude Sonnet 4.5 worked through replication data for an economics paper and that his spot checks and a second AI model’s reproduction checked out.

I spot checked the results and had another AI model, GPT-5 Pro, reproduce the reproduction. It all checked out.

Source-stated

Mollick says some papers could not be tested because of file-size limits or problems with their replication data, and identifies accuracy and fairness benchmarking as barriers to broader use.

There are still barriers to doing this, including benchmarking for accuracy and fairness

Source-stated

Mollick warns that agents can produce unnecessary work, describing how Claude generated 17 PowerPoints from a corporate memo.

Until I got 17 different PowerPoints. That is too many PowerPoints.

Source-stated

Mollick argues that people’s judgment about what work is worth doing will shape whether AI makes them more capable or merely more productive.

By using our judgement in deciding what’s worth doing, not just what can be done, we can ensure these tools make us more capable, not just more productive.

Source-stated

The source is dated September 29, 2025.

Ethan Mollick Sep 29, 2025

Source and contributor context

One Useful Thing · Publisher

The publisher is identified here. No individual author has been inferred.

Source media

Media retrieval status: unchecked.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

Ethan Mollick

Ethan Mollick is a Wharton researcher and author exploring how AI changes work, learning and decision-making.

One Useful Thing

One Useful Thing is Ethan Mollick’s publication about AI in work, education and everyday practice.

Claude

Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.

OpenAI

OpenAI develops AI models and products and publishes research, release announcements and evaluations.

Editorial provenance

Version 1. Publication ID: fe9c690e-c71c-ed07-4a0e-690d05193565.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T00:58:42.374Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge_admitted_by_model.

Observation: 9d12fbda725b166a1b68975fcb938e9fd268763b6877a3caf9baafea26c6f91c. Source text hash: 0347a5d6dd15753c9220a5e56f8a8da9052cd955497cffbb9b27900b4f6ad425.

uncertain · 2026-11-12T00:58:42.374Z · anthropic/claude-opus-5.5

Publication: fe9c690e-c71c-ed07-4a0e-690d05193565

attribution — pass: The reading correctly attributes the essay to Ethan Mollick in One Useful Thing. It keeps his arguments and reported tests framed as his claims, and attributes the suggested workflow to the OpenAI paper he relays.

Real AI Agents and Real Work The race between human-centered work and infinite PowerPoints Ethan Mollick

summary — uncertain: The reading is largely faithful, but 'agents' is central to it and never explained. The definitions list covers only Benchmark. Smallest repair: add the source's own plain description, AI that is given a task and can plan and use tools such as coding or web search to complete it, or add a term-library entry. The reading also omits Mollick's opening evidence: the OpenAI expert-task test, where human experts won only narrowly, and the METR task-length trend. That trims context for his threshold claim but does not change his position.

The dream of autonomous AI agents, which, when given a task, can plan and use tools (coding, web search) to accomplish it, seemed far away.

date — pass: The instant 2025-09-29T18:52:42Z falls on the UTC day September 29, 2025, which matches the source dateline. There is no hindsight framing, and the kind is publisher-page, so no archive disclosure is needed. The modification date equals the publication date.

Ethan Mollick Sep 29, 2025

support — pass: Each claim is supported by the source text: the threshold and task-versus-job argument, the Claude replication with spot checks and a GPT-5 Pro cross-check, results on other papers, file-size and data limits, barriers around accuracy and fairness benchmarking, the 17 PowerPoints, and the judgment conclusion. The OpenAI workflow is presented as the paper's estimate. The question follows from the barriers the source names.

I tried this on several other papers with similarly good results, though some were inaccessible due to file size limitations or issues with the replication data provided.

media — pass: No media was selected, and no verified candidates were supplied, so no media is the appropriate choice.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.