{"id":"88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c","title":"Researchers test detection of AI-agent commits without authorship signatures","argument":"Researchers Kosei Horikawa and coauthors investigate whether commits made by AI coding agents can be distinguished from human commits after authorship signatures are removed. Their study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.\n\nThe researchers report that detectors ranked agent commits above human commits with a ROC AUC of up to 0.859, a measure of how well a detector separates two groups. Most of the signal came from commit-message verbosity and change size, rather than the code itself. But at the observed share of agent commits, the best detector achieved a precision of only 0.332: most commits it flagged were not agent commits.\n\nDetection also transferred poorly to held-out Claude Code and Copilot commits. The authors say signature-free detection may help prioritize commits for review, but cannot replace recorded attribution. For studies using signatures to identify agent commits, they argue that those labels should be treated as a lower bound on agent activity.\n\nAn open question is whether these detection signals remain useful as agents and their commit practices change.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper's abstract; it does not provide details of the study design or results beyond those summarized there. The authors report limited transfer to held-out Claude Code and Copilot commits; the abstract does not establish how well detection works for other agents or repositories.","speaker":{"name":"Horikawa, Kosei, Li, Hao, Kashiwa, Yutaro, Ouatiti, Youssef Esseddiq, Sayagh, Mohammed, Adams, Bram, Iida, Hajimu, Hassan, Ahmed E.","roleAtSource":"Article author"},"source":{"title":"Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36229","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.","excerpt":"using 7,837,946 commits from 1,226 repositories, covering five coding agents and Human commits.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"After authorship signatures were masked, detectors ranked agent commits above human commits with a ROC AUC of up to 0.859; most of the signal came from message verbosity and change size, not code.","excerpt":"After signatures are masked, detectors rank Agent commits above Human commits with a ROC AUC of up to 0.859, and most of this signal comes from message verbosity and change size rather than from the code itself.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"At the observed share of agent commits, the best detector achieved a precision of 0.332 on the full test set.","excerpt":"At the observed Agent share, however, the best detector on the full test set reaches a precision of only 0.332.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"Detection transferred poorly to held-out Claude Code and Copilot commits; TF-IDF reached an AUC of 0.524 for Claude Code.","excerpt":"Detection transfers poorly to held-out Claude Code and Copilot, with TF-IDF reaching an AUC of only 0.524 for Claude Code.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"The authors say signature-free detection can prioritize commits for review but cannot replace recorded attribution; studies relying on signature-based labels should treat them as a lower bound on agent activity.","excerpt":"These results indicate that signature-free detection can prioritize commits for review but cannot replace recorded attribution, and that studies relying on signature-based labels should treat them as a lower bound on agent activity.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36229","checkedAt":"2026-11-06T09:34:07.041Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well will signature-free detectors identify agent commits as agents and their commit practices change?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Researchers test detection of AI-agent commits without authorship signatures","summary":"Researchers Kosei Horikawa and coauthors investigate whether commits made by AI coding agents can be distinguished from human commits after authorship signatures are removed. Their study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.\n\nThe researchers report that detectors ranked agent commits above human commits with a ROC AUC of up to 0.859, a measure of how well a detector separates two groups. Most of the signal came from commit-message verbosity and change size, rather than the code itself. But at the observed share of agent commits, the best detector achieved a precision of only 0.332: most commits it flagged were not agent commits.\n\nDetection also transferred poorly to held-out Claude Code and Copilot commits. The authors say signature-free detection may help prioritize commits for review, but cannot replace recorded attribution. For studies using signatures to identify agent commits, they argue that those labels should be treated as a lower bound on agent activity.\n\nAn open question is whether these detection signals remain useful as agents and their commit practices change.","question":"How well will signature-free detectors identify agent commits as agents and their commit practices change?","claims":[{"text":"The study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.","excerpt":"using 7,837,946 commits from 1,226 repositories, covering five coding agents and Human commits.","support":"source-stated"},{"text":"After authorship signatures were masked, detectors ranked agent commits above human commits with a ROC AUC of up to 0.859; most of the signal came from message verbosity and change size, not code.","excerpt":"After signatures are masked, detectors rank Agent commits above Human commits with a ROC AUC of up to 0.859, and most of this signal comes from message verbosity and change size rather than from the code itself.","support":"source-stated"},{"text":"At the observed share of agent commits, the best detector achieved a precision of 0.332 on the full test set.","excerpt":"At the observed Agent share, however, the best detector on the full test set reaches a precision of only 0.332.","support":"source-stated"},{"text":"Detection transferred poorly to held-out Claude Code and Copilot commits; TF-IDF reached an AUC of 0.524 for Claude Code.","excerpt":"Detection transfers poorly to held-out Claude Code and Copilot, with TF-IDF reaching an AUC of only 0.524 for Claude Code.","support":"source-stated"},{"text":"The authors say signature-free detection can prioritize commits for review but cannot replace recorded attribution; studies relying on signature-based labels should treat them as a lower bound on agent activity.","excerpt":"These results indicate that signature-free detection can prioritize commits for review but cannot replace recorded attribution, and that studies relying on signature-based labels should treat them as a lower bound on agent activity.","support":"source-stated"}],"limitations":["The evidence is the paper's abstract; it does not provide details of the study design or results beyond those summarized there.","The authors report limited transfer to held-out Claude Code and Copilot commits; the abstract does not establish how well detection works for other agents or repositories."],"mediaId":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","correctionReason":null,"id":"88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c","publicationId":"017f907a-da12-4264-82f5-44cc127c2940","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36229","sourceTitle":"Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T07:02:43.816Z","createdAt":"2026-11-05T16:31:33.678Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","kind":"article","url":"https://arxiv.org/abs/2610.36229","sourceUrl":"https://arxiv.org/abs/2610.36229","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T03:32:07.587Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36229","checkedAt":"2026-11-06T09:34:07.041Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","confidence":0.9000000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9a237c1394fc157f17802a0fa11f007de323e5cfd6d2817ae4c0da06573e6aa7","decidedAt":"2026-10-30T03:32:08.588Z"},"provenance":{"textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observationId":"18d7a4b6d2e8bfe715b622370359cc86c7961c3f04af9b9b0cd302f628257812","retrievedAt":"2026-10-30T03:32:07.429Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"91b3be31-ce09-4cbe-8b1d-182d15e006b5"},"reviewer":{"model":"gpt-6-luna","runId":"29b82922-e01b-4c19-84b5-15413b47548d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-05T16:31:33.678Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Horikawa, Kosei","url":null,"kind":"unknown"},{"name":"Li, Hao","url":null,"kind":"unknown"},{"name":"Kashiwa, Yutaro","url":null,"kind":"unknown"},{"name":"Ouatiti, Youssef Esseddiq","url":null,"kind":"unknown"},{"name":"Sayagh, Mohammed","url":null,"kind":"unknown"},{"name":"Adams, Bram","url":null,"kind":"unknown"},{"name":"Iida, Hajimu","url":null,"kind":"unknown"},{"name":"Hassan, Ahmed E.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Horikawa, Kosei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Horikawa, Kosei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Li, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Kashiwa, Yutaro","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kashiwa, Yutaro","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Ouatiti, Youssef Esseddiq","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ouatiti, Youssef Esseddiq","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Sayagh, Mohammed","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sayagh, Mohammed","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Adams, Bram","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Adams, Bram","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Iida, Hajimu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Iida, Hajimu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Hassan, Ahmed E.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hassan, Ahmed E.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36229","snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/researchers-test-detection-of-ai-agent-commits-without-88331289","formats":{"html":"/readings/researchers-test-detection-of-ai-agent-commits-without-88331289","markdown":"/readings/researchers-test-detection-of-ai-agent-commits-without-88331289.md","json":"/readings/researchers-test-detection-of-ai-agent-commits-without-88331289.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c","revision":"017f907a-da12-4264-82f5-44cc127c2940","revisionKind":"publication-id","title":"Researchers test detection of AI-agent commits without authorship signatures","url":"https://escapemeridian.com/readings/researchers-test-detection-of-ai-agent-commits-without-88331289"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.36229","revision":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","revisionKind":"sha256-source-text","title":"Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures","url":"https://arxiv.org/abs/2610.36229"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c","title":"Researchers test detection of AI-agent commits without authorship signatures","argument":"Researchers Kosei Horikawa and coauthors investigate whether commits made by AI coding agents can be distinguished from human commits after authorship signatures are removed. Their study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.\n\nThe researchers report that detectors ranked agent commits above human commits with a ROC AUC of up to 0.859, a measure of how well a detector separates two groups. Most of the signal came from commit-message verbosity and change size, rather than the code itself. But at the observed share of agent commits, the best detector achieved a precision of only 0.332: most commits it flagged were not agent commits.\n\nDetection also transferred poorly to held-out Claude Code and Copilot commits. The authors say signature-free detection may help prioritize commits for review, but cannot replace recorded attribution. For studies using signatures to identify agent commits, they argue that those labels should be treated as a lower bound on agent activity.\n\nAn open question is whether these detection signals remain useful as agents and their commit practices change.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper's abstract; it does not provide details of the study design or results beyond those summarized there. The authors report limited transfer to held-out Claude Code and Copilot commits; the abstract does not establish how well detection works for other agents or repositories.","speaker":{"name":"Horikawa, Kosei, Li, Hao, Kashiwa, Yutaro, Ouatiti, Youssef Esseddiq, Sayagh, Mohammed, Adams, Bram, Iida, Hajimu, Hassan, Ahmed E.","roleAtSource":"Article author"},"source":{"title":"Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36229","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.","excerpt":"using 7,837,946 commits from 1,226 repositories, covering five coding agents and Human commits.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"After authorship signatures were masked, detectors ranked agent commits above human commits with a ROC AUC of up to 0.859; most of the signal came from message verbosity and change size, not code.","excerpt":"After signatures are masked, detectors rank Agent commits above Human commits with a ROC AUC of up to 0.859, and most of this signal comes from message verbosity and change size rather than from the code itself.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"At the observed share of agent commits, the best detector achieved a precision of 0.332 on the full test set.","excerpt":"At the observed Agent share, however, the best detector on the full test set reaches a precision of only 0.332.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"Detection transferred poorly to held-out Claude Code and Copilot commits; TF-IDF reached an AUC of 0.524 for Claude Code.","excerpt":"Detection transfers poorly to held-out Claude Code and Copilot, with TF-IDF reaching an AUC of only 0.524 for Claude Code.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"},{"text":"The authors say signature-free detection can prioritize commits for review but cannot replace recorded attribution; studies relying on signature-based labels should treat them as a lower bound on agent activity.","excerpt":"These results indicate that signature-free detection can prioritize commits for review but cannot replace recorded attribution, and that studies relying on signature-based labels should treat them as a lower bound on agent activity.","url":"https://arxiv.org/abs/2610.36229","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36229","checkedAt":"2026-11-06T09:34:07.041Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well will signature-free detectors identify agent commits as agents and their commit practices change?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Researchers test detection of AI-agent commits without authorship signatures","summary":"Researchers Kosei Horikawa and coauthors investigate whether commits made by AI coding agents can be distinguished from human commits after authorship signatures are removed. Their study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.\n\nThe researchers report that detectors ranked agent commits above human commits with a ROC AUC of up to 0.859, a measure of how well a detector separates two groups. Most of the signal came from commit-message verbosity and change size, rather than the code itself. But at the observed share of agent commits, the best detector achieved a precision of only 0.332: most commits it flagged were not agent commits.\n\nDetection also transferred poorly to held-out Claude Code and Copilot commits. The authors say signature-free detection may help prioritize commits for review, but cannot replace recorded attribution. For studies using signatures to identify agent commits, they argue that those labels should be treated as a lower bound on agent activity.\n\nAn open question is whether these detection signals remain useful as agents and their commit practices change.","question":"How well will signature-free detectors identify agent commits as agents and their commit practices change?","claims":[{"text":"The study analyzes 7,837,946 commits from 1,226 repositories, covering five coding agents and human commits.","excerpt":"using 7,837,946 commits from 1,226 repositories, covering five coding agents and Human commits.","support":"source-stated"},{"text":"After authorship signatures were masked, detectors ranked agent commits above human commits with a ROC AUC of up to 0.859; most of the signal came from message verbosity and change size, not code.","excerpt":"After signatures are masked, detectors rank Agent commits above Human commits with a ROC AUC of up to 0.859, and most of this signal comes from message verbosity and change size rather than from the code itself.","support":"source-stated"},{"text":"At the observed share of agent commits, the best detector achieved a precision of 0.332 on the full test set.","excerpt":"At the observed Agent share, however, the best detector on the full test set reaches a precision of only 0.332.","support":"source-stated"},{"text":"Detection transferred poorly to held-out Claude Code and Copilot commits; TF-IDF reached an AUC of 0.524 for Claude Code.","excerpt":"Detection transfers poorly to held-out Claude Code and Copilot, with TF-IDF reaching an AUC of only 0.524 for Claude Code.","support":"source-stated"},{"text":"The authors say signature-free detection can prioritize commits for review but cannot replace recorded attribution; studies relying on signature-based labels should treat them as a lower bound on agent activity.","excerpt":"These results indicate that signature-free detection can prioritize commits for review but cannot replace recorded attribution, and that studies relying on signature-based labels should treat them as a lower bound on agent activity.","support":"source-stated"}],"limitations":["The evidence is the paper's abstract; it does not provide details of the study design or results beyond those summarized there.","The authors report limited transfer to held-out Claude Code and Copilot commits; the abstract does not establish how well detection works for other agents or repositories."],"mediaId":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","correctionReason":null,"id":"88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c","publicationId":"017f907a-da12-4264-82f5-44cc127c2940","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36229","sourceTitle":"Agent or Human? Detecting Commits by AI Coding Agents in the Absence of Authorship Signatures","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T07:02:43.816Z","createdAt":"2026-11-05T16:31:33.678Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","kind":"article","url":"https://arxiv.org/abs/2610.36229","sourceUrl":"https://arxiv.org/abs/2610.36229","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T03:32:07.587Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36229","checkedAt":"2026-11-06T09:34:07.041Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d628a731fad05cc172d458d14b28bb95c4f63da2ded17a55b78d56163ba35ed7","confidence":0.9000000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9a237c1394fc157f17802a0fa11f007de323e5cfd6d2817ae4c0da06573e6aa7","decidedAt":"2026-10-30T03:32:08.588Z"},"provenance":{"textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observationId":"18d7a4b6d2e8bfe715b622370359cc86c7961c3f04af9b9b0cd302f628257812","retrievedAt":"2026-10-30T03:32:07.429Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"91b3be31-ce09-4cbe-8b1d-182d15e006b5"},"reviewer":{"model":"gpt-6-luna","runId":"29b82922-e01b-4c19-84b5-15413b47548d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-05T16:31:33.678Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Horikawa, Kosei","url":null,"kind":"unknown"},{"name":"Li, Hao","url":null,"kind":"unknown"},{"name":"Kashiwa, Yutaro","url":null,"kind":"unknown"},{"name":"Ouatiti, Youssef Esseddiq","url":null,"kind":"unknown"},{"name":"Sayagh, Mohammed","url":null,"kind":"unknown"},{"name":"Adams, Bram","url":null,"kind":"unknown"},{"name":"Iida, Hajimu","url":null,"kind":"unknown"},{"name":"Hassan, Ahmed E.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Horikawa, Kosei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Horikawa, Kosei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Li, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Kashiwa, Yutaro","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kashiwa, Yutaro","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Ouatiti, Youssef Esseddiq","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ouatiti, Youssef Esseddiq","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Sayagh, Mohammed","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sayagh, Mohammed","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Adams, Bram","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Adams, Bram","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Iida, Hajimu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Iida, Hajimu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}},{"actor":{"name":"Hassan, Ahmed E.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hassan, Ahmed E.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36229","locator":"head/meta[name=author|citation_author]"},"assertionId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T09:34:07.041Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","sourceUrl":"https://arxiv.org/abs/2610.36229","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36229","snapshotId":"03edfaea6a7be39050096081761debcfba9f0eae428ddb8289e8a954bfb28fcd","contentSha256":"e1cffe8679480af7164430a99d503193c0f884047c8fbe5d916bd50d0177afb9","textHash":"5c9f72e695786c433116957db8f9e0f2bf4f42e78ec2a7f423ed59ccf9302d99","observedAt":"2026-11-06T09:34:07.041Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/88331289a09c5a8908460bc1e0ceafff780c756a19021738ec50ecacd7a26d4c/source"}}}],"audits":[{"publicationId":"017f907a-da12-4264-82f5-44cc127c2940","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft attributes the study and its conclusions to Kosei Horikawa and coauthors, matching the arXiv author list. Reported results and recommendations are framed as the researchers' findings and arguments, not as established fact.","excerpt":"Authors:Kosei Horikawa, Hao Li, Yutaro Kashiwa, Youssef Esseddiq Ouatiti, Mohammed Sayagh, Bram Adams, Hajimu Iida, Ahmed E. Hassan"},{"dimension":"summary","status":"uncertain","explanation":"Numbers and conclusions are accurate, and the draft explains ROC AUC and precision. However, the central term 'authorship signatures' is never explained. The draft also omits why the study matters: signatures such as bot accounts and Co-authored-by trailers are optional, removable and often attached to pull requests rather than commits. 'Commit' and 'held-out' are also unexplained for non-specialists. Smallest repair: add one sentence defining signatures and why they go missing, and define held-out as agents excluded from training.","excerpt":"These signatures are optional, can be removed, and are often attached to pull requests rather than to individual commits."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-10-26 matches the v1 submission date shown on the arXiv page. It is not the later feed date.","excerpt":"[Submitted on 26 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract verbatim. The inference that most flagged commits were not agent commits follows from a precision of 0.332. 'May help prioritize' slightly softens the source's 'can prioritize' without changing its meaning. The open question about changing agents follows from the reported temporal and transfer limits and is not a disguised claim.","excerpt":"At the observed Agent share, however, the best detector on the full test set reaches a precision of only 0.332."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-05T16:31:33.678Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}