{"id":"f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e","title":"Hugging Face: Same Model, Different Harness—When to Pick CUGA?","argument":"The IBM Research authors argue that choosing an agent harness can substantially affect task completion, even when the model stays the same, and that the right choice depends on the work. In their AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27. They describe AppWorld as a proxy: its consumer apps test some capabilities also needed for enterprise automation, but it is not a direct enterprise benchmark. The authors say the comparison covered 90 tasks on one benchmark, used setups that were not identical, and did not test policy enforcement because the runs used no policies. They present CUGA as a harness for business work across APIs, apps, and web UIs, with policies that can be enforced by the runtime. Their examples include pausing for a person’s approval before a payment tool runs and blocking a payment over a configured limit. They also describe deployment inside an organization’s own environment, including air-gapped deployments. The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks, and say they will publish the rerun results whichever harness wins.","topicIds":["intelligence-and-discovery","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The comparison covers 90 tasks on one benchmark, and the authors say the results may not generalize to other tasks. The harness setups were not identical; CUGA used an AppWorld configuration the other harnesses did not. The runs did not use policies, so they do not measure policy enforcement. The source reports a benchmark comparison, not evidence that the same task-completion rates will occur in enterprise deployments.","speaker":{"name":"Hugging Face","roleAtSource":"Publisher"},"source":{"title":"Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?","publisher":"Hugging Face","format":"Article","url":"https://huggingface.co/blog/ibm-research/cuga-harness","publishedAt":"2026-11-03T15:57:39.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"The IBM Research authors argue that agent harness choice can substantially affect task completion even when the model is held constant.","excerpt":"we kept the model the same and changed only the harness.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"In the authors’ AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27.","excerpt":"CUGA\n81.1 (73/90)\n66.7 (20/30)\nHermes\n46.7 (42/90)\n26.7 (8/30)\nDeep Agents\n30.0 (27/90)\n6.7 (2/30)","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors describe AppWorld as a proxy that tests a subset of capabilities also needed for enterprise automation, rather than as a direct enterprise benchmark.","excerpt":"The apps are consumer apps, so AppWorld is a proxy: it tests a subset of the capabilities that enterprise automation also needs","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors say the comparison did not test policy enforcement, because the runs did not use policies.","excerpt":"And the runs did not use policies, so they do not measure policy enforcement.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors distinguish policy guidance from runtime enforcement: approvals and ToolGuards can stop tool calls regardless of the model’s decision.","excerpt":"approvals and ToolGuards are enforced by the runtime.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks and say they will publish the rerun results whichever harness wins.","excerpt":"We will rerun it on the same tasks and publish the results, whichever harness wins.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","checkedAt":"2026-11-10T06:40:07.612Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would Hermes or Deep Agents perform on the same tasks if configured for AppWorld, and would a rerun change the comparison?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Hugging Face: Same Model, Different Harness—When to Pick CUGA?","summary":"The IBM Research authors argue that choosing an agent harness can substantially affect task completion, even when the model stays the same, and that the right choice depends on the work. In their AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27. They describe AppWorld as a proxy: its consumer apps test some capabilities also needed for enterprise automation, but it is not a direct enterprise benchmark. The authors say the comparison covered 90 tasks on one benchmark, used setups that were not identical, and did not test policy enforcement because the runs used no policies. They present CUGA as a harness for business work across APIs, apps, and web UIs, with policies that can be enforced by the runtime. Their examples include pausing for a person’s approval before a payment tool runs and blocking a payment over a configured limit. They also describe deployment inside an organization’s own environment, including air-gapped deployments. The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks, and say they will publish the rerun results whichever harness wins.","question":"How would Hermes or Deep Agents perform on the same tasks if configured for AppWorld, and would a rerun change the comparison?","claims":[{"text":"The IBM Research authors argue that agent harness choice can substantially affect task completion even when the model is held constant.","excerpt":"we kept the model the same and changed only the harness.","support":"source-stated"},{"text":"In the authors’ AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27.","excerpt":"CUGA\n81.1 (73/90)\n66.7 (20/30)\nHermes\n46.7 (42/90)\n26.7 (8/30)\nDeep Agents\n30.0 (27/90)\n6.7 (2/30)","support":"source-stated"},{"text":"The authors describe AppWorld as a proxy that tests a subset of capabilities also needed for enterprise automation, rather than as a direct enterprise benchmark.","excerpt":"The apps are consumer apps, so AppWorld is a proxy: it tests a subset of the capabilities that enterprise automation also needs","support":"source-stated"},{"text":"The authors say the comparison did not test policy enforcement, because the runs did not use policies.","excerpt":"And the runs did not use policies, so they do not measure policy enforcement.","support":"source-stated"},{"text":"The authors distinguish policy guidance from runtime enforcement: approvals and ToolGuards can stop tool calls regardless of the model’s decision.","excerpt":"approvals and ToolGuards are enforced by the runtime.","support":"source-stated"},{"text":"The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks and say they will publish the rerun results whichever harness wins.","excerpt":"We will rerun it on the same tasks and publish the results, whichever harness wins.","support":"source-stated"}],"limitations":["The comparison covers 90 tasks on one benchmark, and the authors say the results may not generalize to other tasks.","The harness setups were not identical; CUGA used an AppWorld configuration the other harnesses did not.","The runs did not use policies, so they do not measure policy enforcement.","The source reports a benchmark comparison, not evidence that the same task-completion rates will occur in enterprise deployments."],"mediaId":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","correctionReason":null,"id":"f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e","publicationId":"8205e233-f6ef-4727-8740-7be62d3c4d6a","version":1,"sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","sourceTitle":"Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?","publisher":"Hugging Face","publishedAt":"2026-11-03T15:57:39.000Z","originalPublished":{"value":"2026-11-03T15:57:39.000Z","precision":"instant","basis":"feed_entry"},"firstObservedAt":"2026-11-03T16:01:44.564Z","createdAt":"2026-11-10T06:08:57.006Z","historical":true,"entityIds":["hugging-face"],"topicIds":["intelligence-and-discovery","work-and-agency"],"media":[{"id":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","kind":"article","url":"https://huggingface.co/blog/ibm-research/cuga-harness","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T16:02:04.551Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","checkedAt":"2026-11-10T06:40:07.612Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"1375d2bb7eec87b61f3355da0f5c0af1678f30662001e849264579aa9196d240","decidedAt":"2026-11-03T16:02:06.139Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"6f89f46ed476eb3e60346ce38977bbc2665d2e00398265aca7511800662ae266","observationId":"6d25cccc9c9e051aa347ab34c5678170ac4d02c8baf2e5932482feb26421054e","retrievedAt":"2026-11-03T16:02:04.340Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5b4b4d0e-3b7c-440b-8dfc-ae60daeac041"},"reviewer":{"model":"gpt-6-luna","runId":"56452b88-494a-41e1-8c1f-e3ec1512be17"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T06:08:57.006Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[],"authorRole":"article-author","hosts":[],"status":"missing","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[],"participationCoverage":{"total":0,"returned":0,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","snapshotId":"a9e8e8d368db52aa844ace0f83ba62d9da6f14abf6607911281bda78f7cdd049","contentSha256":"02eee4dda728e7689cfd5df8b9c2554d280c71a18a225b04eed1b64ebe24200f","textHash":"6f89f46ed476eb3e60346ce38977bbc2665d2e00398265aca7511800662ae266","observedAt":"2026-11-03T16:02:04.340Z","basis":"publisher-page-metadata","sourceLinks":93,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e/source"}},"canonicalUrl":"https://escapemeridian.com/readings/hugging-face-same-model-different-harness-when-to-pick-cuga-f57b49e3","formats":{"html":"/readings/hugging-face-same-model-different-harness-when-to-pick-cuga-f57b49e3","markdown":"/readings/hugging-face-same-model-different-harness-when-to-pick-cuga-f57b49e3.md","json":"/readings/hugging-face-same-model-different-harness-when-to-pick-cuga-f57b49e3.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-agent-harness","name":"Agent harness","explanation":"An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.","referenceUrl":"https://www.anthropic.com/research/demystifying-evals-for-ai-agents"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-api","name":"API","explanation":"An application programming interface: a defined way for software to request data or actions from another system.","referenceUrl":"https://developer.mozilla.org/en-US/docs/Glossary/API"}],"entities":[{"id":"hugging-face","name":"Hugging Face","kind":"organization","context":"Hugging Face hosts models, datasets and software that let people share, adapt and inspect AI systems.","referenceUrls":["https://huggingface.co/blog"],"path":"/entities/hugging-face","json":"/entities/hugging-face.json","markdown":"/entities/hugging-face.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e","revision":"8205e233-f6ef-4727-8740-7be62d3c4d6a","revisionKind":"publication-id","title":"Hugging Face: Same Model, Different Harness—When to Pick CUGA?","url":"https://escapemeridian.com/readings/hugging-face-same-model-different-harness-when-to-pick-cuga-f57b49e3"},"source":{"type":"source","id":"https://huggingface.co/blog/ibm-research/cuga-harness","revision":"6f89f46ed476eb3e60346ce38977bbc2665d2e00398265aca7511800662ae266","revisionKind":"sha256-source-text","title":"Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?","url":"https://huggingface.co/blog/ibm-research/cuga-harness"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e","title":"Hugging Face: Same Model, Different Harness—When to Pick CUGA?","argument":"The IBM Research authors argue that choosing an agent harness can substantially affect task completion, even when the model stays the same, and that the right choice depends on the work. In their AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27. They describe AppWorld as a proxy: its consumer apps test some capabilities also needed for enterprise automation, but it is not a direct enterprise benchmark. The authors say the comparison covered 90 tasks on one benchmark, used setups that were not identical, and did not test policy enforcement because the runs used no policies. They present CUGA as a harness for business work across APIs, apps, and web UIs, with policies that can be enforced by the runtime. Their examples include pausing for a person’s approval before a payment tool runs and blocking a payment over a configured limit. They also describe deployment inside an organization’s own environment, including air-gapped deployments. The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks, and say they will publish the rerun results whichever harness wins.","topicIds":["intelligence-and-discovery","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The comparison covers 90 tasks on one benchmark, and the authors say the results may not generalize to other tasks. The harness setups were not identical; CUGA used an AppWorld configuration the other harnesses did not. The runs did not use policies, so they do not measure policy enforcement. The source reports a benchmark comparison, not evidence that the same task-completion rates will occur in enterprise deployments.","speaker":{"name":"Hugging Face","roleAtSource":"Publisher"},"source":{"title":"Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?","publisher":"Hugging Face","format":"Article","url":"https://huggingface.co/blog/ibm-research/cuga-harness","publishedAt":"2026-11-03T15:57:39.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"The IBM Research authors argue that agent harness choice can substantially affect task completion even when the model is held constant.","excerpt":"we kept the model the same and changed only the harness.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"In the authors’ AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27.","excerpt":"CUGA\n81.1 (73/90)\n66.7 (20/30)\nHermes\n46.7 (42/90)\n26.7 (8/30)\nDeep Agents\n30.0 (27/90)\n6.7 (2/30)","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors describe AppWorld as a proxy that tests a subset of capabilities also needed for enterprise automation, rather than as a direct enterprise benchmark.","excerpt":"The apps are consumer apps, so AppWorld is a proxy: it tests a subset of the capabilities that enterprise automation also needs","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors say the comparison did not test policy enforcement, because the runs did not use policies.","excerpt":"And the runs did not use policies, so they do not measure policy enforcement.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors distinguish policy guidance from runtime enforcement: approvals and ToolGuards can stop tool calls regardless of the model’s decision.","excerpt":"approvals and ToolGuards are enforced by the runtime.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"},{"text":"The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks and say they will publish the rerun results whichever harness wins.","excerpt":"We will rerun it on the same tasks and publish the results, whichever harness wins.","url":"https://huggingface.co/blog/ibm-research/cuga-harness","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","checkedAt":"2026-11-10T06:40:07.612Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How would Hermes or Deep Agents perform on the same tasks if configured for AppWorld, and would a rerun change the comparison?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Hugging Face: Same Model, Different Harness—When to Pick CUGA?","summary":"The IBM Research authors argue that choosing an agent harness can substantially affect task completion, even when the model stays the same, and that the right choice depends on the work. In their AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27. They describe AppWorld as a proxy: its consumer apps test some capabilities also needed for enterprise automation, but it is not a direct enterprise benchmark. The authors say the comparison covered 90 tasks on one benchmark, used setups that were not identical, and did not test policy enforcement because the runs used no policies. They present CUGA as a harness for business work across APIs, apps, and web UIs, with policies that can be enforced by the runtime. Their examples include pausing for a person’s approval before a payment tool runs and blocking a payment over a configured limit. They also describe deployment inside an organization’s own environment, including air-gapped deployments. The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks, and say they will publish the rerun results whichever harness wins.","question":"How would Hermes or Deep Agents perform on the same tasks if configured for AppWorld, and would a rerun change the comparison?","claims":[{"text":"The IBM Research authors argue that agent harness choice can substantially affect task completion even when the model is held constant.","excerpt":"we kept the model the same and changed only the harness.","support":"source-stated"},{"text":"In the authors’ AppWorld comparison using GLM-5.3-flash, CUGA passed 73 of 90 tasks, Hermes 42, and Deep Agents 27.","excerpt":"CUGA\n81.1 (73/90)\n66.7 (20/30)\nHermes\n46.7 (42/90)\n26.7 (8/30)\nDeep Agents\n30.0 (27/90)\n6.7 (2/30)","support":"source-stated"},{"text":"The authors describe AppWorld as a proxy that tests a subset of capabilities also needed for enterprise automation, rather than as a direct enterprise benchmark.","excerpt":"The apps are consumer apps, so AppWorld is a proxy: it tests a subset of the capabilities that enterprise automation also needs","support":"source-stated"},{"text":"The authors say the comparison did not test policy enforcement, because the runs did not use policies.","excerpt":"And the runs did not use policies, so they do not measure policy enforcement.","support":"source-stated"},{"text":"The authors distinguish policy guidance from runtime enforcement: approvals and ToolGuards can stop tool calls regardless of the model’s decision.","excerpt":"approvals and ToolGuards are enforced by the runtime.","support":"source-stated"},{"text":"The authors invite readers to submit a Hermes or Deep Agents configuration for evaluation on the same tasks and say they will publish the rerun results whichever harness wins.","excerpt":"We will rerun it on the same tasks and publish the results, whichever harness wins.","support":"source-stated"}],"limitations":["The comparison covers 90 tasks on one benchmark, and the authors say the results may not generalize to other tasks.","The harness setups were not identical; CUGA used an AppWorld configuration the other harnesses did not.","The runs did not use policies, so they do not measure policy enforcement.","The source reports a benchmark comparison, not evidence that the same task-completion rates will occur in enterprise deployments."],"mediaId":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","correctionReason":null,"id":"f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e","publicationId":"8205e233-f6ef-4727-8740-7be62d3c4d6a","version":1,"sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","sourceTitle":"Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?","publisher":"Hugging Face","publishedAt":"2026-11-03T15:57:39.000Z","originalPublished":{"value":"2026-11-03T15:57:39.000Z","precision":"instant","basis":"feed_entry"},"firstObservedAt":"2026-11-03T16:01:44.564Z","createdAt":"2026-11-10T06:08:57.006Z","historical":true,"entityIds":["hugging-face"],"topicIds":["intelligence-and-discovery","work-and-agency"],"media":[{"id":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","kind":"article","url":"https://huggingface.co/blog/ibm-research/cuga-harness","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-03T16:02:04.551Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"found","sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","checkedAt":"2026-11-10T06:40:07.612Z","items":[],"note":"Media was declared by the source, but no asset passed the supported availability checks. Open the original source to view it."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"b05fd13d79e76b342d3b75b796117c261aa938a91cd535ffaf297d9053927ec5","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"1375d2bb7eec87b61f3355da0f5c0af1678f30662001e849264579aa9196d240","decidedAt":"2026-11-03T16:02:06.139Z","redecided":{"from":"stream-admission-v5","under":"stream-admission-v5+confidence-0.5"}},"provenance":{"textHash":"6f89f46ed476eb3e60346ce38977bbc2665d2e00398265aca7511800662ae266","observationId":"6d25cccc9c9e051aa347ab34c5678170ac4d02c8baf2e5932482feb26421054e","retrievedAt":"2026-11-03T16:02:04.340Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5b4b4d0e-3b7c-440b-8dfc-ae60daeac041"},"reviewer":{"model":"gpt-6-luna","runId":"56452b88-494a-41e1-8c1f-e3ec1512be17"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T06:08:57.006Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[],"authorRole":"article-author","hosts":[],"status":"missing","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[],"participationCoverage":{"total":0,"returned":0,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://huggingface.co/blog/ibm-research/cuga-harness","snapshotId":"a9e8e8d368db52aa844ace0f83ba62d9da6f14abf6607911281bda78f7cdd049","contentSha256":"02eee4dda728e7689cfd5df8b9c2554d280c71a18a225b04eed1b64ebe24200f","textHash":"6f89f46ed476eb3e60346ce38977bbc2665d2e00398265aca7511800662ae266","observedAt":"2026-11-03T16:02:04.340Z","basis":"publisher-page-metadata","sourceLinks":93,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f57b49e3b0a307dbb735772fe29c8bea1ef5c7cb9b51b1c9335da8b41496819e/source"}}}],"audits":[{"publicationId":"8205e233-f6ef-4727-8740-7be62d3c4d6a","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the argument and results to the IBM Research authors, with Hugging Face as the publisher. It keeps benchmark results and CUGA's capabilities as the authors' claims. The title's 'Hugging Face:' prefix names the publisher, and the summary correctly identifies the authors.","excerpt":"CUGA (ConfigUrable Generalist Agent) is IBM's open-source harness built for that job"},{"dimension":"summary","status":"uncertain","explanation":"The summary never explains the central term 'agent harness': the software around a model that plans steps, calls tools, and checks or enforces rules. A non-specialist cannot readily see why swapping it changes results. It also leaves 'open-weight model' and 'air-gapped' unexplained. Smallest repair: add one plain-language line defining a harness, ideally anchored to the source's prepare, call the model, execute loop. The rest is faithful, including the stated limits.","excerpt":"Every CUGA agent runs the same compact loop: prepare, call the model, execute, and repeat."},{"dimension":"date","status":"pass","explanation":"The originalPublished value, 2026-11-03, matches the article's stated publication date of November 3, 2026.","excerpt":"Published\nNovember 3, 2026"},{"dimension":"support","status":"pass","explanation":"The scores, the AppWorld proxy caveat, the absence of policies, runtime enforcement, the payment approval and limit examples, air-gapped deployment, and the rerun invitation are all stated in the source. The question follows from the authors' own disclosure that CUGA used a tailored configuration. No unsupported benefits are implied.","excerpt":"The CUGA team ran this comparison, and CUGA used an AppWorld configuration that the other harnesses did not."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original Hugging Face article, which is the most relevant way to access the source.","excerpt":null}],"createdAt":"2026-11-10T06:08:57.006Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}