# arXiv cs.AI: HarnessFlow: MCTS-Guided Harness Optimization for LLM Agents [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-harnessflow-mcts-guided-harness-optimization-for-c9eec7e5) Authors Zhi Hong, Qianlong Wang, and coauthors introduce HarnessFlow, a framework for optimizing executable harnesses that govern how large language model (LLM) agents interact with tools and an environment. They hold the model and task environment fixed, using Monte Carlo Tree Search (MCTS) to select candidate harnesses for refinement with archived code, execution feedback, and reusable mechanisms. The authors report results on six benchmarks spanning agentic tasks, coding, and web interaction. With 15 refinement attempts per benchmark, HarnessFlow achieved an average score of 69.48%: 10.89 percentage points above the initial harnesses and 3.95 above Meta-Harness. They also report lower average per-task execution costs than hand-engineered baselines. The paper argues that harness design, which the authors describe as largely manual, can be treated as structured search under a limited evaluation budget. As an Escape Meridian interpretation, the results offer evidence for this approach on the tested benchmarks, but do not establish its performance on other tasks or settings. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T04:02:14.881Z. First observed: 2026-11-05T05:06:31.868Z. Retrieved: 2026-11-10T04:01:33.525Z. - [HarnessFlow: MCTS-Guided Harness Optimization for LLM Agents](https://arxiv.org/abs/2611.06254) ## Limits The evidence provided is the arXiv abstract, which reports results on six benchmarks but does not include details of their setup or results for other tasks. The reported test scores and execution costs describe the evaluated benchmarks and comparisons; they do not establish performance in other settings. ## Open question Would HarnessFlow’s reported score and cost advantages hold on tasks beyond the six benchmarks evaluated? ## Source-stated The authors present HarnessFlow as a framework for optimizing complete executable harnesses while holding the model and task environment fixed. > We introduce HarnessFlow, a framework for optimizing complete executable harnesses under a limited candidate-evaluation budget, with the model and task environment held fixed. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated HarnessFlow uses an MCTS-based policy to choose harness candidates for refinement, using archived code, execution feedback, and reusable mechanisms. > using a Monte Carlo Tree Search (MCTS)-based policy to balance exploitation and exploration. A coding agent refines selected harnesses using archived code, execution feedback, and a library of reusable harness mechanisms. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The paper reports that HarnessFlow achieved the highest mean test scores among the compared methods on six benchmarks, with 15 refinement attempts per benchmark. > With 15 refinement attempts per benchmark, HarnessFlow achieves the highest mean test scores among the compared methods on six benchmarks spanning agentic tasks, coding, and web interaction. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The authors report an average score of 69.48%, exceeding initial harnesses by 10.89 percentage points and Meta-Harness by 3.95 percentage points. > The optimized harnesses achieve an average score of 69.48%, outperforming the initial harnesses and Meta-Harness by 10.89 and 3.95 percentage points, respectively - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The authors report lower average per-task execution costs than hand-engineered baselines. > while incurring lower average per-task execution costs than hand-engineered baselines. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Escape Meridian interpretation The reported evaluation covers six benchmarks; whether the reported advantages extend to other tasks remains untested in this evidence. > on six benchmarks spanning agentic tasks, coding, and web interaction. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source and contributor context Hong, Zhi, Wang, Qianlong, Wei, Hongchen, Wu, Aidan, Ying, Daohong, Kong, Mingze, Liu, Bei, Luo, Chong · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Agentic AI AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer. - [Definition reference](https://developers.google.com/machine-learning/glossary#agentic) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 94dbfe9e-6959-4a73-8830-95b33ed4502a. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T04:02:14.881Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 9b940800b7a40066b79697074c5e3f6052adfdd13b9f768c83b5f9ee7682a362. Source text hash: 3d326fe672c767a688e9470a0915f103d2263836070c1da2e783430cab2d2003. ## Revision and source-check history ### Version 1 — 2026-11-10T04:02:14.881Z Authors Zhi Hong, Qianlong Wang, and coauthors introduce HarnessFlow, a framework for optimizing executable harnesses that govern how large language model (LLM) agents interact with tools and an environment. They hold the model and task environment fixed, using Monte Carlo Tree Search (MCTS) to select candidate harnesses for refinement with archived code, execution feedback, and reusable mechanisms. The authors report results on six benchmarks spanning agentic tasks, coding, and web interaction. With 15 refinement attempts per benchmark, HarnessFlow achieved an average score of 69.48%: 10.89 percentage points above the initial harnesses and 3.95 above Meta-Harness. They also report lower average per-task execution costs than hand-engineered baselines. The paper argues that harness design, which the authors describe as largely manual, can be treated as structured search under a limited evaluation budget. As an Escape Meridian interpretation, the results offer evidence for this approach on the tested benchmarks, but do not establish its performance on other tasks or settings. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T04:02:14.881Z. First observed: 2026-11-05T05:06:31.868Z. Retrieved: 2026-11-10T04:01:33.525Z. - [HarnessFlow: MCTS-Guided Harness Optimization for LLM Agents](https://arxiv.org/abs/2611.06254) ## Limits The evidence provided is the arXiv abstract, which reports results on six benchmarks but does not include details of their setup or results for other tasks. The reported test scores and execution costs describe the evaluated benchmarks and comparisons; they do not establish performance in other settings. ## Open question Would HarnessFlow’s reported score and cost advantages hold on tasks beyond the six benchmarks evaluated? ## Source-stated The authors present HarnessFlow as a framework for optimizing complete executable harnesses while holding the model and task environment fixed. > We introduce HarnessFlow, a framework for optimizing complete executable harnesses under a limited candidate-evaluation budget, with the model and task environment held fixed. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated HarnessFlow uses an MCTS-based policy to choose harness candidates for refinement, using archived code, execution feedback, and reusable mechanisms. > using a Monte Carlo Tree Search (MCTS)-based policy to balance exploitation and exploration. A coding agent refines selected harnesses using archived code, execution feedback, and a library of reusable harness mechanisms. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The paper reports that HarnessFlow achieved the highest mean test scores among the compared methods on six benchmarks, with 15 refinement attempts per benchmark. > With 15 refinement attempts per benchmark, HarnessFlow achieves the highest mean test scores among the compared methods on six benchmarks spanning agentic tasks, coding, and web interaction. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The authors report an average score of 69.48%, exceeding initial harnesses by 10.89 percentage points and Meta-Harness by 3.95 percentage points. > The optimized harnesses achieve an average score of 69.48%, outperforming the initial harnesses and Meta-Harness by 10.89 and 3.95 percentage points, respectively - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source-stated The authors report lower average per-task execution costs than hand-engineered baselines. > while incurring lower average per-task execution costs than hand-engineered baselines. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Escape Meridian interpretation The reported evaluation covers six benchmarks; whether the reported advantages extend to other tasks remains untested in this evidence. > on six benchmarks spanning agentic tasks, coding, and web interaction. - [Supporting source](https://arxiv.org/abs/2611.06254) ## Source and contributor context Hong, Zhi, Wang, Qianlong, Wei, Hongchen, Wu, Aidan, Ying, Daohong, Kong, Mingze, Liu, Bei, Luo, Chong · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Agentic AI AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer. - [Definition reference](https://developers.google.com/machine-learning/glossary#agentic) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 94dbfe9e-6959-4a73-8830-95b33ed4502a. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T04:02:14.881Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 9b940800b7a40066b79697074c5e3f6052adfdd13b9f768c83b5f9ee7682a362. Source text hash: 3d326fe672c767a688e9470a0915f103d2263836070c1da2e783430cab2d2003. ### passed — 2026-11-10T04:02:14.881Z — anthropic/claude-opus-5.5 Publication: 94dbfe9e-6959-4a73-8830-95b33ed4502a attribution — pass: The draft correctly attributes HarnessFlow and its results to the paper's authors, naming the first two listed authors plus coauthors. Reported scores and costs are framed as author reports, and the generalization caveat is labeled as Escape Meridian interpretation. > Authors:Zhi Hong, Qianlong Wang, Hongchen Wei, Aidan Wu, Daohong Ying, Mingze Kong, Bei Liu, Chong Luo summary — pass: The summary leads with the development, gives a plain description of a harness (what governs how agents interact with tools and the environment), and keeps the fixed model and environment, the search mechanism, the budget and the results. MCTS and Meta-Harness get little explanation, but the reading remains understandable, and term tooltips can cover them. The title mirrors the source, and the question is a genuine open issue. > The performance of large language model (LLM) agents depends on both the underlying model and the harness that governs interaction with tools and the environment. date — pass: originalPublished 2026-11-04 matches the arXiv v1 submission date. It is not the later feed date of 2026-11-05. > \[Submitted on 4 Nov 2026\] support — pass: All numeric claims match the abstract: 15 attempts, six benchmarks, 69.48%, +10.89 and +3.95 points. The cost claim is correctly scoped to hand-engineered baselines. The phrase 'can be treated as structured search' is slightly firmer than the authors' 'promising route', but it is not a material change. The interpretation and limitations do not overstate the evidence. > These results suggest that structured harness search offers a promising route toward automating the design of capable and efficient LLM agents. media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the most relevant way to reach the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/c9eec7e50c80cb88f95b541c19a76c421c00c3bfcdaa22912a2a9c0051b1398a/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-harnessflow-mcts-guided-harness-optimization-for-c9eec7e5.json)