# arXiv cs.AI: AmbiHTMLBench tests HTML document reconstruction
[Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-ambihtmlbench-tests-html-document-reconstruction-f07b0b7e)
The authors of AmbiHTMLBench argue that Markdown, while effective for linear text, can lose spatial structure, table geometry, visual hierarchy and rendering semantics in documents where layout matters. They introduce a benchmark in which models reconstruct real-world documents as executable HTML, preserving content, organization and visual appearance. The benchmark contains 1,115 diverse pages with structured annotations. It evaluates reconstructions using two approaches: an objective protocol that compares rendered blocks and measures table fidelity, page-level text error and two-dimensional layout consistency; and a reference-anchored protocol that uses LLM judges aligned with human preferences to assess perceived fidelity. Across ten primary multimodal systems, the highest objective score and the subjective winner differ. The authors say this demonstrates that automatic decomposition and human-perceived fidelity capture complementary properties. They also report that task-specific adaptation of a small-parameter expert model yields good performance on document-to-HTML reconstruction. The authors present AmbiHTMLBench as a diagnostic testbed for building smarter and more logical document parsing systems. The abstract describes the pages as diverse but does not specify which document types they contain.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
## Original source
arXiv cs.AI · Article
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T11:52:46.422Z. First observed: 2026-11-05T05:09:32.062Z. Retrieved: 2026-11-09T11:48:13.563Z.
- [AmbiHTMLBench: A Benchmark for HTML-based Visually Rich Document parsing](https://arxiv.org/abs/2611.06449)
## Limits
The abstract describes the pages as diverse but does not specify which document types they contain. The abstract reports benchmark results but does not establish how well the systems perform on documents outside the benchmark.
## Open question
What kinds of documents are represented in the benchmark’s 1,115 pages, and how might that coverage affect its evaluation results?
## Source-stated
The authors say Markdown is effective for linear text but does not fully preserve layout and rendering details in visually rich documents.
> Traditional document parsing systems use Markdown as their output representation, which is effective for linear text but does not fully preserve fine-grained spatial structure, table geometry, visual hierarchy, or rendering semantics.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
AmbiHTMLBench evaluates whether models can reconstruct real-world documents as executable HTML while preserving content, organization and appearance.
> given a real-world document, a model must recover executable HTML that preserves its content, organization, and visual appearance.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
The benchmark contains 1,115 diverse pages with structured annotations and uses an objective protocol and a reference-anchored protocol.
> The benchmark contains 1,115 diverse pages with structured annotations and evaluates predictions in two different ways:
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
Across ten primary multimodal systems, the highest objective score and the subjective winner differ; the authors say the two approaches capture complementary properties.
> Across ten primary multimodal systems, the best objective score is 0.8092, while the subjective winner is different, demonstrating that automatic decomposition and human-perceived fidelity capture complementary properties.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
The authors report good performance on document-to-HTML reconstruction after task-specific adaptation of a small-parameter expert model.
> We further fine-tune a small-parameter expert model and find that task-specific adaptation yields good performance on document-to-HTML reconstruction task.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source and contributor context
Niu, Boyu, Xiong, Yingjie, Li, Shurui, Pang, Linhan, Zhang, Yuntong, Wang, Han, Wu, Hao, Zuo, Kai, Tang, Xu, Zhou, Xuanhe, Wu, Fan · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
## Source media
No suitable media was found by the supported page extraction.
## Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
## Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
- [Definition reference](https://arxiv.org/abs/2211.09110)
## Large language model
A language model with many learned numerical settings, used to process and generate language.
- [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model)
## Multimodal model
A model that works with more than one kind of input or output, such as text, images and audio.
- [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model)
## arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)
## Editorial provenance
Version 1. Publication ID: 4c72f909-f14d-4673-8791-25205b305c43.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T11:52:46.422Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material\_development.
Observation: f823757bc4f022cc21d01bd50b1aae2e45ef8987bfe15cdb1cf4291cb7282094. Source text hash: 69bec8217ce24353687b5a5a38f8a8ea594d6acb700d6d0130f281945c5b1c1f.
## Revision and source-check history
### Version 1 — 2026-11-09T11:52:46.422Z
The authors of AmbiHTMLBench argue that Markdown, while effective for linear text, can lose spatial structure, table geometry, visual hierarchy and rendering semantics in documents where layout matters. They introduce a benchmark in which models reconstruct real-world documents as executable HTML, preserving content, organization and visual appearance. The benchmark contains 1,115 diverse pages with structured annotations. It evaluates reconstructions using two approaches: an objective protocol that compares rendered blocks and measures table fidelity, page-level text error and two-dimensional layout consistency; and a reference-anchored protocol that uses LLM judges aligned with human preferences to assess perceived fidelity. Across ten primary multimodal systems, the highest objective score and the subjective winner differ. The authors say this demonstrates that automatic decomposition and human-perceived fidelity capture complementary properties. They also report that task-specific adaptation of a small-parameter expert model yields good performance on document-to-HTML reconstruction. The authors present AmbiHTMLBench as a diagnostic testbed for building smarter and more logical document parsing systems. The abstract describes the pages as diverse but does not specify which document types they contain.
## Original source
arXiv cs.AI · Article
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T11:52:46.422Z. First observed: 2026-11-05T05:09:32.062Z. Retrieved: 2026-11-09T11:48:13.563Z.
- [AmbiHTMLBench: A Benchmark for HTML-based Visually Rich Document parsing](https://arxiv.org/abs/2611.06449)
## Limits
The abstract describes the pages as diverse but does not specify which document types they contain. The abstract reports benchmark results but does not establish how well the systems perform on documents outside the benchmark.
## Open question
What kinds of documents are represented in the benchmark’s 1,115 pages, and how might that coverage affect its evaluation results?
## Source-stated
The authors say Markdown is effective for linear text but does not fully preserve layout and rendering details in visually rich documents.
> Traditional document parsing systems use Markdown as their output representation, which is effective for linear text but does not fully preserve fine-grained spatial structure, table geometry, visual hierarchy, or rendering semantics.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
AmbiHTMLBench evaluates whether models can reconstruct real-world documents as executable HTML while preserving content, organization and appearance.
> given a real-world document, a model must recover executable HTML that preserves its content, organization, and visual appearance.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
The benchmark contains 1,115 diverse pages with structured annotations and uses an objective protocol and a reference-anchored protocol.
> The benchmark contains 1,115 diverse pages with structured annotations and evaluates predictions in two different ways:
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
Across ten primary multimodal systems, the highest objective score and the subjective winner differ; the authors say the two approaches capture complementary properties.
> Across ten primary multimodal systems, the best objective score is 0.8092, while the subjective winner is different, demonstrating that automatic decomposition and human-perceived fidelity capture complementary properties.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source-stated
The authors report good performance on document-to-HTML reconstruction after task-specific adaptation of a small-parameter expert model.
> We further fine-tune a small-parameter expert model and find that task-specific adaptation yields good performance on document-to-HTML reconstruction task.
- [Supporting source](https://arxiv.org/abs/2611.06449)
## Source and contributor context
Niu, Boyu, Xiong, Yingjie, Li, Shurui, Pang, Linhan, Zhang, Yuntong, Wang, Han, Wu, Hao, Zuo, Kai, Tang, Xu, Zhou, Xuanhe, Wu, Fan · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
## Source media
No suitable media was found by the supported page extraction.
## Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
## Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
- [Definition reference](https://arxiv.org/abs/2211.09110)
## Large language model
A language model with many learned numerical settings, used to process and generate language.
- [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model)
## Multimodal model
A model that works with more than one kind of input or output, such as text, images and audio.
- [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model)
## arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)
## Editorial provenance
Version 1. Publication ID: 4c72f909-f14d-4673-8791-25205b305c43.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T11:52:46.422Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material\_development.
Observation: f823757bc4f022cc21d01bd50b1aae2e45ef8987bfe15cdb1cf4291cb7282094. Source text hash: 69bec8217ce24353687b5a5a38f8a8ea594d6acb700d6d0130f281945c5b1c1f.
### uncertain — 2026-11-09T11:52:46.422Z — anthropic/claude-opus-5.5
Publication: 4c72f909-f14d-4673-8791-25205b305c43
attribution — pass: The reading correctly attributes the arguments, benchmark design and results to the AmbiHTMLBench authors, and identifies the source as an arXiv cs.AI paper. It does not present source claims as established facts or as Escape Meridian's opinion.
> Authors:Boyu Niu, Yingjie Xiong, Shurui Li, Linhan Pang, Yuntong Zhang, Han Wang, Hao Wu, Kai Zuo, Xu Tang, Xuanhe Zhou, Fan Wu
summary — uncertain: The summary is faithful, but it leaves out the authors' central reason for preferring HTML: these documents need representations that stay editable, inspectable and reusable. Without that, a general reader learns what the benchmark tests but not why the shift matters. It also never says in plain words what document parsing is, for example turning page images or PDFs into structured, machine-usable text. Smallest repair: add one sentence with the editable/inspectable/reusable rationale and a short plain gloss of document parsing. Terms such as Markdown, executable HTML and LLM judges should get term-library tooltips.
> HTML is advantageous for heterogeneous and layout-sensitive documents whose representations must remain editable, inspectable, and reusable
date — pass: The originalPublished date of 2026-11-04 matches the v1 submission date on arXiv. The feed date of Nov 5 is later and was correctly not used.
> \[Submitted on 4 Nov 2026\]
support — pass: Each claim matches its excerpt. The phrase 'can lose' fairly renders 'does not fully preserve.' The divergence between the objective and subjective winners, and the small fine-tuned model result, are stated as the authors' own findings. The limitations and the question about document-type coverage follow from the abstract and are not leading. No benefits or costs are invented.
> Across ten primary multimodal systems, the best objective score is 0.8092, while the subjective winner is different
media — pass: The selected media is the verified, direct arXiv abstract page for this paper, which is the most direct way to reach the source.
## Recorded references
Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter.
No public references recorded here yet.
[Reference data (JSON)](/readings/f07b0b7ee024031788fefcb5b4cb445d4ae459bae23e410add825c9d00d93dc8/references.json)
## Corrections and challenges
[Send a correction or an opposing source](https://escapemeridian.com/corrections/)
[JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-ambihtmlbench-tests-html-document-reconstruction-f07b0b7e.json)