{"id":"d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387","title":"The authors introduce a benchmark for context-based Word editing","argument":"The authors introduce WordInferBench to test a gap they say existing Word-editing benchmarks leave unmeasured: whether agents can infer formatting changes from a document, rather than follow instructions that spell out each change. Each of 280 base editing instances has descriptive, referential and inferential instruction conditions. In the inferential condition, an agent must use an in-document exemplar—a matching example elsewhere in the document—to determine the target formatting. The authors say the instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes. Across six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported task-level pass rate: 62.9% on descriptive variants and 40.7% on inferential variants. Escape Meridian’s reading: on this benchmark, success with explicit directions does not carry over as reliably when the needed formatting must be inferred from context. That distinction matters for editing tasks in which users expect consistency without listing every attribute. The evidence is limited to the benchmark and systems evaluated; the abstract does not establish how these results translate to editing work beyond those test instances.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results concern the benchmark’s constructed instances and six evaluated coding-agent systems; the abstract does not establish how they generalize to editing work beyond those tests. The inferential instances are constructed so the target formatting is recoverable from an in-document exemplar, which bounds what the benchmark tests.","speaker":{"name":"Ding, Jiayu, Huang, Yupan, Park, Jinyoung, Jia, Yilin, Wu, Wenshan, Lv, Tengchao, Huang, Shaohan, Zhao, Yuzhong, Zhou, Xiangyang, Ge, Tao, Mao, Sun, Wang, Xun, Jiao, Huitian, Chen, Si-Qing, Cui, Lei, Zheng, Nanning, Wei, Furu","roleAtSource":"Article author"},"source":{"title":"WordInferBench: Can Agents Infer How to Edit from Word Document Context?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.15189","publishedAt":"2026-11-11","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce a benchmark for evaluating whether agents can infer formatting changes from document context, a capability they say existing Word-editing benchmarks do not evaluate.","excerpt":"They do not evaluate agents' ability to infer the appropriate attributes from document context","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"Each of the 280 base editing instances is paired with descriptive, referential and inferential instruction conditions.","excerpt":"a benchmark comprising 280 base document-editing instances, each paired with three instruction conditions: descriptive","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"The instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","excerpt":"derived from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"Among six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported pass rate, with a lower rate on inferential than descriptive variants.","excerpt":"the best-performing evaluated system, Claude Code with Opus 4.6, achieves a 62.9% task-level pass rate on descriptive variants but only 40.7% on inferential variants","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"The result suggests that, on this benchmark, performance with explicit editing directions may not carry over as reliably when agents must infer changes from context.","excerpt":"indicating that current systems complete tasks less reliably when the required formatting changes must be determined from document context.","url":"https://arxiv.org/abs/2611.15189","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.15189","checkedAt":"2026-11-13T12:32:09.022Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the other five evaluated systems compare on the difference between descriptive and inferential variants?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The authors introduce a benchmark for context-based Word editing","summary":"The authors introduce WordInferBench to test a gap they say existing Word-editing benchmarks leave unmeasured: whether agents can infer formatting changes from a document, rather than follow instructions that spell out each change. Each of 280 base editing instances has descriptive, referential and inferential instruction conditions. In the inferential condition, an agent must use an in-document exemplar—a matching example elsewhere in the document—to determine the target formatting. The authors say the instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes. Across six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported task-level pass rate: 62.9% on descriptive variants and 40.7% on inferential variants. Escape Meridian’s reading: on this benchmark, success with explicit directions does not carry over as reliably when the needed formatting must be inferred from context. That distinction matters for editing tasks in which users expect consistency without listing every attribute. The evidence is limited to the benchmark and systems evaluated; the abstract does not establish how these results translate to editing work beyond those test instances.","question":"How do the other five evaluated systems compare on the difference between descriptive and inferential variants?","claims":[{"text":"The authors introduce a benchmark for evaluating whether agents can infer formatting changes from document context, a capability they say existing Word-editing benchmarks do not evaluate.","excerpt":"They do not evaluate agents' ability to infer the appropriate attributes from document context","support":"source-stated"},{"text":"Each of the 280 base editing instances is paired with descriptive, referential and inferential instruction conditions.","excerpt":"a benchmark comprising 280 base document-editing instances, each paired with three instruction conditions: descriptive","support":"source-stated"},{"text":"The instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","excerpt":"derived from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","support":"source-stated"},{"text":"Among six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported pass rate, with a lower rate on inferential than descriptive variants.","excerpt":"the best-performing evaluated system, Claude Code with Opus 4.6, achieves a 62.9% task-level pass rate on descriptive variants but only 40.7% on inferential variants","support":"source-stated"},{"text":"The result suggests that, on this benchmark, performance with explicit editing directions may not carry over as reliably when agents must infer changes from context.","excerpt":"indicating that current systems complete tasks less reliably when the required formatting changes must be determined from document context.","support":"interpretation"}],"limitations":["The reported results concern the benchmark’s constructed instances and six evaluated coding-agent systems; the abstract does not establish how they generalize to editing work beyond those tests.","The inferential instances are constructed so the target formatting is recoverable from an in-document exemplar, which bounds what the benchmark tests."],"mediaId":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","correctionReason":null,"id":"d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387","publicationId":"8111c9fa-2f62-43b3-8c28-660da7bd90a0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.15189","sourceTitle":"WordInferBench: Can Agents Infer How to Edit from Word Document Context?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-11","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:39:49.163Z","createdAt":"2026-11-13T12:01:37.537Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","kind":"article","url":"https://arxiv.org/abs/2611.15189","sourceUrl":"https://arxiv.org/abs/2611.15189","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T11:47:56.223Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.15189","checkedAt":"2026-11-13T12:32:09.022Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","confidence":0.56,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e70825d1bb196db8733e2e65e512d60a8f0ad5f60b5988d8dfb00efef18ea24d","decidedAt":"2026-11-13T11:47:57.081Z"},"provenance":{"textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observationId":"30933e722ae30d2907f2336dba391d0c1e91d2262b10bc0146f96f9ddc4cf5be","retrievedAt":"2026-11-13T11:47:56.131Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"4e6f018c-0490-4e6e-895d-001e23d1d4d9"},"reviewer":{"model":"gpt-6-luna","runId":"8911f25a-9ab8-4b37-88de-a66ff9610e55"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T12:01:37.537Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ding, Jiayu","url":null,"kind":"unknown"},{"name":"Huang, Yupan","url":null,"kind":"unknown"},{"name":"Park, Jinyoung","url":null,"kind":"unknown"},{"name":"Jia, Yilin","url":null,"kind":"unknown"},{"name":"Wu, Wenshan","url":null,"kind":"unknown"},{"name":"Lv, Tengchao","url":null,"kind":"unknown"},{"name":"Huang, Shaohan","url":null,"kind":"unknown"},{"name":"Zhao, Yuzhong","url":null,"kind":"unknown"},{"name":"Zhou, Xiangyang","url":null,"kind":"unknown"},{"name":"Ge, Tao","url":null,"kind":"unknown"},{"name":"Mao, Sun","url":null,"kind":"unknown"},{"name":"Wang, Xun","url":null,"kind":"unknown"},{"name":"Jiao, Huitian","url":null,"kind":"unknown"},{"name":"Chen, Si-Qing","url":null,"kind":"unknown"},{"name":"Cui, Lei","url":null,"kind":"unknown"},{"name":"Zheng, Nanning","url":null,"kind":"unknown"},{"name":"Wei, Furu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ding, Jiayu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ding, Jiayu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Huang, Yupan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yupan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Park, Jinyoung","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Jinyoung","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Jia, Yilin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jia, Yilin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wu, Wenshan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wu, Wenshan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Lv, Tengchao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lv, Tengchao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Huang, Shaohan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Shaohan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zhao, Yuzhong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Yuzhong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zhou, Xiangyang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Xiangyang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Ge, Tao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ge, Tao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Mao, Sun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mao, Sun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wang, Xun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Xun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Jiao, Huitian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiao, Huitian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:12","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Chen, Si-Qing","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Si-Qing","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:13","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Cui, Lei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cui, Lei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:14","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zheng, Nanning","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zheng, Nanning","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:15","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wei, Furu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wei, Furu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:16","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}}],"participationCoverage":{"total":17,"returned":17,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.15189","snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z","basis":"publisher-page-metadata","sourceLinks":55,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387/source"}},"canonicalUrl":"https://escapemeridian.com/readings/the-authors-introduce-a-benchmark-for-context-based-word-editing-d5854e37","formats":{"html":"/readings/the-authors-introduce-a-benchmark-for-context-based-word-editing-d5854e37","markdown":"/readings/the-authors-introduce-a-benchmark-for-context-based-word-editing-d5854e37.md","json":"/readings/the-authors-introduce-a-benchmark-for-context-based-word-editing-d5854e37.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387","revision":"8111c9fa-2f62-43b3-8c28-660da7bd90a0","revisionKind":"publication-id","title":"The authors introduce a benchmark for context-based Word editing","url":"https://escapemeridian.com/readings/the-authors-introduce-a-benchmark-for-context-based-word-editing-d5854e37"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.15189","revision":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","revisionKind":"sha256-source-text","title":"WordInferBench: Can Agents Infer How to Edit from Word Document Context?","url":"https://arxiv.org/abs/2611.15189"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387","title":"The authors introduce a benchmark for context-based Word editing","argument":"The authors introduce WordInferBench to test a gap they say existing Word-editing benchmarks leave unmeasured: whether agents can infer formatting changes from a document, rather than follow instructions that spell out each change. Each of 280 base editing instances has descriptive, referential and inferential instruction conditions. In the inferential condition, an agent must use an in-document exemplar—a matching example elsewhere in the document—to determine the target formatting. The authors say the instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes. Across six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported task-level pass rate: 62.9% on descriptive variants and 40.7% on inferential variants. Escape Meridian’s reading: on this benchmark, success with explicit directions does not carry over as reliably when the needed formatting must be inferred from context. That distinction matters for editing tasks in which users expect consistency without listing every attribute. The evidence is limited to the benchmark and systems evaluated; the abstract does not establish how these results translate to editing work beyond those test instances.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results concern the benchmark’s constructed instances and six evaluated coding-agent systems; the abstract does not establish how they generalize to editing work beyond those tests. The inferential instances are constructed so the target formatting is recoverable from an in-document exemplar, which bounds what the benchmark tests.","speaker":{"name":"Ding, Jiayu, Huang, Yupan, Park, Jinyoung, Jia, Yilin, Wu, Wenshan, Lv, Tengchao, Huang, Shaohan, Zhao, Yuzhong, Zhou, Xiangyang, Ge, Tao, Mao, Sun, Wang, Xun, Jiao, Huitian, Chen, Si-Qing, Cui, Lei, Zheng, Nanning, Wei, Furu","roleAtSource":"Article author"},"source":{"title":"WordInferBench: Can Agents Infer How to Edit from Word Document Context?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.15189","publishedAt":"2026-11-11","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce a benchmark for evaluating whether agents can infer formatting changes from document context, a capability they say existing Word-editing benchmarks do not evaluate.","excerpt":"They do not evaluate agents' ability to infer the appropriate attributes from document context","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"Each of the 280 base editing instances is paired with descriptive, referential and inferential instruction conditions.","excerpt":"a benchmark comprising 280 base document-editing instances, each paired with three instruction conditions: descriptive","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"The instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","excerpt":"derived from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"Among six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported pass rate, with a lower rate on inferential than descriptive variants.","excerpt":"the best-performing evaluated system, Claude Code with Opus 4.6, achieves a 62.9% task-level pass rate on descriptive variants but only 40.7% on inferential variants","url":"https://arxiv.org/abs/2611.15189","relationship":"Source-stated"},{"text":"The result suggests that, on this benchmark, performance with explicit editing directions may not carry over as reliably when agents must infer changes from context.","excerpt":"indicating that current systems complete tasks less reliably when the required formatting changes must be determined from document context.","url":"https://arxiv.org/abs/2611.15189","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.15189","checkedAt":"2026-11-13T12:32:09.022Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the other five evaluated systems compare on the difference between descriptive and inferential variants?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The authors introduce a benchmark for context-based Word editing","summary":"The authors introduce WordInferBench to test a gap they say existing Word-editing benchmarks leave unmeasured: whether agents can infer formatting changes from a document, rather than follow instructions that spell out each change. Each of 280 base editing instances has descriptive, referential and inferential instruction conditions. In the inferential condition, an agent must use an in-document exemplar—a matching example elsewhere in the document—to determine the target formatting. The authors say the instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes. Across six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported task-level pass rate: 62.9% on descriptive variants and 40.7% on inferential variants. Escape Meridian’s reading: on this benchmark, success with explicit directions does not carry over as reliably when the needed formatting must be inferred from context. That distinction matters for editing tasks in which users expect consistency without listing every attribute. The evidence is limited to the benchmark and systems evaluated; the abstract does not establish how these results translate to editing work beyond those test instances.","question":"How do the other five evaluated systems compare on the difference between descriptive and inferential variants?","claims":[{"text":"The authors introduce a benchmark for evaluating whether agents can infer formatting changes from document context, a capability they say existing Word-editing benchmarks do not evaluate.","excerpt":"They do not evaluate agents' ability to infer the appropriate attributes from document context","support":"source-stated"},{"text":"Each of the 280 base editing instances is paired with descriptive, referential and inferential instruction conditions.","excerpt":"a benchmark comprising 280 base document-editing instances, each paired with three instruction conditions: descriptive","support":"source-stated"},{"text":"The instances come from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","excerpt":"derived from real Word documents collected from Common Crawl and cover 13 object types and 81 attributes.","support":"source-stated"},{"text":"Among six evaluated coding-agent systems, Claude Code with Opus 4.6 has the highest reported pass rate, with a lower rate on inferential than descriptive variants.","excerpt":"the best-performing evaluated system, Claude Code with Opus 4.6, achieves a 62.9% task-level pass rate on descriptive variants but only 40.7% on inferential variants","support":"source-stated"},{"text":"The result suggests that, on this benchmark, performance with explicit editing directions may not carry over as reliably when agents must infer changes from context.","excerpt":"indicating that current systems complete tasks less reliably when the required formatting changes must be determined from document context.","support":"interpretation"}],"limitations":["The reported results concern the benchmark’s constructed instances and six evaluated coding-agent systems; the abstract does not establish how they generalize to editing work beyond those tests.","The inferential instances are constructed so the target formatting is recoverable from an in-document exemplar, which bounds what the benchmark tests."],"mediaId":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","correctionReason":null,"id":"d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387","publicationId":"8111c9fa-2f62-43b3-8c28-660da7bd90a0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.15189","sourceTitle":"WordInferBench: Can Agents Infer How to Edit from Word Document Context?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-11","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:39:49.163Z","createdAt":"2026-11-13T12:01:37.537Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","kind":"article","url":"https://arxiv.org/abs/2611.15189","sourceUrl":"https://arxiv.org/abs/2611.15189","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T11:47:56.223Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.15189","checkedAt":"2026-11-13T12:32:09.022Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"1134bdbc357ce8aea73caacabe605b68e45c213ead172061d3cab9288acfd573","confidence":0.56,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e70825d1bb196db8733e2e65e512d60a8f0ad5f60b5988d8dfb00efef18ea24d","decidedAt":"2026-11-13T11:47:57.081Z"},"provenance":{"textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observationId":"30933e722ae30d2907f2336dba391d0c1e91d2262b10bc0146f96f9ddc4cf5be","retrievedAt":"2026-11-13T11:47:56.131Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"4e6f018c-0490-4e6e-895d-001e23d1d4d9"},"reviewer":{"model":"gpt-6-luna","runId":"8911f25a-9ab8-4b37-88de-a66ff9610e55"}},"audit":{"status":"passed","reviewedAt":"2026-11-13T12:01:37.537Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ding, Jiayu","url":null,"kind":"unknown"},{"name":"Huang, Yupan","url":null,"kind":"unknown"},{"name":"Park, Jinyoung","url":null,"kind":"unknown"},{"name":"Jia, Yilin","url":null,"kind":"unknown"},{"name":"Wu, Wenshan","url":null,"kind":"unknown"},{"name":"Lv, Tengchao","url":null,"kind":"unknown"},{"name":"Huang, Shaohan","url":null,"kind":"unknown"},{"name":"Zhao, Yuzhong","url":null,"kind":"unknown"},{"name":"Zhou, Xiangyang","url":null,"kind":"unknown"},{"name":"Ge, Tao","url":null,"kind":"unknown"},{"name":"Mao, Sun","url":null,"kind":"unknown"},{"name":"Wang, Xun","url":null,"kind":"unknown"},{"name":"Jiao, Huitian","url":null,"kind":"unknown"},{"name":"Chen, Si-Qing","url":null,"kind":"unknown"},{"name":"Cui, Lei","url":null,"kind":"unknown"},{"name":"Zheng, Nanning","url":null,"kind":"unknown"},{"name":"Wei, Furu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ding, Jiayu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ding, Jiayu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Huang, Yupan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yupan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Park, Jinyoung","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Park, Jinyoung","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Jia, Yilin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jia, Yilin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wu, Wenshan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wu, Wenshan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Lv, Tengchao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lv, Tengchao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Huang, Shaohan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Shaohan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zhao, Yuzhong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Yuzhong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zhou, Xiangyang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Xiangyang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Ge, Tao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ge, Tao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Mao, Sun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mao, Sun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wang, Xun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Xun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Jiao, Huitian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiao, Huitian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:12","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Chen, Si-Qing","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Si-Qing","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:13","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Cui, Lei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cui, Lei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:14","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Zheng, Nanning","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zheng, Nanning","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:15","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}},{"actor":{"name":"Wei, Furu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wei, Furu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.15189","locator":"head/meta[name=author|citation_author]"},"assertionId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0:participation:16","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:32:09.022Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","sourceUrl":"https://arxiv.org/abs/2611.15189","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z"}}],"participationCoverage":{"total":17,"returned":17,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.15189","snapshotId":"8c0ab1c45c5ab58ee11594716590b0af68a109358307e14a9ab79999e1a7cab0","contentSha256":"3b56af2ebf80dfda7a79d021a976f2012a612c9058509ad530698ae39dea6192","textHash":"fe6454854841ab2506be9b1a8cf16fd99c01d4cf0adf42d2fb6613f0a799ff08","observedAt":"2026-11-13T12:32:09.022Z","basis":"publisher-page-metadata","sourceLinks":55,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d5854e37c3db9fec9072a6ccf1d3340d40058130acd599bdab60dc6950d33387/source"}}}],"audits":[{"publicationId":"8111c9fa-2f62-43b3-8c28-660da7bd90a0","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the benchmark, its motivating gap, the dataset details and the results to the paper's authors. It labels the generalization point as Escape Meridian's reading.","excerpt":"We introduce WordInferBench, a benchmark comprising 280 base document-editing instances"},{"dimension":"summary","status":"pass","explanation":"The reading leads with the authors' new benchmark and the gap they claim it fills. It explains the in-document exemplar in plain language and reports the headline 62.9% vs 40.7% result with its scope. The title and question are accurate and non-leading; the abstract does not report the other five systems' scores, so that question is genuinely open. Referential and descriptive conditions are only named, but they are not central to the finding. A Common Crawl tooltip could help readers but is not required.","excerpt":"inferential (the agent must examine document context to infer what attributes to apply)"},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-11 matches the arXiv v1 submission date. The later feed date of Nov 13 was correctly not used.","excerpt":"[Submitted on 11 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All factual claims match the abstract: 280 instances, three instruction conditions, Common Crawl sourcing, 13 object types, 81 attributes, six systems and the best system's two pass rates. The interpretation is labeled and grounded in the authors' own conclusion, and is narrowed to this benchmark. The limitations correctly note the exemplar-recoverable construction. No benefits or costs beyond the source are asserted.","excerpt":"indicating that current systems complete tasks less reliably when the required formatting changes must be determined from document context."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the easiest route to the original source.","excerpt":null}],"createdAt":"2026-11-13T12:01:37.537Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}