# arXiv: In-Context Black-Box Optimization with Unreliable Feedback [Canonical reading](https://escapemeridian.com/readings/arxiv-in-context-black-box-optimization-with-unreliable-feedback-52254408) Nicolas Samuel Blumer, Julien Martinelli and Samuel Kaski study how an optimizer can use advice that may be useful, biased or misleading while searching for a good candidate. Their feedback-informed in-context black-box optimization (FICBO) method gives a pretrained optimizer both its past observations and auxiliary feedback: inexpensive signals from sources such as experts, simulators, pretrained predictors or heuristics. The authors train a feedback-aware transformer with structured priors covering different relationships between auxiliary feedback and the objective. At test time, it compares observed objective values with those signals to estimate how reliable each source is, then uses that estimate to select queries. The intended advantage is to benefit from informative advice without depending on advice that is weak or misleading. The paper reports experiments on synthetic and real-world tasks and says the method exploits informative feedback while remaining robust to weak or misleading sources. This addresses a tension in optimization: extra guidance can make a search more efficient, but treating that guidance as trustworthy can misdirect it. The authors also investigate how the model perceives sources at test time, as a way to examine its interpretability and decision-making. The arXiv abstract does not give performance measures or details of those investigations, so a Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: May 7, 2026 (2026-05-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-09T06:17:32.888Z. First observed: 2026-11-05T05:06:41.639Z. Retrieved: 2026-11-09T06:10:32.383Z. - [In-Context Black-Box Optimization with Unreliable Feedback](https://arxiv.org/abs/2605.06187) ## Limits The supplied evidence is the arXiv abstract, which does not provide performance measures or details of the experiments and interpretability investigations. ## Open question How well does the method estimate source reliability when auxiliary feedback is biased, input-dependent or misleading? ## Source-stated The authors study a method that uses both optimization history and auxiliary feedback for the current candidate set. > a pretrained optimizer conditions on both the observed history and cheap auxiliary feedback for the current candidate set - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors pretrain a feedback-aware transformer using structured priors for different relationships between auxiliary feedback and the objective. > We introduce structured priors over how auxiliary feedback relates to the objective, and use them to pretrain a feedback-aware transformer - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated At test time, the model compares observed objective values with auxiliary signals to estimate source reliability and guide query selection. > the model estimates source reliability in context by comparing observed objective values with auxiliary signals, improving query selection - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors report that FICBO uses informative feedback while remaining robust to weak or misleading sources on synthetic and real-world tasks. > On synthetic and real-world tasks, FICBO effectively exploits informative feedback while remaining robust to weak or misleading sources. - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors investigate how the model perceives test-time sources, relating this analysis to interpretability and decision-making. > Empirical investigations further illustrate how the model perceives test-time sources, offering insights into its interpretability and decision-making process. - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source and contributor context Blumer, Nicolas Samuel, Martinelli, Julien, Kaski, Samuel · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Interpretability Research into how a model reaches its outputs, often by examining its internal workings. - [Definition reference](https://developers.google.com/machine-learning/glossary#interpretability) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: d14f07fd-e3f4-479f-854b-8e0795d8ef17. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T06:17:32.888Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: c512c9430e0c3fbdb39945958aae69e28b0c7443cdef0b58b4a627a7ecc47360. Source text hash: b9974495b4227871d50eb1a1a38dfede33064942c2acd795499c0df6ccd37893. ## Revision and source-check history ### Version 1 — 2026-11-09T06:17:32.888Z Nicolas Samuel Blumer, Julien Martinelli and Samuel Kaski study how an optimizer can use advice that may be useful, biased or misleading while searching for a good candidate. Their feedback-informed in-context black-box optimization (FICBO) method gives a pretrained optimizer both its past observations and auxiliary feedback: inexpensive signals from sources such as experts, simulators, pretrained predictors or heuristics. The authors train a feedback-aware transformer with structured priors covering different relationships between auxiliary feedback and the objective. At test time, it compares observed objective values with those signals to estimate how reliable each source is, then uses that estimate to select queries. The intended advantage is to benefit from informative advice without depending on advice that is weak or misleading. The paper reports experiments on synthetic and real-world tasks and says the method exploits informative feedback while remaining robust to weak or misleading sources. This addresses a tension in optimization: extra guidance can make a search more efficient, but treating that guidance as trustworthy can misdirect it. The authors also investigate how the model perceives sources at test time, as a way to examine its interpretability and decision-making. The arXiv abstract does not give performance measures or details of those investigations, so a ## Original source arXiv cs.AI · Article Original source date: May 7, 2026 (2026-05-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-09T06:17:32.888Z. First observed: 2026-11-05T05:06:41.639Z. Retrieved: 2026-11-09T06:10:32.383Z. - [In-Context Black-Box Optimization with Unreliable Feedback](https://arxiv.org/abs/2605.06187) ## Limits The supplied evidence is the arXiv abstract, which does not provide performance measures or details of the experiments and interpretability investigations. ## Open question How well does the method estimate source reliability when auxiliary feedback is biased, input-dependent or misleading? ## Source-stated The authors study a method that uses both optimization history and auxiliary feedback for the current candidate set. > a pretrained optimizer conditions on both the observed history and cheap auxiliary feedback for the current candidate set - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors pretrain a feedback-aware transformer using structured priors for different relationships between auxiliary feedback and the objective. > We introduce structured priors over how auxiliary feedback relates to the objective, and use them to pretrain a feedback-aware transformer - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated At test time, the model compares observed objective values with auxiliary signals to estimate source reliability and guide query selection. > the model estimates source reliability in context by comparing observed objective values with auxiliary signals, improving query selection - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors report that FICBO uses informative feedback while remaining robust to weak or misleading sources on synthetic and real-world tasks. > On synthetic and real-world tasks, FICBO effectively exploits informative feedback while remaining robust to weak or misleading sources. - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source-stated The authors investigate how the model perceives test-time sources, relating this analysis to interpretability and decision-making. > Empirical investigations further illustrate how the model perceives test-time sources, offering insights into its interpretability and decision-making process. - [Supporting source](https://arxiv.org/abs/2605.06187) ## Source and contributor context Blumer, Nicolas Samuel, Martinelli, Julien, Kaski, Samuel · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Interpretability Research into how a model reaches its outputs, often by examining its internal workings. - [Definition reference](https://developers.google.com/machine-learning/glossary#interpretability) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: d14f07fd-e3f4-479f-854b-8e0795d8ef17. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T06:17:32.888Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: c512c9430e0c3fbdb39945958aae69e28b0c7443cdef0b58b4a627a7ecc47360. Source text hash: b9974495b4227871d50eb1a1a38dfede33064942c2acd795499c0df6ccd37893. ### uncertain — 2026-11-09T06:17:32.888Z — anthropic/claude-opus-5.5 Publication: d14f07fd-e3f4-479f-854b-8e0795d8ef17 attribution — pass: The reading correctly credits Nicolas Samuel Blumer, Julien Martinelli and Samuel Kaski. It frames FICBO, the priors, the reliability estimation and the results as the authors' own work and reported findings. > Authors:Nicolas Samuel Blumer, Julien Martinelli, Samuel Kaski summary — uncertain: The summary is cut off mid-sentence: its final paragraph ends with 'so a'. The closing statement about what remains unknown is therefore unreadable. Smallest repair: complete or remove that sentence. Separately, the central term 'black-box optimization' and the words 'objective' and 'query' are never explained in plain language, so a non-specialist may not grasp what is being searched for. A brief gloss would help, such as: searching for the best design by testing candidates without knowing the underlying formula. Otherwise the title and question are faithful to the abstract. > Black-box optimization in science and engineering often comes with side information date — pass: originalPublished is 2026-05-07, which matches the v1 submission. The 4 Nov 2026 revision and the November feed date are correctly not used. > \[Submitted on 7 May 2026 (v1), last revised 4 Nov 2026 (this version, v2)\] support — pass: Each claim matches the abstract and stays attributed to the authors. The tension between faster search and misdirection reflects the abstract's own framing. The reading notes that the abstract gives no performance measures and does not convert reported robustness into demonstrated real-world reliability. The question follows naturally from the evidence and does not assume an answer. > Such feedback can accelerate search, but can also be biased, input-dependent, or misleading. media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/52254408492688953d419c0d918e50a6be79d465337e2195c521db92e158f025/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-in-context-black-box-optimization-with-unreliable-feedback-52254408.json)