{"id":"2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f","title":"arXiv eess.SY: Evaluating Rollout-Verified Reinforcement Fine-Tuning for Building Control","argument":"Takumi Shioda, Kohei Terashima and Tatsuo Nagai investigate whether reasoning models can control multi-zone variable-air-volume systems without building-specific training, and whether rollout-verified reinforcement fine-tuning can improve a smaller model. In a physics-based four-zone emulator, GPT-5 used less electricity than a Guideline 36-based baseline, but also used less outdoor air and had lower CO₂ compliance. A trained reinforcement learning controller reduced electricity use while improving temperature and CO₂ compliance. Yet a critic whose estimates closely tracked rollout returns often failed to rank actions correctly within the same state. Fine-tuning gpt-oss-20b with rollout returns produced no sustained improvement in sampled-action returns or closed-loop performance, and the authors found unreliable next-state predictions before and after fine-tuning. The results show that energy use, air quality and temperature can move in different directions, and that aggregate agreement between a verifier and rollout returns did not ensure useful action choices. The study used an emulator over five summer days; whether the results carry over to real buildings remains unknown. The authors propose testing supervised fine-tuning on next-state prediction before subsequent rollout-verified reinforcement fine-tuning.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evaluation was conducted in a physics-based four-zone emulator over five summer days; the abstract does not report tests in real buildings. The abstract does not specify how the observed energy, outdoor-air, temperature and CO₂ outcomes would transfer to other buildings or operating conditions. The abstract describes one 200-step fine-tuning run, so it does not establish whether other runs or training setups would produce different results.","speaker":{"name":"Shioda, Takumi, Terashima, Kohei, Nagai, Tatsuo","roleAtSource":"Article author"},"source":{"title":"Evaluating Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone Variable-Air-Volume Control","publisher":"arXiv eess.SY","format":"Article","url":"https://arxiv.org/abs/2607.27914","publishedAt":"2026-07-30","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors evaluate model-based control and fine-tuning in a physics-based four-zone emulator over five summer days.","excerpt":"Five controllers were evaluated over five summer days in a physics-based four-zone emulator.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"GPT-5 used less electricity than the baseline but also used less outdoor air and had lower CO₂ compliance.","excerpt":"GPT-5 used 6.8-7.4% less electricity than a Guideline 36-based baseline, but used less outdoor air and had lower CO$_2$ compliance.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"A trained reinforcement learning controller used less electricity while improving temperature and CO₂ compliance relative to the baseline.","excerpt":"A trained reinforcement learning controller used 4.5% less electricity than the baseline while improving temperature and CO$_2$ compliance.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The critic's high correlation with rollout returns did not reliably identify the best action within a state.","excerpt":"Across 470 candidates, their correlation was 0.9995, yet the critic selected the best action in only 7 of 30 states.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The fine-tuning run did not improve sampled-action returns or closed-loop performance, and next-state predictions remained unreliable.","excerpt":"One 200-step run produced no sustained improvement in the returns of sampled actions and no improvement in closed-loop performance. Analysis of the model's reasoning traces and quantitative tests showed that its next-state predictions of temperature and CO$_2$ were unreliable both before and after","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The authors identify supervised fine-tuning on next-state prediction as a direction to test before subsequent rollout-verified reinforcement fine-tuning.","excerpt":"these findings motivate testing whether supervised fine-tuning on next-state prediction improves subsequent rollout-verified reinforcement fine-tuning.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2607.27914","checkedAt":"2026-11-10T11:44:09.164Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would supervised fine-tuning on next-state prediction improve subsequent rollout-verified reinforcement fine-tuning, as the authors propose testing?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv eess.SY: Evaluating Rollout-Verified Reinforcement Fine-Tuning for Building Control","summary":"Takumi Shioda, Kohei Terashima and Tatsuo Nagai investigate whether reasoning models can control multi-zone variable-air-volume systems without building-specific training, and whether rollout-verified reinforcement fine-tuning can improve a smaller model. In a physics-based four-zone emulator, GPT-5 used less electricity than a Guideline 36-based baseline, but also used less outdoor air and had lower CO₂ compliance. A trained reinforcement learning controller reduced electricity use while improving temperature and CO₂ compliance. Yet a critic whose estimates closely tracked rollout returns often failed to rank actions correctly within the same state. Fine-tuning gpt-oss-20b with rollout returns produced no sustained improvement in sampled-action returns or closed-loop performance, and the authors found unreliable next-state predictions before and after fine-tuning. The results show that energy use, air quality and temperature can move in different directions, and that aggregate agreement between a verifier and rollout returns did not ensure useful action choices. The study used an emulator over five summer days; whether the results carry over to real buildings remains unknown. The authors propose testing supervised fine-tuning on next-state prediction before subsequent rollout-verified reinforcement fine-tuning.","question":"Would supervised fine-tuning on next-state prediction improve subsequent rollout-verified reinforcement fine-tuning, as the authors propose testing?","claims":[{"text":"The authors evaluate model-based control and fine-tuning in a physics-based four-zone emulator over five summer days.","excerpt":"Five controllers were evaluated over five summer days in a physics-based four-zone emulator.","support":"source-stated"},{"text":"GPT-5 used less electricity than the baseline but also used less outdoor air and had lower CO₂ compliance.","excerpt":"GPT-5 used 6.8-7.4% less electricity than a Guideline 36-based baseline, but used less outdoor air and had lower CO$_2$ compliance.","support":"source-stated"},{"text":"A trained reinforcement learning controller used less electricity while improving temperature and CO₂ compliance relative to the baseline.","excerpt":"A trained reinforcement learning controller used 4.5% less electricity than the baseline while improving temperature and CO$_2$ compliance.","support":"source-stated"},{"text":"The critic's high correlation with rollout returns did not reliably identify the best action within a state.","excerpt":"Across 470 candidates, their correlation was 0.9995, yet the critic selected the best action in only 7 of 30 states.","support":"source-stated"},{"text":"The fine-tuning run did not improve sampled-action returns or closed-loop performance, and next-state predictions remained unreliable.","excerpt":"One 200-step run produced no sustained improvement in the returns of sampled actions and no improvement in closed-loop performance. Analysis of the model's reasoning traces and quantitative tests showed that its next-state predictions of temperature and CO$_2$ were unreliable both before and after","support":"source-stated"},{"text":"The authors identify supervised fine-tuning on next-state prediction as a direction to test before subsequent rollout-verified reinforcement fine-tuning.","excerpt":"these findings motivate testing whether supervised fine-tuning on next-state prediction improves subsequent rollout-verified reinforcement fine-tuning.","support":"source-stated"}],"limitations":["The evaluation was conducted in a physics-based four-zone emulator over five summer days; the abstract does not report tests in real buildings.","The abstract does not specify how the observed energy, outdoor-air, temperature and CO₂ outcomes would transfer to other buildings or operating conditions.","The abstract describes one 200-step fine-tuning run, so it does not establish whether other runs or training setups would produce different results."],"mediaId":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","correctionReason":null,"id":"2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f","publicationId":"40468c9f-c9ca-41cd-8534-9fb73360ca89","version":1,"sourceUrl":"https://arxiv.org/abs/2607.27914","sourceTitle":"Evaluating Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone Variable-Air-Volume Control","publisher":"arXiv eess.SY","publishedAt":null,"originalPublished":{"value":"2026-07-30","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-02T05:06:47.910Z","createdAt":"2026-11-10T10:40:43.849Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","kind":"article","url":"https://arxiv.org/abs/2607.27914","sourceUrl":"https://arxiv.org/abs/2607.27914","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-02T07:46:56.527Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2607.27914","checkedAt":"2026-11-10T11:44:09.164Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","confidence":0.8200000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0f331842ab99296e0ab8d3457423e76280469f69d0ad849115f3214b3e5d959a","decidedAt":"2026-11-02T07:47:11.712Z"},"provenance":{"textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observationId":"c722943255a532e3bc2500196f873ed5feddbbf6b6fe40b49627e0a0f22f12c4","retrievedAt":"2026-11-02T07:46:56.225Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"7f0aee66-69a4-492d-88f5-9c776635cc5c"},"reviewer":{"model":"gpt-6-luna","runId":"ef496f56-15c6-46a4-8717-2edef00fde4d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T10:40:43.849Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shioda, Takumi","url":null,"kind":"unknown"},{"name":"Terashima, Kohei","url":null,"kind":"unknown"},{"name":"Nagai, Tatsuo","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shioda, Takumi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shioda, Takumi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}},{"actor":{"name":"Terashima, Kohei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Terashima, Kohei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}},{"actor":{"name":"Nagai, Tatsuo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nagai, Tatsuo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2607.27914","snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-eess-sy-evaluating-rollout-verified-reinforcement-fine-2a49d9a6","formats":{"html":"/readings/arxiv-eess-sy-evaluating-rollout-verified-reinforcement-fine-2a49d9a6","markdown":"/readings/arxiv-eess-sy-evaluating-rollout-verified-reinforcement-fine-2a49d9a6.md","json":"/readings/arxiv-eess-sy-evaluating-rollout-verified-reinforcement-fine-2a49d9a6.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"},{"id":"term-reasoning-model","name":"Reasoning model","explanation":"A language model trained to work through a problem in written steps before it answers.","referenceUrl":"https://en.wikipedia.org/wiki/Reasoning_model"},{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f","revision":"40468c9f-c9ca-41cd-8534-9fb73360ca89","revisionKind":"publication-id","title":"arXiv eess.SY: Evaluating Rollout-Verified Reinforcement Fine-Tuning for Building Control","url":"https://escapemeridian.com/readings/arxiv-eess-sy-evaluating-rollout-verified-reinforcement-fine-2a49d9a6"},"source":{"type":"source","id":"https://arxiv.org/abs/2607.27914","revision":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","revisionKind":"sha256-source-text","title":"Evaluating Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone Variable-Air-Volume Control","url":"https://arxiv.org/abs/2607.27914"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f","title":"arXiv eess.SY: Evaluating Rollout-Verified Reinforcement Fine-Tuning for Building Control","argument":"Takumi Shioda, Kohei Terashima and Tatsuo Nagai investigate whether reasoning models can control multi-zone variable-air-volume systems without building-specific training, and whether rollout-verified reinforcement fine-tuning can improve a smaller model. In a physics-based four-zone emulator, GPT-5 used less electricity than a Guideline 36-based baseline, but also used less outdoor air and had lower CO₂ compliance. A trained reinforcement learning controller reduced electricity use while improving temperature and CO₂ compliance. Yet a critic whose estimates closely tracked rollout returns often failed to rank actions correctly within the same state. Fine-tuning gpt-oss-20b with rollout returns produced no sustained improvement in sampled-action returns or closed-loop performance, and the authors found unreliable next-state predictions before and after fine-tuning. The results show that energy use, air quality and temperature can move in different directions, and that aggregate agreement between a verifier and rollout returns did not ensure useful action choices. The study used an emulator over five summer days; whether the results carry over to real buildings remains unknown. The authors propose testing supervised fine-tuning on next-state prediction before subsequent rollout-verified reinforcement fine-tuning.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evaluation was conducted in a physics-based four-zone emulator over five summer days; the abstract does not report tests in real buildings. The abstract does not specify how the observed energy, outdoor-air, temperature and CO₂ outcomes would transfer to other buildings or operating conditions. The abstract describes one 200-step fine-tuning run, so it does not establish whether other runs or training setups would produce different results.","speaker":{"name":"Shioda, Takumi, Terashima, Kohei, Nagai, Tatsuo","roleAtSource":"Article author"},"source":{"title":"Evaluating Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone Variable-Air-Volume Control","publisher":"arXiv eess.SY","format":"Article","url":"https://arxiv.org/abs/2607.27914","publishedAt":"2026-07-30","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors evaluate model-based control and fine-tuning in a physics-based four-zone emulator over five summer days.","excerpt":"Five controllers were evaluated over five summer days in a physics-based four-zone emulator.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"GPT-5 used less electricity than the baseline but also used less outdoor air and had lower CO₂ compliance.","excerpt":"GPT-5 used 6.8-7.4% less electricity than a Guideline 36-based baseline, but used less outdoor air and had lower CO$_2$ compliance.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"A trained reinforcement learning controller used less electricity while improving temperature and CO₂ compliance relative to the baseline.","excerpt":"A trained reinforcement learning controller used 4.5% less electricity than the baseline while improving temperature and CO$_2$ compliance.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The critic's high correlation with rollout returns did not reliably identify the best action within a state.","excerpt":"Across 470 candidates, their correlation was 0.9995, yet the critic selected the best action in only 7 of 30 states.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The fine-tuning run did not improve sampled-action returns or closed-loop performance, and next-state predictions remained unreliable.","excerpt":"One 200-step run produced no sustained improvement in the returns of sampled actions and no improvement in closed-loop performance. Analysis of the model's reasoning traces and quantitative tests showed that its next-state predictions of temperature and CO$_2$ were unreliable both before and after","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"},{"text":"The authors identify supervised fine-tuning on next-state prediction as a direction to test before subsequent rollout-verified reinforcement fine-tuning.","excerpt":"these findings motivate testing whether supervised fine-tuning on next-state prediction improves subsequent rollout-verified reinforcement fine-tuning.","url":"https://arxiv.org/abs/2607.27914","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2607.27914","checkedAt":"2026-11-10T11:44:09.164Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would supervised fine-tuning on next-state prediction improve subsequent rollout-verified reinforcement fine-tuning, as the authors propose testing?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv eess.SY: Evaluating Rollout-Verified Reinforcement Fine-Tuning for Building Control","summary":"Takumi Shioda, Kohei Terashima and Tatsuo Nagai investigate whether reasoning models can control multi-zone variable-air-volume systems without building-specific training, and whether rollout-verified reinforcement fine-tuning can improve a smaller model. In a physics-based four-zone emulator, GPT-5 used less electricity than a Guideline 36-based baseline, but also used less outdoor air and had lower CO₂ compliance. A trained reinforcement learning controller reduced electricity use while improving temperature and CO₂ compliance. Yet a critic whose estimates closely tracked rollout returns often failed to rank actions correctly within the same state. Fine-tuning gpt-oss-20b with rollout returns produced no sustained improvement in sampled-action returns or closed-loop performance, and the authors found unreliable next-state predictions before and after fine-tuning. The results show that energy use, air quality and temperature can move in different directions, and that aggregate agreement between a verifier and rollout returns did not ensure useful action choices. The study used an emulator over five summer days; whether the results carry over to real buildings remains unknown. The authors propose testing supervised fine-tuning on next-state prediction before subsequent rollout-verified reinforcement fine-tuning.","question":"Would supervised fine-tuning on next-state prediction improve subsequent rollout-verified reinforcement fine-tuning, as the authors propose testing?","claims":[{"text":"The authors evaluate model-based control and fine-tuning in a physics-based four-zone emulator over five summer days.","excerpt":"Five controllers were evaluated over five summer days in a physics-based four-zone emulator.","support":"source-stated"},{"text":"GPT-5 used less electricity than the baseline but also used less outdoor air and had lower CO₂ compliance.","excerpt":"GPT-5 used 6.8-7.4% less electricity than a Guideline 36-based baseline, but used less outdoor air and had lower CO$_2$ compliance.","support":"source-stated"},{"text":"A trained reinforcement learning controller used less electricity while improving temperature and CO₂ compliance relative to the baseline.","excerpt":"A trained reinforcement learning controller used 4.5% less electricity than the baseline while improving temperature and CO$_2$ compliance.","support":"source-stated"},{"text":"The critic's high correlation with rollout returns did not reliably identify the best action within a state.","excerpt":"Across 470 candidates, their correlation was 0.9995, yet the critic selected the best action in only 7 of 30 states.","support":"source-stated"},{"text":"The fine-tuning run did not improve sampled-action returns or closed-loop performance, and next-state predictions remained unreliable.","excerpt":"One 200-step run produced no sustained improvement in the returns of sampled actions and no improvement in closed-loop performance. Analysis of the model's reasoning traces and quantitative tests showed that its next-state predictions of temperature and CO$_2$ were unreliable both before and after","support":"source-stated"},{"text":"The authors identify supervised fine-tuning on next-state prediction as a direction to test before subsequent rollout-verified reinforcement fine-tuning.","excerpt":"these findings motivate testing whether supervised fine-tuning on next-state prediction improves subsequent rollout-verified reinforcement fine-tuning.","support":"source-stated"}],"limitations":["The evaluation was conducted in a physics-based four-zone emulator over five summer days; the abstract does not report tests in real buildings.","The abstract does not specify how the observed energy, outdoor-air, temperature and CO₂ outcomes would transfer to other buildings or operating conditions.","The abstract describes one 200-step fine-tuning run, so it does not establish whether other runs or training setups would produce different results."],"mediaId":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","correctionReason":null,"id":"2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f","publicationId":"40468c9f-c9ca-41cd-8534-9fb73360ca89","version":1,"sourceUrl":"https://arxiv.org/abs/2607.27914","sourceTitle":"Evaluating Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone Variable-Air-Volume Control","publisher":"arXiv eess.SY","publishedAt":null,"originalPublished":{"value":"2026-07-30","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-02T05:06:47.910Z","createdAt":"2026-11-10T10:40:43.849Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","kind":"article","url":"https://arxiv.org/abs/2607.27914","sourceUrl":"https://arxiv.org/abs/2607.27914","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-02T07:46:56.527Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2607.27914","checkedAt":"2026-11-10T11:44:09.164Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"11d9354f7c00fd932d4d9ceda8d900bb0647ce2a9c2690fb97803dafd7603a9e","confidence":0.8200000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0f331842ab99296e0ab8d3457423e76280469f69d0ad849115f3214b3e5d959a","decidedAt":"2026-11-02T07:47:11.712Z"},"provenance":{"textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observationId":"c722943255a532e3bc2500196f873ed5feddbbf6b6fe40b49627e0a0f22f12c4","retrievedAt":"2026-11-02T07:46:56.225Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"7f0aee66-69a4-492d-88f5-9c776635cc5c"},"reviewer":{"model":"gpt-6-luna","runId":"ef496f56-15c6-46a4-8717-2edef00fde4d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T10:40:43.849Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shioda, Takumi","url":null,"kind":"unknown"},{"name":"Terashima, Kohei","url":null,"kind":"unknown"},{"name":"Nagai, Tatsuo","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shioda, Takumi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shioda, Takumi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}},{"actor":{"name":"Terashima, Kohei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Terashima, Kohei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}},{"actor":{"name":"Nagai, Tatsuo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nagai, Tatsuo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2607.27914","locator":"head/meta[name=author|citation_author]"},"assertionId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T11:44:09.164Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","sourceUrl":"https://arxiv.org/abs/2607.27914","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2607.27914","snapshotId":"ca945bf3271840a73ebc41f0f5e6dda53fbdf99c062d88f1cc8044fceb9796b0","contentSha256":"c24d509144b685bd66434f9ee0177145c86b46c950dce8459e4c3b18cf2f01a5","textHash":"d1eff08c869938785076002b257cdfab51a3f218e3f36ab7133bc55ea553a6db","observedAt":"2026-11-10T11:44:09.164Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/2a49d9a6d667099c491d8c31a67877aa55e0a907ec1d26d62ce6f63a47f75f5f/source"}}}],"audits":[{"publicationId":"40468c9f-c9ca-41cd-8534-9fb73360ca89","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly credits Takumi Shioda, Kohei Terashima and Tatsuo Nagai and keeps the findings framed as their study results. Naming GPT-5 and gpt-oss-20b matches the abstract.","excerpt":"Authors:Takumi Shioda, Kohei Terashima, Tatsuo Nagai"},{"dimension":"summary","status":"uncertain","explanation":"The reading is faithful, but a non-specialist could not follow its core. It never says these are building heating, ventilation and air-conditioning (HVAC) systems, the abstract's own framing. Central terms are unexplained: variable-air-volume, rollout-verified reinforcement fine-tuning, rollout returns, critic, closed-loop, Guideline 36 and next-state prediction. Smallest repair: open with the HVAC energy context. Add term-library tooltips for these terms. State that the critic came from the trained RL controller and was tested as a lower-cost verifier. 'Reasoning models' should be 'a frontier reasoning model'.","excerpt":"To assess this controller's critic as a lower-cost verifier, we compared its estimates with deterministic rollout returns."},{"dimension":"date","status":"pass","explanation":"The displayed original publication date of 2026-07-30 matches the v1 submission date. It is not the 30 Oct 2026 v2 revision or the November feed date.","excerpt":"Submitted on 30 Jul 2026 (v1), last revised 30 Oct 2026 (this version, v2)"},{"dimension":"support","status":"pass","explanation":"The claims match the abstract: the GPT-5 tradeoff, the RL controller's gains, the critic's 0.9995 correlation but only 7 of 30 best-action picks, the failed 200-step fine-tuning run, unreliable next-state predictions and the proposed next test. Two lines are interpretive but grounded. One says energy, air quality and temperature can diverge; the other says aggregate agreement did not ensure good action choices. The stated limitations do not overreach.","excerpt":"High overall correlation did not ensure reliable ranking at the same state."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. That is the most direct way to access the source.","excerpt":null}],"createdAt":"2026-11-10T10:40:43.849Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}