{"id":"87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003","title":"arXiv cs.AI: When does deep reinforcement learning pay off in HVAC supervisory control?","argument":"Bingnan Zhao, Harshala Gammulle and Tharindu Fernando compare deep reinforcement learning (DRL) agents with tuned rule-based controllers across four small Modelica case studies of HVAC supervisory control in an office building in Brisbane, Australia. They argue that reported gains are hard to interpret without a strong rule-based baseline and a near-optimal reference. In two cases without storage, agents reached the near-optimal reference but improved on a well-chosen rule by only 1.3% for condenser water reset and 0.18% for chilled water reset. With chilled water storage, an agent outperformed both tested rules and adopted midday charging, yet achieved only about 45% of the saving from the perfect-foresight schedule and did little to limit the demand peak. In pre-cooling, a hand-tuned rule remained superior. The authors therefore suggest that HVAC control studies report the margin between the best rule and a near-optimal reference. Across these cases, the apparent payoff varies by control problem: beating tested rules does not necessarily mean approaching the available reference. The abstract describes four small case studies based on a modeled office building, so it does not establish how the results transfer beyond them.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence describes four small, reproducible case studies based on an office building in Brisbane, Australia; the abstract does not establish how the results transfer to other buildings or settings. The abstract says practical difficulties in training on co-simulation FMUs are reported, but does not identify those difficulties or their effect on the results.","speaker":{"name":"Zhao, Bingnan, Gammulle, Harshala, Fernando, Tharindu","roleAtSource":"Article author"},"source":{"title":"When does deep reinforcement learning pay off in HVAC supervisory control? Four small Modelica case studies trained directly on FMUs","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.22144","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors compare DRL agents with tuned rule-based controllers and, where practicable, near-optimal references in four small case studies based on an office building in Brisbane.","excerpt":"This paper examines four small, reproducible case studies based on an office building in Brisbane, Australia","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In two cases without storage, the agent reached the near-optimal reference, but its margin over a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","excerpt":"In the two cases without storage the agent reached the near-optimal reference, but the margin above a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In the chilled water storage case, the agent outperformed both rules and adopted midday charging, but obtained only about 45% of the saving achieved by the perfect-foresight schedule and did little to limit the demand peak.","excerpt":"With a chilled water storage tank the margin was considerably larger. The agent outperformed both rules (-7.8%, compared with -3.9% and -6.3%) and adopted midday charging during the solar off-peak period, yet it obtained only about 45% of the saving achieved by the perfect-foresight schedule and did","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In the pre-cooling case, a hand-tuned rule performed better than the agent.","excerpt":"In the pre-cooling case a hand-tuned rule remained superior (-12.0% compared with -5.6%).","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"The authors recommend that DRL studies of HVAC control state the margin between the best rule and a near-optimal reference.","excerpt":"These results suggest that studies of DRL for HVAC control should state the margin between the best rule and a near-optimal reference.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"The paper reports practical difficulties in training on co-simulation FMUs.","excerpt":"Some practical difficulties encountered in training on co-simulation FMUs are also reported.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22144","checkedAt":"2026-11-18T16:50:11.736Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What practical difficulties did the authors encounter when training on co-simulation FMUs, and how did those difficulties affect the reported results?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: When does deep reinforcement learning pay off in HVAC supervisory control?","summary":"Bingnan Zhao, Harshala Gammulle and Tharindu Fernando compare deep reinforcement learning (DRL) agents with tuned rule-based controllers across four small Modelica case studies of HVAC supervisory control in an office building in Brisbane, Australia. They argue that reported gains are hard to interpret without a strong rule-based baseline and a near-optimal reference. In two cases without storage, agents reached the near-optimal reference but improved on a well-chosen rule by only 1.3% for condenser water reset and 0.18% for chilled water reset. With chilled water storage, an agent outperformed both tested rules and adopted midday charging, yet achieved only about 45% of the saving from the perfect-foresight schedule and did little to limit the demand peak. In pre-cooling, a hand-tuned rule remained superior. The authors therefore suggest that HVAC control studies report the margin between the best rule and a near-optimal reference. Across these cases, the apparent payoff varies by control problem: beating tested rules does not necessarily mean approaching the available reference. The abstract describes four small case studies based on a modeled office building, so it does not establish how the results transfer beyond them.","question":"What practical difficulties did the authors encounter when training on co-simulation FMUs, and how did those difficulties affect the reported results?","claims":[{"text":"The authors compare DRL agents with tuned rule-based controllers and, where practicable, near-optimal references in four small case studies based on an office building in Brisbane.","excerpt":"This paper examines four small, reproducible case studies based on an office building in Brisbane, Australia","support":"source-stated"},{"text":"In two cases without storage, the agent reached the near-optimal reference, but its margin over a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","excerpt":"In the two cases without storage the agent reached the near-optimal reference, but the margin above a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","support":"source-stated"},{"text":"In the chilled water storage case, the agent outperformed both rules and adopted midday charging, but obtained only about 45% of the saving achieved by the perfect-foresight schedule and did little to limit the demand peak.","excerpt":"With a chilled water storage tank the margin was considerably larger. The agent outperformed both rules (-7.8%, compared with -3.9% and -6.3%) and adopted midday charging during the solar off-peak period, yet it obtained only about 45% of the saving achieved by the perfect-foresight schedule and did","support":"source-stated"},{"text":"In the pre-cooling case, a hand-tuned rule performed better than the agent.","excerpt":"In the pre-cooling case a hand-tuned rule remained superior (-12.0% compared with -5.6%).","support":"source-stated"},{"text":"The authors recommend that DRL studies of HVAC control state the margin between the best rule and a near-optimal reference.","excerpt":"These results suggest that studies of DRL for HVAC control should state the margin between the best rule and a near-optimal reference.","support":"source-stated"},{"text":"The paper reports practical difficulties in training on co-simulation FMUs.","excerpt":"Some practical difficulties encountered in training on co-simulation FMUs are also reported.","support":"source-stated"}],"limitations":["The evidence describes four small, reproducible case studies based on an office building in Brisbane, Australia; the abstract does not establish how the results transfer to other buildings or settings.","The abstract says practical difficulties in training on co-simulation FMUs are reported, but does not identify those difficulties or their effect on the results."],"mediaId":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","correctionReason":null,"id":"87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003","publicationId":"b7793cdb-6080-4347-89e5-4a5cba7c2ef1","version":1,"sourceUrl":"https://arxiv.org/abs/2611.22144","sourceTitle":"When does deep reinforcement learning pay off in HVAC supervisory control? Four small Modelica case studies trained directly on FMUs","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:13:21.920Z","createdAt":"2026-11-18T15:46:18.662Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","kind":"article","url":"https://arxiv.org/abs/2611.22144","sourceUrl":"https://arxiv.org/abs/2611.22144","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:33:55.147Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22144","checkedAt":"2026-11-18T16:50:11.736Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bb42762d76eee686a427d02f2170973d1b13e5a404f7b1585ff168266477edc5","decidedAt":"2026-11-18T15:33:56.301Z"},"provenance":{"textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observationId":"7b046077c3134c2c2300079fc549ed11e8bf0255222cb93ee7a16692fd7f3e81","retrievedAt":"2026-11-18T15:33:54.967Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"679e971f-f26c-47db-8008-671b5594be7f"},"reviewer":{"model":"gpt-6-luna","runId":"0fd89d8c-c400-448c-8145-6095ddcbc4b9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:46:18.662Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhao, Bingnan","url":null,"kind":"unknown"},{"name":"Gammulle, Harshala","url":null,"kind":"unknown"},{"name":"Fernando, Tharindu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhao, Bingnan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Bingnan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}},{"actor":{"name":"Gammulle, Harshala","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gammulle, Harshala","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}},{"actor":{"name":"Fernando, Tharindu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Fernando, Tharindu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.22144","snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-when-does-deep-reinforcement-learning-pay-off-in-87fe64b7","formats":{"html":"/readings/arxiv-cs-ai-when-does-deep-reinforcement-learning-pay-off-in-87fe64b7","markdown":"/readings/arxiv-cs-ai-when-does-deep-reinforcement-learning-pay-off-in-87fe64b7.md","json":"/readings/arxiv-cs-ai-when-does-deep-reinforcement-learning-pay-off-in-87fe64b7.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003","revision":"b7793cdb-6080-4347-89e5-4a5cba7c2ef1","revisionKind":"publication-id","title":"arXiv cs.AI: When does deep reinforcement learning pay off in HVAC supervisory control?","url":"https://escapemeridian.com/readings/arxiv-cs-ai-when-does-deep-reinforcement-learning-pay-off-in-87fe64b7"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.22144","revision":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","revisionKind":"sha256-source-text","title":"When does deep reinforcement learning pay off in HVAC supervisory control? Four small Modelica case studies trained directly on FMUs","url":"https://arxiv.org/abs/2611.22144"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003","title":"arXiv cs.AI: When does deep reinforcement learning pay off in HVAC supervisory control?","argument":"Bingnan Zhao, Harshala Gammulle and Tharindu Fernando compare deep reinforcement learning (DRL) agents with tuned rule-based controllers across four small Modelica case studies of HVAC supervisory control in an office building in Brisbane, Australia. They argue that reported gains are hard to interpret without a strong rule-based baseline and a near-optimal reference. In two cases without storage, agents reached the near-optimal reference but improved on a well-chosen rule by only 1.3% for condenser water reset and 0.18% for chilled water reset. With chilled water storage, an agent outperformed both tested rules and adopted midday charging, yet achieved only about 45% of the saving from the perfect-foresight schedule and did little to limit the demand peak. In pre-cooling, a hand-tuned rule remained superior. The authors therefore suggest that HVAC control studies report the margin between the best rule and a near-optimal reference. Across these cases, the apparent payoff varies by control problem: beating tested rules does not necessarily mean approaching the available reference. The abstract describes four small case studies based on a modeled office building, so it does not establish how the results transfer beyond them.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence describes four small, reproducible case studies based on an office building in Brisbane, Australia; the abstract does not establish how the results transfer to other buildings or settings. The abstract says practical difficulties in training on co-simulation FMUs are reported, but does not identify those difficulties or their effect on the results.","speaker":{"name":"Zhao, Bingnan, Gammulle, Harshala, Fernando, Tharindu","roleAtSource":"Article author"},"source":{"title":"When does deep reinforcement learning pay off in HVAC supervisory control? Four small Modelica case studies trained directly on FMUs","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.22144","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors compare DRL agents with tuned rule-based controllers and, where practicable, near-optimal references in four small case studies based on an office building in Brisbane.","excerpt":"This paper examines four small, reproducible case studies based on an office building in Brisbane, Australia","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In two cases without storage, the agent reached the near-optimal reference, but its margin over a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","excerpt":"In the two cases without storage the agent reached the near-optimal reference, but the margin above a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In the chilled water storage case, the agent outperformed both rules and adopted midday charging, but obtained only about 45% of the saving achieved by the perfect-foresight schedule and did little to limit the demand peak.","excerpt":"With a chilled water storage tank the margin was considerably larger. The agent outperformed both rules (-7.8%, compared with -3.9% and -6.3%) and adopted midday charging during the solar off-peak period, yet it obtained only about 45% of the saving achieved by the perfect-foresight schedule and did","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"In the pre-cooling case, a hand-tuned rule performed better than the agent.","excerpt":"In the pre-cooling case a hand-tuned rule remained superior (-12.0% compared with -5.6%).","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"The authors recommend that DRL studies of HVAC control state the margin between the best rule and a near-optimal reference.","excerpt":"These results suggest that studies of DRL for HVAC control should state the margin between the best rule and a near-optimal reference.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"},{"text":"The paper reports practical difficulties in training on co-simulation FMUs.","excerpt":"Some practical difficulties encountered in training on co-simulation FMUs are also reported.","url":"https://arxiv.org/abs/2611.22144","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22144","checkedAt":"2026-11-18T16:50:11.736Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What practical difficulties did the authors encounter when training on co-simulation FMUs, and how did those difficulties affect the reported results?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: When does deep reinforcement learning pay off in HVAC supervisory control?","summary":"Bingnan Zhao, Harshala Gammulle and Tharindu Fernando compare deep reinforcement learning (DRL) agents with tuned rule-based controllers across four small Modelica case studies of HVAC supervisory control in an office building in Brisbane, Australia. They argue that reported gains are hard to interpret without a strong rule-based baseline and a near-optimal reference. In two cases without storage, agents reached the near-optimal reference but improved on a well-chosen rule by only 1.3% for condenser water reset and 0.18% for chilled water reset. With chilled water storage, an agent outperformed both tested rules and adopted midday charging, yet achieved only about 45% of the saving from the perfect-foresight schedule and did little to limit the demand peak. In pre-cooling, a hand-tuned rule remained superior. The authors therefore suggest that HVAC control studies report the margin between the best rule and a near-optimal reference. Across these cases, the apparent payoff varies by control problem: beating tested rules does not necessarily mean approaching the available reference. The abstract describes four small case studies based on a modeled office building, so it does not establish how the results transfer beyond them.","question":"What practical difficulties did the authors encounter when training on co-simulation FMUs, and how did those difficulties affect the reported results?","claims":[{"text":"The authors compare DRL agents with tuned rule-based controllers and, where practicable, near-optimal references in four small case studies based on an office building in Brisbane.","excerpt":"This paper examines four small, reproducible case studies based on an office building in Brisbane, Australia","support":"source-stated"},{"text":"In two cases without storage, the agent reached the near-optimal reference, but its margin over a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","excerpt":"In the two cases without storage the agent reached the near-optimal reference, but the margin above a well-chosen rule was small: 1.3% for condenser water reset and 0.18% for chilled water reset.","support":"source-stated"},{"text":"In the chilled water storage case, the agent outperformed both rules and adopted midday charging, but obtained only about 45% of the saving achieved by the perfect-foresight schedule and did little to limit the demand peak.","excerpt":"With a chilled water storage tank the margin was considerably larger. The agent outperformed both rules (-7.8%, compared with -3.9% and -6.3%) and adopted midday charging during the solar off-peak period, yet it obtained only about 45% of the saving achieved by the perfect-foresight schedule and did","support":"source-stated"},{"text":"In the pre-cooling case, a hand-tuned rule performed better than the agent.","excerpt":"In the pre-cooling case a hand-tuned rule remained superior (-12.0% compared with -5.6%).","support":"source-stated"},{"text":"The authors recommend that DRL studies of HVAC control state the margin between the best rule and a near-optimal reference.","excerpt":"These results suggest that studies of DRL for HVAC control should state the margin between the best rule and a near-optimal reference.","support":"source-stated"},{"text":"The paper reports practical difficulties in training on co-simulation FMUs.","excerpt":"Some practical difficulties encountered in training on co-simulation FMUs are also reported.","support":"source-stated"}],"limitations":["The evidence describes four small, reproducible case studies based on an office building in Brisbane, Australia; the abstract does not establish how the results transfer to other buildings or settings.","The abstract says practical difficulties in training on co-simulation FMUs are reported, but does not identify those difficulties or their effect on the results."],"mediaId":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","correctionReason":null,"id":"87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003","publicationId":"b7793cdb-6080-4347-89e5-4a5cba7c2ef1","version":1,"sourceUrl":"https://arxiv.org/abs/2611.22144","sourceTitle":"When does deep reinforcement learning pay off in HVAC supervisory control? Four small Modelica case studies trained directly on FMUs","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:13:21.920Z","createdAt":"2026-11-18T15:46:18.662Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","kind":"article","url":"https://arxiv.org/abs/2611.22144","sourceUrl":"https://arxiv.org/abs/2611.22144","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:33:55.147Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22144","checkedAt":"2026-11-18T16:50:11.736Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"a6649924329f8f3c7080644ef9eda1fdeefc93280eab87d6056800c0b5a9cec1","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bb42762d76eee686a427d02f2170973d1b13e5a404f7b1585ff168266477edc5","decidedAt":"2026-11-18T15:33:56.301Z"},"provenance":{"textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observationId":"7b046077c3134c2c2300079fc549ed11e8bf0255222cb93ee7a16692fd7f3e81","retrievedAt":"2026-11-18T15:33:54.967Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"679e971f-f26c-47db-8008-671b5594be7f"},"reviewer":{"model":"gpt-6-luna","runId":"0fd89d8c-c400-448c-8145-6095ddcbc4b9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:46:18.662Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhao, Bingnan","url":null,"kind":"unknown"},{"name":"Gammulle, Harshala","url":null,"kind":"unknown"},{"name":"Fernando, Tharindu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhao, Bingnan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Bingnan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}},{"actor":{"name":"Gammulle, Harshala","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gammulle, Harshala","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}},{"actor":{"name":"Fernando, Tharindu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Fernando, Tharindu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22144","locator":"head/meta[name=author|citation_author]"},"assertionId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:50:11.736Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","sourceUrl":"https://arxiv.org/abs/2611.22144","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.22144","snapshotId":"8484e9ed0ff5673fd24b8083a432aee8df878e57f17853ff7448dfe6108c3830","contentSha256":"5a9d18ea830b7f61ad43f532b1e6e44221d8a78245155955389220be8139bf29","textHash":"4f3bcd75e52747e8791210b739c32f79b2b3d035d143692acb7b54899d06a1af","observedAt":"2026-11-18T16:50:11.736Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/87fe64b788317f1bc8034e5063507a80f1e9e9004ae5f7181807238583163003/source"}}}],"audits":[{"publicationId":"b7793cdb-6080-4347-89e5-4a5cba7c2ef1","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the paper to Bingnan Zhao, Harshala Gammulle and Tharindu Fernando on arXiv. It keeps findings and the reporting recommendation as the authors' claims.","excerpt":"Authors:Bingnan Zhao, Harshala Gammulle, Tharindu Fernando"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful, but key terms are never explained for a general reader. HVAC is not spelled out (heating, ventilation and air-conditioning). Modelica, supervisory control, condenser and chilled water reset, perfect foresight, demand peak and co-simulation FMUs are also unexplained. It never says the near-optimal reference came from exhaustive search or dynamic programming with perfect foresight, which is central to the argument. Smallest repair: add plain-language glosses or term tooltips for these terms. Optionally restore the notable finding that two common reset rules used more energy than a fixed set point.","excerpt":"with a near-optimal reference from hourly exhaustive search or dynamic programming with perfect foresight"},{"dimension":"date","status":"pass","explanation":"The displayed original publication date of 2026-11-17 matches the arXiv v1 submission date, not the feed date of 2026-11-18.","excerpt":"[Submitted on 17 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract verbatim in substance. The synthesis line, that beating rules does not mean approaching the reference, follows directly from the storage case. The limitations and the question about FMU training difficulties are grounded in what the abstract leaves unstated. No benefits or costs are invented.","excerpt":"yet it obtained only about 45% of the saving achieved by the perfect-foresight schedule and did little to limit the demand peak"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-18T15:46:18.662Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}