{"id":"ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6","title":"arXiv cs.AI paper: Lev-3B argues a two-stage training recipe helps compact models analyze logs","argument":"The authors of Lev-3B present a 3-billion-parameter model for log-analysis decisions, such as detecting anomalous sessions or identifying attack techniques. Their central claim is about the training recipe: teach the model to make bounded decisions before exposing it to logs, then mix target tasks with general log data.\n\nThey report that this two-stage approach transfers better than training on log data alone, and that general log data improves results on sources excluded from training. On anomaly detection, Lev-3B outperforms prompted frontier models, including on an excluded logging system, at a fraction of their serving cost. But it trails those models on attack-technique classification, and its probabilities, though well calibrated on familiar sources, confidently miss anomalies on the excluded system.\n\nThe contrast matters: lower serving cost and strong results on one task do not mean dependable performance across unfamiliar systems or tasks. The authors release the checkpoint, recipe, data manifests and prediction-level artifacts, making their approach available for inspection. How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it does not provide detailed evaluation results or explain the scope of the tested tasks and systems. The abstract reports a result on an excluded logging system but does not establish how performance or calibration will generalize to other unfamiliar systems.","speaker":{"name":"Betthauser, Leo, Liu, Yingqi, Shah, Uday, Wei, Jishang, Galhotra, Sainyam, Gou, Liang, Dharnidharka, Vedant, Yang, Hao","roleAtSource":"Article author"},"source":{"title":"Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.38915","publishedAt":"2026-10-28","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors present Lev-3B, a 3-billion-parameter decision model, and study a training recipe that first teaches bounded natural-language decisions without log data, then trains on target tasks mixed with general log data.","excerpt":"The recipe has two key parts. First, training follows a curriculum: the model learns bounded natural-language decisions, using no log data, before it sees any logs.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report that the two-stage recipe transfers better than training on log data alone, and that general log data improves performance on excluded sources.","excerpt":"The two-stage recipe transfers substantially better than training on log data alone. Adding general log data improves performance on excluded sources.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report that Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, at a fraction of their serving cost; it trails them on attack-technique classification.","excerpt":"At a fraction of their serving cost, Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, but trails them on attack-technique classification.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report good calibration on familiar sources but say Lev-3B confidently misses anomalies on the excluded logging system.","excerpt":"Its probabilities are well calibrated on familiar sources, but on the excluded logging system it confidently misses anomalies.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors say they release the checkpoint, recipe, data manifests and prediction-level artifacts.","excerpt":"We release the checkpoint, recipe, data manifests, and prediction-level artifacts.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38915","checkedAt":"2026-11-11T08:54:07.960Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: Lev-3B argues a two-stage training recipe helps compact models analyze logs","summary":"The authors of Lev-3B present a 3-billion-parameter model for log-analysis decisions, such as detecting anomalous sessions or identifying attack techniques. Their central claim is about the training recipe: teach the model to make bounded decisions before exposing it to logs, then mix target tasks with general log data.\n\nThey report that this two-stage approach transfers better than training on log data alone, and that general log data improves results on sources excluded from training. On anomaly detection, Lev-3B outperforms prompted frontier models, including on an excluded logging system, at a fraction of their serving cost. But it trails those models on attack-technique classification, and its probabilities, though well calibrated on familiar sources, confidently miss anomalies on the excluded system.\n\nThe contrast matters: lower serving cost and strong results on one task do not mean dependable performance across unfamiliar systems or tasks. The authors release the checkpoint, recipe, data manifests and prediction-level artifacts, making their approach available for inspection. How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","question":"How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","claims":[{"text":"The authors present Lev-3B, a 3-billion-parameter decision model, and study a training recipe that first teaches bounded natural-language decisions without log data, then trains on target tasks mixed with general log data.","excerpt":"The recipe has two key parts. First, training follows a curriculum: the model learns bounded natural-language decisions, using no log data, before it sees any logs.","support":"source-stated"},{"text":"The authors report that the two-stage recipe transfers better than training on log data alone, and that general log data improves performance on excluded sources.","excerpt":"The two-stage recipe transfers substantially better than training on log data alone. Adding general log data improves performance on excluded sources.","support":"source-stated"},{"text":"The authors report that Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, at a fraction of their serving cost; it trails them on attack-technique classification.","excerpt":"At a fraction of their serving cost, Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, but trails them on attack-technique classification.","support":"source-stated"},{"text":"The authors report good calibration on familiar sources but say Lev-3B confidently misses anomalies on the excluded logging system.","excerpt":"Its probabilities are well calibrated on familiar sources, but on the excluded logging system it confidently misses anomalies.","support":"source-stated"},{"text":"The authors say they release the checkpoint, recipe, data manifests and prediction-level artifacts.","excerpt":"We release the checkpoint, recipe, data manifests, and prediction-level artifacts.","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it does not provide detailed evaluation results or explain the scope of the tested tasks and systems.","The abstract reports a result on an excluded logging system but does not establish how performance or calibration will generalize to other unfamiliar systems."],"mediaId":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","correctionReason":null,"id":"ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6","publicationId":"ecedcafd-830d-43ac-84a5-006114876bd1","version":1,"sourceUrl":"https://arxiv.org/abs/2610.38915","sourceTitle":"Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-28","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:32.828Z","createdAt":"2026-11-11T08:38:39.260Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","kind":"article","url":"https://arxiv.org/abs/2610.38915","sourceUrl":"https://arxiv.org/abs/2610.38915","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T11:31:40.875Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38915","checkedAt":"2026-11-11T08:54:07.960Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","confidence":0.94,"provider":"typesafe","model":"jev-1.13.0","inputHash":"8bcc133aaeb5e8087bf3ad5de3d939bcb2f7e05f0addc98c520e4670baddc58e","decidedAt":"2026-10-31T11:31:41.545Z"},"provenance":{"textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observationId":"d617c83758146f71bddd17653e3f730c9483f04c969023d2f652628f731599b2","retrievedAt":"2026-10-31T11:31:40.793Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"a4da5ddc-860f-4111-81ce-fd44617195df"},"reviewer":{"model":"gpt-6-luna","runId":"732209d3-9e19-48f4-8c04-875daa9296a6"}},"audit":{"status":"passed","reviewedAt":"2026-11-11T08:38:39.260Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Betthauser, Leo","url":null,"kind":"unknown"},{"name":"Liu, Yingqi","url":null,"kind":"unknown"},{"name":"Shah, Uday","url":null,"kind":"unknown"},{"name":"Wei, Jishang","url":null,"kind":"unknown"},{"name":"Galhotra, Sainyam","url":null,"kind":"unknown"},{"name":"Gou, Liang","url":null,"kind":"unknown"},{"name":"Dharnidharka, Vedant","url":null,"kind":"unknown"},{"name":"Yang, Hao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Betthauser, Leo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Betthauser, Leo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Liu, Yingqi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yingqi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Shah, Uday","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shah, Uday","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Wei, Jishang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wei, Jishang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Galhotra, Sainyam","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Galhotra, Sainyam","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Gou, Liang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gou, Liang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Dharnidharka, Vedant","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dharnidharka, Vedant","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Yang, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yang, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.38915","snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-lev-3b-argues-a-two-stage-training-recipe-ded92384","formats":{"html":"/readings/arxiv-cs-ai-paper-lev-3b-argues-a-two-stage-training-recipe-ded92384","markdown":"/readings/arxiv-cs-ai-paper-lev-3b-argues-a-two-stage-training-recipe-ded92384.md","json":"/readings/arxiv-cs-ai-paper-lev-3b-argues-a-two-stage-training-recipe-ded92384.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"},{"id":"term-calibration","name":"Model calibration","explanation":"Whether a model's stated confidence matches how often it turns out to be right.","referenceUrl":"https://en.wikipedia.org/wiki/Calibration_(statistics)"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6","revision":"ecedcafd-830d-43ac-84a5-006114876bd1","revisionKind":"publication-id","title":"arXiv cs.AI paper: Lev-3B argues a two-stage training recipe helps compact models analyze logs","url":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-lev-3b-argues-a-two-stage-training-recipe-ded92384"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.38915","revision":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","revisionKind":"sha256-source-text","title":"Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models","url":"https://arxiv.org/abs/2610.38915"},"status":"partial","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6","title":"arXiv cs.AI paper: Lev-3B argues a two-stage training recipe helps compact models analyze logs","argument":"The authors of Lev-3B present a 3-billion-parameter model for log-analysis decisions, such as detecting anomalous sessions or identifying attack techniques. Their central claim is about the training recipe: teach the model to make bounded decisions before exposing it to logs, then mix target tasks with general log data.\n\nThey report that this two-stage approach transfers better than training on log data alone, and that general log data improves results on sources excluded from training. On anomaly detection, Lev-3B outperforms prompted frontier models, including on an excluded logging system, at a fraction of their serving cost. But it trails those models on attack-technique classification, and its probabilities, though well calibrated on familiar sources, confidently miss anomalies on the excluded system.\n\nThe contrast matters: lower serving cost and strong results on one task do not mean dependable performance across unfamiliar systems or tasks. The authors release the checkpoint, recipe, data manifests and prediction-level artifacts, making their approach available for inspection. How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it does not provide detailed evaluation results or explain the scope of the tested tasks and systems. The abstract reports a result on an excluded logging system but does not establish how performance or calibration will generalize to other unfamiliar systems.","speaker":{"name":"Betthauser, Leo, Liu, Yingqi, Shah, Uday, Wei, Jishang, Galhotra, Sainyam, Gou, Liang, Dharnidharka, Vedant, Yang, Hao","roleAtSource":"Article author"},"source":{"title":"Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.38915","publishedAt":"2026-10-28","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors present Lev-3B, a 3-billion-parameter decision model, and study a training recipe that first teaches bounded natural-language decisions without log data, then trains on target tasks mixed with general log data.","excerpt":"The recipe has two key parts. First, training follows a curriculum: the model learns bounded natural-language decisions, using no log data, before it sees any logs.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report that the two-stage recipe transfers better than training on log data alone, and that general log data improves performance on excluded sources.","excerpt":"The two-stage recipe transfers substantially better than training on log data alone. Adding general log data improves performance on excluded sources.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report that Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, at a fraction of their serving cost; it trails them on attack-technique classification.","excerpt":"At a fraction of their serving cost, Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, but trails them on attack-technique classification.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors report good calibration on familiar sources but say Lev-3B confidently misses anomalies on the excluded logging system.","excerpt":"Its probabilities are well calibrated on familiar sources, but on the excluded logging system it confidently misses anomalies.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"},{"text":"The authors say they release the checkpoint, recipe, data manifests and prediction-level artifacts.","excerpt":"We release the checkpoint, recipe, data manifests, and prediction-level artifacts.","url":"https://arxiv.org/abs/2610.38915","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38915","checkedAt":"2026-11-11T08:54:07.960Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: Lev-3B argues a two-stage training recipe helps compact models analyze logs","summary":"The authors of Lev-3B present a 3-billion-parameter model for log-analysis decisions, such as detecting anomalous sessions or identifying attack techniques. Their central claim is about the training recipe: teach the model to make bounded decisions before exposing it to logs, then mix target tasks with general log data.\n\nThey report that this two-stage approach transfers better than training on log data alone, and that general log data improves results on sources excluded from training. On anomaly detection, Lev-3B outperforms prompted frontier models, including on an excluded logging system, at a fraction of their serving cost. But it trails those models on attack-technique classification, and its probabilities, though well calibrated on familiar sources, confidently miss anomalies on the excluded system.\n\nThe contrast matters: lower serving cost and strong results on one task do not mean dependable performance across unfamiliar systems or tasks. The authors release the checkpoint, recipe, data manifests and prediction-level artifacts, making their approach available for inspection. How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","question":"How well would the reported performance and calibration hold across additional logging systems not used for training, calibration or model selection?","claims":[{"text":"The authors present Lev-3B, a 3-billion-parameter decision model, and study a training recipe that first teaches bounded natural-language decisions without log data, then trains on target tasks mixed with general log data.","excerpt":"The recipe has two key parts. First, training follows a curriculum: the model learns bounded natural-language decisions, using no log data, before it sees any logs.","support":"source-stated"},{"text":"The authors report that the two-stage recipe transfers better than training on log data alone, and that general log data improves performance on excluded sources.","excerpt":"The two-stage recipe transfers substantially better than training on log data alone. Adding general log data improves performance on excluded sources.","support":"source-stated"},{"text":"The authors report that Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, at a fraction of their serving cost; it trails them on attack-technique classification.","excerpt":"At a fraction of their serving cost, Lev-3B outperforms prompted frontier models on anomaly detection, including on an excluded logging system, but trails them on attack-technique classification.","support":"source-stated"},{"text":"The authors report good calibration on familiar sources but say Lev-3B confidently misses anomalies on the excluded logging system.","excerpt":"Its probabilities are well calibrated on familiar sources, but on the excluded logging system it confidently misses anomalies.","support":"source-stated"},{"text":"The authors say they release the checkpoint, recipe, data manifests and prediction-level artifacts.","excerpt":"We release the checkpoint, recipe, data manifests, and prediction-level artifacts.","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it does not provide detailed evaluation results or explain the scope of the tested tasks and systems.","The abstract reports a result on an excluded logging system but does not establish how performance or calibration will generalize to other unfamiliar systems."],"mediaId":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","correctionReason":null,"id":"ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6","publicationId":"ecedcafd-830d-43ac-84a5-006114876bd1","version":1,"sourceUrl":"https://arxiv.org/abs/2610.38915","sourceTitle":"Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-28","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-30T06:45:32.828Z","createdAt":"2026-11-11T08:38:39.260Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","kind":"article","url":"https://arxiv.org/abs/2610.38915","sourceUrl":"https://arxiv.org/abs/2610.38915","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-31T11:31:40.875Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.38915","checkedAt":"2026-11-11T08:54:07.960Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6d299afdf7be576d64f9c124160914a24479b95cedfa2106762fb02fbb58004f","confidence":0.94,"provider":"typesafe","model":"jev-1.13.0","inputHash":"8bcc133aaeb5e8087bf3ad5de3d939bcb2f7e05f0addc98c520e4670baddc58e","decidedAt":"2026-10-31T11:31:41.545Z"},"provenance":{"textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observationId":"d617c83758146f71bddd17653e3f730c9483f04c969023d2f652628f731599b2","retrievedAt":"2026-10-31T11:31:40.793Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"a4da5ddc-860f-4111-81ce-fd44617195df"},"reviewer":{"model":"gpt-6-luna","runId":"732209d3-9e19-48f4-8c04-875daa9296a6"}},"audit":{"status":"passed","reviewedAt":"2026-11-11T08:38:39.260Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Betthauser, Leo","url":null,"kind":"unknown"},{"name":"Liu, Yingqi","url":null,"kind":"unknown"},{"name":"Shah, Uday","url":null,"kind":"unknown"},{"name":"Wei, Jishang","url":null,"kind":"unknown"},{"name":"Galhotra, Sainyam","url":null,"kind":"unknown"},{"name":"Gou, Liang","url":null,"kind":"unknown"},{"name":"Dharnidharka, Vedant","url":null,"kind":"unknown"},{"name":"Yang, Hao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Betthauser, Leo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Betthauser, Leo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Liu, Yingqi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yingqi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Shah, Uday","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shah, Uday","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Wei, Jishang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wei, Jishang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Galhotra, Sainyam","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Galhotra, Sainyam","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Gou, Liang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gou, Liang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Dharnidharka, Vedant","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dharnidharka, Vedant","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}},{"actor":{"name":"Yang, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yang, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.38915","locator":"head/meta[name=author|citation_author]"},"assertionId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T08:54:07.960Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","sourceUrl":"https://arxiv.org/abs/2610.38915","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.38915","snapshotId":"62e1e26ab9be10e351880a2423b52335623a0b93a48f1d480eb12233a17634f7","contentSha256":"dc53ea52966171007cd9051873fc080a944033ae48ec7ab2c07faa05c83e1f7a","textHash":"fcf3ad78715359db28d45ed9673bceb0b955db8c5ce02e9bd5de7aca3828b7b2","observedAt":"2026-11-11T08:54:07.960Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ded92384cf77b9565748865ef262a97fc046d5ba13c4272c10d2b2e7bfca97e6/source"}}}],"audits":[{"publicationId":"ecedcafd-830d-43ac-84a5-006114876bd1","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The claims are consistently attributed to the paper's authors, and the arXiv source is identified. The paper's primary category is cs.LG and it is cross-listed in cs.AI; the 'arXiv cs.AI' label matches the publisher metadata and is not misleading.","excerpt":"Machine Learning (cs.LG); Artificial Intelligence (cs.AI)"},{"dimension":"summary","status":"pass","explanation":"The reading faithfully conveys the two-stage recipe, the transfer results, the cost advantage, the anomaly-detection win, the attack-classification shortfall, the calibration failure on the excluded system and the release. Small fidelity repairs would help: restore 'substantially' in 'transfers substantially better', and keep the exact term 'bounded natural-language decisions' rather than shortening it. Terms such as calibrated and serving cost should be covered by term-library tooltips. The question is substantive and follows from the evidence.","excerpt":"The two-stage recipe transfers substantially better than training on log data alone."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-28 matches the v1 submission date shown on the arXiv page.","excerpt":"[Submitted on 28 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim's excerpt appears verbatim in the source. The interpretive line saying strong results on one task do not mean dependable performance on unfamiliar systems is grounded in the source's own reported trade-offs. The limitations accurately note that the evidence is only the abstract.","excerpt":"Its probabilities are well calibrated on familiar sources, but on the excluded logging system it confidently misses anomalies."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the source itself.","excerpt":null}],"createdAt":"2026-11-11T08:38:39.260Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}