{"schemaVersion":1,"target":{"type":"reading","id":"5a3bb9c2b4dc0ca6a0657843be3cd4bff14d3ef2629b0a1119c30ee27366fdc0","revision":"c4baaa3b-8431-5f6b-11ac-b17c3c94f1a7","revisionKind":"publication-id","title":"Melanie Mitchell argues counterfactual tasks can test LLM reasoning","url":"https://escapemeridian.com/readings/melanie-mitchell-argues-counterfactual-tasks-can-test-llm-5a3bb9c2"},"source":{"type":"source","id":"https://aiguide.substack.com/p/evaluating-large-language-models","revision":"acc24653a41ca7bf870a666f4f450d8a3d7c3e2ad1817e896129228a9b708356","revisionKind":"sha256-source-text","title":"Evaluating Large Language Models Using “Counterfactual Tasks”","url":"https://aiguide.substack.com/p/evaluating-large-language-models"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."}