{"id":"78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb","title":"arXiv cs.AI: Model Merging Does Not Require Uniform LoRA Ranks","argument":"In an arXiv cs.AI abstract, the authors of “Model Merging Does Not Require Uniform LoRA Ranks” argue that model merging need not force separately fine-tuned experts to use the same LoRA rank. They report experiments with 36 experts across mathematics, instruction following and multilingual tasks, using four ranks, three model scales and six merging methods. The authors say averaging and utility-based selection gained up to 1.8 percentage points in multi-domain accuracy when each domain used its own best rank, while conflict-resolution methods were inconsistent and lost up to 4 points. They attribute the difference to how merging methods select spectral components: methods selecting by size can discard components that would reduce loss and nearly drop the instruction adapter, which they link to a 16-to-25-point fall on IFEval. By contrast, selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range in the reported comparison. The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude. Their results make the choice of merging method—not a shared rank—the key condition in their argument; how broadly that condition holds beyond the reported experiments remains open.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"This reading is based on the arXiv abstract, which reports the experimental setup and headline results but does not provide the detailed methods or results needed to assess them independently. The reported experiments cover 36 experts, three domains, four ranks, three model scales and six merging methods; the abstract does not establish how the results generalize beyond those tested combinations.","speaker":{"name":"Xie, Zirong, Afolabi, Zainab, Kozodoi, Nikita, Butler, Jack","roleAtSource":"Article author"},"source":{"title":"Model Merging Does Not Require Uniform LoRA Ranks","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06486","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that requiring every expert to use the same LoRA rank is a property of the merge method, not a requirement of model merging.","excerpt":"We show this coupling is a property of the merge method, not of merging.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors report that allowing domain-specific ranks cost averaging and utility-based selection nothing and improved multi-domain accuracy by up to 1.8 percentage points; conflict-resolution methods were inconsistent and lost up to 4 points.","excerpt":"Giving experts different ranks costs averaging and utility-based selection nothing, and gains them up to 1.8 pp of multi-domain accuracy, while the conflict-resolution methods are inconsistent and can lose up to 4 pp.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors attribute the difference to selection by size discarding components that would have reduced loss; they report that the instruction adapter was nearly discarded and IFEval fell by 16 to 25 percentage points.","excerpt":"methods that choose them by size discard many that would have reduced loss. They also tend to discard the same expert: the instruction adapter has the smallest singular values, so it is dropped almost entirely and IFEval falls by 16 to 25 pp.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors say selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range, compared with a 6.7-point change for TIES at 4B scale.","excerpt":"Choosing components by their effect on loss instead keeps all three experts, and leaves accuracy nearly flat across an 8$\\times$ rank range (0.7 pp, against 6.7 pp for TIES at 4B scale).","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude.","excerpt":"Rank can therefore be chosen per expert whenever the merge operator does not select by magnitude.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06486","checkedAt":"2026-11-09T08:54:09.968Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do these results vary across domains, model scales and merging methods beyond the combinations tested in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Model Merging Does Not Require Uniform LoRA Ranks","summary":"In an arXiv cs.AI abstract, the authors of “Model Merging Does Not Require Uniform LoRA Ranks” argue that model merging need not force separately fine-tuned experts to use the same LoRA rank. They report experiments with 36 experts across mathematics, instruction following and multilingual tasks, using four ranks, three model scales and six merging methods. The authors say averaging and utility-based selection gained up to 1.8 percentage points in multi-domain accuracy when each domain used its own best rank, while conflict-resolution methods were inconsistent and lost up to 4 points. They attribute the difference to how merging methods select spectral components: methods selecting by size can discard components that would reduce loss and nearly drop the instruction adapter, which they link to a 16-to-25-point fall on IFEval. By contrast, selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range in the reported comparison. The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude. Their results make the choice of merging method—not a shared rank—the key condition in their argument; how broadly that condition holds beyond the reported experiments remains open.","question":"How do these results vary across domains, model scales and merging methods beyond the combinations tested in the paper?","claims":[{"text":"The authors argue that requiring every expert to use the same LoRA rank is a property of the merge method, not a requirement of model merging.","excerpt":"We show this coupling is a property of the merge method, not of merging.","support":"source-stated"},{"text":"The authors report that allowing domain-specific ranks cost averaging and utility-based selection nothing and improved multi-domain accuracy by up to 1.8 percentage points; conflict-resolution methods were inconsistent and lost up to 4 points.","excerpt":"Giving experts different ranks costs averaging and utility-based selection nothing, and gains them up to 1.8 pp of multi-domain accuracy, while the conflict-resolution methods are inconsistent and can lose up to 4 pp.","support":"source-stated"},{"text":"The authors attribute the difference to selection by size discarding components that would have reduced loss; they report that the instruction adapter was nearly discarded and IFEval fell by 16 to 25 percentage points.","excerpt":"methods that choose them by size discard many that would have reduced loss. They also tend to discard the same expert: the instruction adapter has the smallest singular values, so it is dropped almost entirely and IFEval falls by 16 to 25 pp.","support":"source-stated"},{"text":"The authors say selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range, compared with a 6.7-point change for TIES at 4B scale.","excerpt":"Choosing components by their effect on loss instead keeps all three experts, and leaves accuracy nearly flat across an 8$\\times$ rank range (0.7 pp, against 6.7 pp for TIES at 4B scale).","support":"source-stated"},{"text":"The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude.","excerpt":"Rank can therefore be chosen per expert whenever the merge operator does not select by magnitude.","support":"source-stated"}],"limitations":["This reading is based on the arXiv abstract, which reports the experimental setup and headline results but does not provide the detailed methods or results needed to assess them independently.","The reported experiments cover 36 experts, three domains, four ranks, three model scales and six merging methods; the abstract does not establish how the results generalize beyond those tested combinations."],"mediaId":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","correctionReason":null,"id":"78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb","publicationId":"51673607-eb97-4086-828a-91206e73ba10","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06486","sourceTitle":"Model Merging Does Not Require Uniform LoRA Ranks","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:22.287Z","createdAt":"2026-11-09T08:23:33.799Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","kind":"article","url":"https://arxiv.org/abs/2611.06486","sourceUrl":"https://arxiv.org/abs/2611.06486","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T08:17:09.495Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06486","checkedAt":"2026-11-09T08:54:09.968Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","confidence":0.89,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a2759f680e9bffae9a5a924948feb03266f651603d560a76cf225ad6c78898e0","decidedAt":"2026-11-09T08:17:10.483Z"},"provenance":{"textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observationId":"690ab8bd07cef4fd072ba6682b0ab980c9a854fe82f40987bc9d4f9de8513737","retrievedAt":"2026-11-09T08:17:09.331Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"458019a6-378e-4ed6-8008-476d48734e6c"},"reviewer":{"model":"gpt-6-luna","runId":"62376ace-3049-4d5e-82d7-dea72a5387ca"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T08:23:33.799Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Xie, Zirong","url":null,"kind":"unknown"},{"name":"Afolabi, Zainab","url":null,"kind":"unknown"},{"name":"Kozodoi, Nikita","url":null,"kind":"unknown"},{"name":"Butler, Jack","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Xie, Zirong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Zirong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Afolabi, Zainab","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Afolabi, Zainab","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Kozodoi, Nikita","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kozodoi, Nikita","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Butler, Jack","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Butler, Jack","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06486","snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-model-merging-does-not-require-uniform-lora-ranks-78faaf61","formats":{"html":"/readings/arxiv-cs-ai-model-merging-does-not-require-uniform-lora-ranks-78faaf61","markdown":"/readings/arxiv-cs-ai-model-merging-does-not-require-uniform-lora-ranks-78faaf61.md","json":"/readings/arxiv-cs-ai-model-merging-does-not-require-uniform-lora-ranks-78faaf61.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb","revision":"51673607-eb97-4086-828a-91206e73ba10","revisionKind":"publication-id","title":"arXiv cs.AI: Model Merging Does Not Require Uniform LoRA Ranks","url":"https://escapemeridian.com/readings/arxiv-cs-ai-model-merging-does-not-require-uniform-lora-ranks-78faaf61"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.06486","revision":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","revisionKind":"sha256-source-text","title":"Model Merging Does Not Require Uniform LoRA Ranks","url":"https://arxiv.org/abs/2611.06486"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb","title":"arXiv cs.AI: Model Merging Does Not Require Uniform LoRA Ranks","argument":"In an arXiv cs.AI abstract, the authors of “Model Merging Does Not Require Uniform LoRA Ranks” argue that model merging need not force separately fine-tuned experts to use the same LoRA rank. They report experiments with 36 experts across mathematics, instruction following and multilingual tasks, using four ranks, three model scales and six merging methods. The authors say averaging and utility-based selection gained up to 1.8 percentage points in multi-domain accuracy when each domain used its own best rank, while conflict-resolution methods were inconsistent and lost up to 4 points. They attribute the difference to how merging methods select spectral components: methods selecting by size can discard components that would reduce loss and nearly drop the instruction adapter, which they link to a 16-to-25-point fall on IFEval. By contrast, selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range in the reported comparison. The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude. Their results make the choice of merging method—not a shared rank—the key condition in their argument; how broadly that condition holds beyond the reported experiments remains open.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"This reading is based on the arXiv abstract, which reports the experimental setup and headline results but does not provide the detailed methods or results needed to assess them independently. The reported experiments cover 36 experts, three domains, four ranks, three model scales and six merging methods; the abstract does not establish how the results generalize beyond those tested combinations.","speaker":{"name":"Xie, Zirong, Afolabi, Zainab, Kozodoi, Nikita, Butler, Jack","roleAtSource":"Article author"},"source":{"title":"Model Merging Does Not Require Uniform LoRA Ranks","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06486","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that requiring every expert to use the same LoRA rank is a property of the merge method, not a requirement of model merging.","excerpt":"We show this coupling is a property of the merge method, not of merging.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors report that allowing domain-specific ranks cost averaging and utility-based selection nothing and improved multi-domain accuracy by up to 1.8 percentage points; conflict-resolution methods were inconsistent and lost up to 4 points.","excerpt":"Giving experts different ranks costs averaging and utility-based selection nothing, and gains them up to 1.8 pp of multi-domain accuracy, while the conflict-resolution methods are inconsistent and can lose up to 4 pp.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors attribute the difference to selection by size discarding components that would have reduced loss; they report that the instruction adapter was nearly discarded and IFEval fell by 16 to 25 percentage points.","excerpt":"methods that choose them by size discard many that would have reduced loss. They also tend to discard the same expert: the instruction adapter has the smallest singular values, so it is dropped almost entirely and IFEval falls by 16 to 25 pp.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors say selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range, compared with a 6.7-point change for TIES at 4B scale.","excerpt":"Choosing components by their effect on loss instead keeps all three experts, and leaves accuracy nearly flat across an 8$\\times$ rank range (0.7 pp, against 6.7 pp for TIES at 4B scale).","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"},{"text":"The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude.","excerpt":"Rank can therefore be chosen per expert whenever the merge operator does not select by magnitude.","url":"https://arxiv.org/abs/2611.06486","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06486","checkedAt":"2026-11-09T08:54:09.968Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do these results vary across domains, model scales and merging methods beyond the combinations tested in the paper?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Model Merging Does Not Require Uniform LoRA Ranks","summary":"In an arXiv cs.AI abstract, the authors of “Model Merging Does Not Require Uniform LoRA Ranks” argue that model merging need not force separately fine-tuned experts to use the same LoRA rank. They report experiments with 36 experts across mathematics, instruction following and multilingual tasks, using four ranks, three model scales and six merging methods. The authors say averaging and utility-based selection gained up to 1.8 percentage points in multi-domain accuracy when each domain used its own best rank, while conflict-resolution methods were inconsistent and lost up to 4 points. They attribute the difference to how merging methods select spectral components: methods selecting by size can discard components that would reduce loss and nearly drop the instruction adapter, which they link to a 16-to-25-point fall on IFEval. By contrast, selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range in the reported comparison. The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude. Their results make the choice of merging method—not a shared rank—the key condition in their argument; how broadly that condition holds beyond the reported experiments remains open.","question":"How do these results vary across domains, model scales and merging methods beyond the combinations tested in the paper?","claims":[{"text":"The authors argue that requiring every expert to use the same LoRA rank is a property of the merge method, not a requirement of model merging.","excerpt":"We show this coupling is a property of the merge method, not of merging.","support":"source-stated"},{"text":"The authors report that allowing domain-specific ranks cost averaging and utility-based selection nothing and improved multi-domain accuracy by up to 1.8 percentage points; conflict-resolution methods were inconsistent and lost up to 4 points.","excerpt":"Giving experts different ranks costs averaging and utility-based selection nothing, and gains them up to 1.8 pp of multi-domain accuracy, while the conflict-resolution methods are inconsistent and can lose up to 4 pp.","support":"source-stated"},{"text":"The authors attribute the difference to selection by size discarding components that would have reduced loss; they report that the instruction adapter was nearly discarded and IFEval fell by 16 to 25 percentage points.","excerpt":"methods that choose them by size discard many that would have reduced loss. They also tend to discard the same expert: the instruction adapter has the smallest singular values, so it is dropped almost entirely and IFEval falls by 16 to 25 pp.","support":"source-stated"},{"text":"The authors say selecting components by their effect on loss kept all three experts and left accuracy nearly flat across an 8× rank range, compared with a 6.7-point change for TIES at 4B scale.","excerpt":"Choosing components by their effect on loss instead keeps all three experts, and leaves accuracy nearly flat across an 8$\\times$ rank range (0.7 pp, against 6.7 pp for TIES at 4B scale).","support":"source-stated"},{"text":"The authors conclude that rank can be chosen separately for each expert when the merge operator does not select by magnitude.","excerpt":"Rank can therefore be chosen per expert whenever the merge operator does not select by magnitude.","support":"source-stated"}],"limitations":["This reading is based on the arXiv abstract, which reports the experimental setup and headline results but does not provide the detailed methods or results needed to assess them independently.","The reported experiments cover 36 experts, three domains, four ranks, three model scales and six merging methods; the abstract does not establish how the results generalize beyond those tested combinations."],"mediaId":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","correctionReason":null,"id":"78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb","publicationId":"51673607-eb97-4086-828a-91206e73ba10","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06486","sourceTitle":"Model Merging Does Not Require Uniform LoRA Ranks","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:22.287Z","createdAt":"2026-11-09T08:23:33.799Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","kind":"article","url":"https://arxiv.org/abs/2611.06486","sourceUrl":"https://arxiv.org/abs/2611.06486","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T08:17:09.495Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06486","checkedAt":"2026-11-09T08:54:09.968Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"27c75616bb5cf8475a67d2378035f1ae579d04ef320616e80ab1eded05df5dc1","confidence":0.89,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a2759f680e9bffae9a5a924948feb03266f651603d560a76cf225ad6c78898e0","decidedAt":"2026-11-09T08:17:10.483Z"},"provenance":{"textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observationId":"690ab8bd07cef4fd072ba6682b0ab980c9a854fe82f40987bc9d4f9de8513737","retrievedAt":"2026-11-09T08:17:09.331Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"458019a6-378e-4ed6-8008-476d48734e6c"},"reviewer":{"model":"gpt-6-luna","runId":"62376ace-3049-4d5e-82d7-dea72a5387ca"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T08:23:33.799Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Xie, Zirong","url":null,"kind":"unknown"},{"name":"Afolabi, Zainab","url":null,"kind":"unknown"},{"name":"Kozodoi, Nikita","url":null,"kind":"unknown"},{"name":"Butler, Jack","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Xie, Zirong","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Zirong","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Afolabi, Zainab","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Afolabi, Zainab","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Kozodoi, Nikita","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kozodoi, Nikita","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}},{"actor":{"name":"Butler, Jack","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Butler, Jack","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06486","locator":"head/meta[name=author|citation_author]"},"assertionId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T08:54:09.968Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","sourceUrl":"https://arxiv.org/abs/2611.06486","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06486","snapshotId":"382d2a1b176a5e654182c5bb3f0e7d6bc17bc8ea98f4400d6b77ac1a2c0e2ec7","contentSha256":"2db844c24f5b2939dcf8abef1ec39986ca337c4d804a04d7529d40480ba7a8e9","textHash":"53b93303ce85b40a4e8536e5f106ad68c0e1dcb53cd6ecc29c03c0667831d64d","observedAt":"2026-11-09T08:54:09.968Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/78faaf61937b85c1666a0dbbc75cd2495dcfcf8bf1808289790ea4896c7aadcb/source"}}}],"audits":[{"publicationId":"51673607-eb97-4086-828a-91206e73ba10","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the claims to the paper's authors and presents them as reported findings rather than established facts. The arXiv listing is primarily cs.LG, cross-listed to cs.AI. The 'arXiv cs.AI' label matches the feed publisher and does not misattribute the work.","excerpt":"Authors:Zirong Xie, Zainab Afolabi, Nikita Kozodoi, Jack Butler"},{"dimension":"summary","status":"uncertain","explanation":"The figures and conditions are faithful to the abstract. However, central terms are not explained for a non-specialist reader: LoRA rank, spectral components, singular values or magnitude selection, IFEval, TIES and merge operator. The draft also omits the abstract's plain definition that merging combines fine-tuned experts without retraining. A reader cannot follow why rank or selection by size matters. Smallest repair: add the abstract's definition of merging, and add term-library tooltips for LoRA rank, IFEval and TIES, without paraphrasing those terms.","excerpt":"Model merging combines separately fine-tuned experts into a single model without retraining."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-04 matches the v1 submission date. It is not the later feed entry date.","excerpt":"[Submitted on 4 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim's excerpt is verbatim and supports its claim, including 1.8 pp, up to 4 pp, 16 to 25 pp on IFEval, and 0.7 pp against 6.7 pp for TIES at 4B scale. The conditional conclusion is preserved. The closing sentence and the question are appropriately framed as open rather than asserting generalization.","excerpt":"Rank can therefore be chosen per expert whenever the merge operator does not select by magnitude."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-09T08:23:33.799Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}