Nakib, Md., Sarkar, Sudipto, Talukder, A. J. A. Jubayer, Haque, Mohammad Ariful · Oct 27, 2026
arXiv cs.AI paper: PairCLIP-SWA authors argue deepfake detectors should average checkpoints
Markdown · JSON · Original source
In their abstract, Md. Nakib, Sudipto Sarkar, A. J. A. Jubayer Talukder and Mohammad Ariful Haque argue that choosing a deepfake detector by its best validation score can be unreliable. PairCLIP-SWA adapts an OpenCLIP visual tower and averages checkpoints in weight space, rather than relying on one checkpoint selected by validation accuracy. On the IEEE SP Cup 2025 , the authors report higher accuracy and AU-ROC, and a lower equal error rate, than a three-backbone ensemble trained under the same protocol. They also describe a sharper warning from an OpenForensics-derived benchmark: the checkpoint ranked best on validation scored lower on a separate test partition than the terminal average. This gap matters because, in their reported comparison, validation ranking selected a model that performed worse on separate test images. The authors attribute accuracy mainly to CLIP , report that secondary face cropping costs about 34 points, and recommend per-class selection criteria measured off the early-stopping split. The abstract does not establish how these results transfer beyond the stated benchmarks. Would the same ranking reversal appear on other disjoint ?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-13T20:05:30.233Z. First observed: 2026-10-30T06:42:59.319Z. Retrieved: 2026-10-30T16:33:09.916Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported results concern the named and protocols; the abstract does not establish performance on other datasets or deployment conditions. The source evidence is the paper's abstract, which does not provide full experimental details for assessing the reported comparisons. The abstract reports that secondary face cropping costs about 34 points but does not specify the metric in that sentence.
Open question
Would the same reversal between validation ranking and test performance appear on other disjoint deepfake-image ?
Source-stated
The authors argue that selecting the single checkpoint with the best validation score can be unreliable, and present checkpoint averaging as a way to address this concern.
the reliability of that choice is rarely measured
Source-stated
On the IEEE SP Cup 2025 benchmark, PairCLIP-SWA reached higher reported accuracy and AU-ROC, and a lower equal error rate, than the strongest published three-backbone ensemble under the same protocol.
the weight-averaged detector reaches 97.04% accuracy, 98.64% AU-ROC and a 4.07% equal error rate, against 94.46%, 97.60% and 5.00%.
Source-stated
On an OpenForensics-derived benchmark, the checkpoint ranked first by validation accuracy scored lower on a disjoint test partition than the terminal average.
the checkpoint that validation accuracy selects (98.43%) scores 88.85% on a disjoint 10,905-image test partition, rejecting 21.1% of genuine photographs, while the terminal average, ranked last on validation, scores 94.76%.
Source-stated
The authors report that CLIP pre-training, rather than ensembling, drives accuracy in their study of in-house configurations on the same benchmark split.
shows that CLIP pre-training rather than ensembling drives accuracy
Source-stated
The authors recommend measuring per-class selection criteria outside the early-stopping split.
We recommend per-class selection criteria measured off the early-stopping split.
Source and contributor context
Nakib, Md., Sarkar, Sudipto, Talukder, A. J. A. Jubayer, Haque, Mohammad Ariful · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Held-out set
Data kept aside during training and used only to test how well a model works on examples it has not seen.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9f97fa22-229a-424d-89f6-2d718dd9fd2d.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-13T20:05:30.233Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 7c2daa1ed9ce16077fd61b1a19e326d4daa4a8fb600c1ce2429823a6b34a60c8. Source text hash: 3aa1d53ce08692b07e4e599dade10c9768b9f1635fca0bb11076bf7213839097.
Revision and source-check history
Version 1 · 2026-11-13T20:05:30.233Z
arXiv cs.AI paper: PairCLIP-SWA authors argue deepfake detectors should average checkpoints
In their abstract, Md. Nakib, Sudipto Sarkar, A. J. A. Jubayer Talukder and Mohammad Ariful Haque argue that choosing a deepfake detector by its best validation score can be unreliable. PairCLIP-SWA adapts an OpenCLIP visual tower and averages checkpoints in weight space, rather than relying on one checkpoint selected by validation accuracy. On the IEEE SP Cup 2025 , the authors report higher accuracy and AU-ROC, and a lower equal error rate, than a three-backbone ensemble trained under the same protocol. They also describe a sharper warning from an OpenForensics-derived benchmark: the checkpoint ranked best on validation scored lower on a separate test partition than the terminal average. This gap matters because, in their reported comparison, validation ranking selected a model that performed worse on separate test images. The authors attribute accuracy mainly to CLIP , report that secondary face cropping costs about 34 points, and recommend per-class selection criteria measured off the early-stopping split. The abstract does not establish how these results transfer beyond the stated benchmarks. Would the same ranking reversal appear on other disjoint ?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-13T20:05:30.233Z. First observed: 2026-10-30T06:42:59.319Z. Retrieved: 2026-10-30T16:33:09.916Z.
Limits
The reported results concern the named and protocols; the abstract does not establish performance on other datasets or deployment conditions. The source evidence is the paper's abstract, which does not provide full experimental details for assessing the reported comparisons. The abstract reports that secondary face cropping costs about 34 points but does not specify the metric in that sentence.
Open question
Would the same reversal between validation ranking and test performance appear on other disjoint deepfake-image ?
Source-stated
The authors argue that selecting the single checkpoint with the best validation score can be unreliable, and present checkpoint averaging as a way to address this concern.
the reliability of that choice is rarely measured
Source-stated
On the IEEE SP Cup 2025 benchmark, PairCLIP-SWA reached higher reported accuracy and AU-ROC, and a lower equal error rate, than the strongest published three-backbone ensemble under the same protocol.
the weight-averaged detector reaches 97.04% accuracy, 98.64% AU-ROC and a 4.07% equal error rate, against 94.46%, 97.60% and 5.00%.
Source-stated
On an OpenForensics-derived benchmark, the checkpoint ranked first by validation accuracy scored lower on a disjoint test partition than the terminal average.
the checkpoint that validation accuracy selects (98.43%) scores 88.85% on a disjoint 10,905-image test partition, rejecting 21.1% of genuine photographs, while the terminal average, ranked last on validation, scores 94.76%.
Source-stated
The authors report that CLIP pre-training, rather than ensembling, drives accuracy in their study of in-house configurations on the same benchmark split.
shows that CLIP pre-training rather than ensembling drives accuracy
Source-stated
The authors recommend measuring per-class selection criteria outside the early-stopping split.
We recommend per-class selection criteria measured off the early-stopping split.
Source and contributor context
Nakib, Md., Sarkar, Sudipto, Talukder, A. J. A. Jubayer, Haque, Mohammad Ariful · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Held-out set
Data kept aside during training and used only to test how well a model works on examples it has not seen.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9f97fa22-229a-424d-89f6-2d718dd9fd2d.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-13T20:05:30.233Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 7c2daa1ed9ce16077fd61b1a19e326d4daa4a8fb600c1ce2429823a6b34a60c8. Source text hash: 3aa1d53ce08692b07e4e599dade10c9768b9f1635fca0bb11076bf7213839097.
uncertain · 2026-11-13T20:05:30.233Z · anthropic/claude-opus-5.5
Publication: 9f97fa22-229a-424d-89f6-2d718dd9fd2d
attribution — pass: The reading attributes the paper to the four listed authors on arXiv and keeps the results framed as the authors' reported findings rather than established fact.
Authors:Md. Nakib, Sudipto Sarkar, A. J. A. Jubayer Talukder, Mohammad Ariful Haque
summary — uncertain: The title says the authors argue detectors 'should average checkpoints', but their explicit recommendation is per-class selection criteria off the early-stopping split. Smallest repair: retitle around unreliable best-checkpoint selection. The summary also drops the human stake: the validation-picked checkpoint rejected 21.1% of genuine photographs, and the average was ranked last on validation. Without these, the 'this gap matters' sentence is circular. Checkpoint, validation split, AU-ROC, equal error rate and early-stopping split need plain explanation or tooltips for non-specialists.
rejecting 21.1% of genuine photographs, while the terminal average, ranked last on validation, scores 94.76%
date — pass: originalPublished 2026-10-27 matches the arXiv v1 submission date. The later feed date is correctly not used.
[Submitted on 27 Oct 2026]
support — pass: Each claim matches its excerpt. The comparisons, the OpenForensics ranking reversal, the CLIP pre-training finding and the recommendation are all source-stated. The limitations correctly note benchmark scope and the unspecified metric for the 34-point cropping cost. The question follows from the evidence and is not leading.
shows that CLIP pre-training rather than ensembling drives accuracy
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceData kept aside during training and used only to test how well a model works on examples it has not seen.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceData kept aside during training and used only to test how well a model works on examples it has not seen.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceData kept aside during training and used only to test how well a model works on examples it has not seen.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceData kept aside during training and used only to test how well a model works on examples it has not seen.
Definition reference