Hong, Chaofei, Chen, Ziyang, Wang, Baochen, Jin, Christina Yi, Zhang, Qing · Oct 27, 2026
AC-JEPA combines cross-modal prediction with supervised training
Markdown · JSON · Original source
Researchers Chaofei Hong, Ziyang Chen, Baochen Wang, Christina Yi Jin and Qing Zhang introduce AC-JEPA, a method designed to translate between visual and symbolic data when paired examples may be imperfect. Their approach combines supervised (SFT), which trains against target tokens, with a joint-embedding objective that predicts intermediate representations across modalities. The authors test it on optical chemical structure recognition, where visual inputs are translated into symbolic chemical structures. On the Simple set of the WildMol , the authors report 76.07% accuracy for AC-JEPA trained on clean pairs, compared with 67.40% for SFT alone. In self-training with the same pseudo-labeled data, AC-JEPA reaches 80.23% accuracy; direct SFT falls from 67.40% to 63.47%. The authors argue that learning from continuous latent targets can better tolerate local errors in pseudo-labeled pairs than treating pseudo-tokens as hard categorical supervision. These results are limited to the reported benchmark and setup; the abstract does not establish how the method performs in other scientific domains or real-world use. How well does AC-JEPA transfer beyond optical chemical structure recognition, especially when paired data are imperfect?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-06T12:16:28.698Z. First observed: 2026-10-28T08:52:32.166Z. Retrieved: 2026-10-30T00:47:28.445Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract reports results on optical chemical structure recognition and the Simple set of the WildMol ; it does not establish performance in other domains or real-world use. The abstract does not provide details about the benchmark setup or evidence of transfer beyond the reported testbed.
Open question
How well does AC-JEPA transfer beyond optical chemical structure recognition, especially when paired data are imperfect?
Source-stated
The authors introduce AC-JEPA as a method for cross-modal translation that combines a joint-embedding objective with direct token-level supervision.
The joint-embedding objective targets cross-modal structure predictable from context, while the causal SFT path retains direct token-level supervision for the target sequence.
Source-stated
On the Simple set of the WildMol benchmark, AC-JEPA trained on clean pairs achieved 76.07% accuracy, compared with 67.40% for SFT alone.
AC-JEPA trained on clean pairs achieves 76.07% accuracy on the Simple set of the WildMol benchmark, compared with 67.40% for SFT alone.
Source-stated
With the same pseudo-labeled data, AC-JEPA-based self-training achieved 80.23% accuracy, while direct SFT accuracy fell from 67.40% to 63.47%.
Using the same pseudo-labeled data for both approaches, AC-JEPA-based self-training further raises accuracy to 80.23%, whereas accuracy under direct SFT drops from 67.40% to 63.47%.
Source-stated
The authors attribute tolerance to local errors to learning from continuous latent targets rather than treating pseudo-tokens as hard categorical supervision.
AC-JEPA learns from continuous latent targets derived from imperfect pseudo-labeled pairs, offering intrinsic tolerance to local data errors without promoting pseudo-tokens to hard categorical supervision.
Source and contributor context
Hong, Chaofei, Chen, Ziyang, Wang, Baochen, Jin, Christina Yi, Zhang, Qing · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 844b7639-b42a-4019-8bb2-fb41e72961d5.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-06T12:16:28.698Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2b7b408619e5ad040df2f7c086988d479c7463b202d65b06210be5d86819489e. Source text hash: a0040252db7f6f6726697775d74007b66ed99d89ce8b4a4ea776bcea05fe0b6e.
Revision and source-check history
Version 1 · 2026-11-06T12:16:28.698Z
AC-JEPA combines cross-modal prediction with supervised training
Researchers Chaofei Hong, Ziyang Chen, Baochen Wang, Christina Yi Jin and Qing Zhang introduce AC-JEPA, a method designed to translate between visual and symbolic data when paired examples may be imperfect. Their approach combines supervised (SFT), which trains against target tokens, with a joint-embedding objective that predicts intermediate representations across modalities. The authors test it on optical chemical structure recognition, where visual inputs are translated into symbolic chemical structures. On the Simple set of the WildMol , the authors report 76.07% accuracy for AC-JEPA trained on clean pairs, compared with 67.40% for SFT alone. In self-training with the same pseudo-labeled data, AC-JEPA reaches 80.23% accuracy; direct SFT falls from 67.40% to 63.47%. The authors argue that learning from continuous latent targets can better tolerate local errors in pseudo-labeled pairs than treating pseudo-tokens as hard categorical supervision. These results are limited to the reported benchmark and setup; the abstract does not establish how the method performs in other scientific domains or real-world use. How well does AC-JEPA transfer beyond optical chemical structure recognition, especially when paired data are imperfect?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-06T12:16:28.698Z. First observed: 2026-10-28T08:52:32.166Z. Retrieved: 2026-10-30T00:47:28.445Z.
Limits
The abstract reports results on optical chemical structure recognition and the Simple set of the WildMol ; it does not establish performance in other domains or real-world use. The abstract does not provide details about the benchmark setup or evidence of transfer beyond the reported testbed.
Open question
How well does AC-JEPA transfer beyond optical chemical structure recognition, especially when paired data are imperfect?
Source-stated
The authors introduce AC-JEPA as a method for cross-modal translation that combines a joint-embedding objective with direct token-level supervision.
The joint-embedding objective targets cross-modal structure predictable from context, while the causal SFT path retains direct token-level supervision for the target sequence.
Source-stated
On the Simple set of the WildMol benchmark, AC-JEPA trained on clean pairs achieved 76.07% accuracy, compared with 67.40% for SFT alone.
AC-JEPA trained on clean pairs achieves 76.07% accuracy on the Simple set of the WildMol benchmark, compared with 67.40% for SFT alone.
Source-stated
With the same pseudo-labeled data, AC-JEPA-based self-training achieved 80.23% accuracy, while direct SFT accuracy fell from 67.40% to 63.47%.
Using the same pseudo-labeled data for both approaches, AC-JEPA-based self-training further raises accuracy to 80.23%, whereas accuracy under direct SFT drops from 67.40% to 63.47%.
Source-stated
The authors attribute tolerance to local errors to learning from continuous latent targets rather than treating pseudo-tokens as hard categorical supervision.
AC-JEPA learns from continuous latent targets derived from imperfect pseudo-labeled pairs, offering intrinsic tolerance to local data errors without promoting pseudo-tokens to hard categorical supervision.
Source and contributor context
Hong, Chaofei, Chen, Ziyang, Wang, Baochen, Jin, Christina Yi, Zhang, Qing · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 844b7639-b42a-4019-8bb2-fb41e72961d5.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-06T12:16:28.698Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2b7b408619e5ad040df2f7c086988d479c7463b202d65b06210be5d86819489e. Source text hash: a0040252db7f6f6726697775d74007b66ed99d89ce8b4a4ea776bcea05fe0b6e.
uncertain · 2026-11-06T12:16:28.698Z · anthropic/claude-opus-5.5
Publication: 844b7639-b42a-4019-8bb2-fb41e72961d5
attribution — pass: The reading correctly names the five listed authors and attributes the method, results and interpretation to them. It keeps benchmark figures and the error-tolerance argument as the authors' reported claims.
Authors:Chaofei Hong, Ziyang Chen, Baochen Wang, Christina Yi Jin, Qing Zhang
summary — uncertain: The reading is faithful, but the terms behind its central finding are not explained for a non-specialist. Pseudo-labeled data, self-training, continuous latent targets, tokens and joint-embedding (JEPA, never expanded) are unexplained. The headline result is that AC-JEPA gains while SFT drops on imperfect pseudo-labels, so readers cannot see why that matters. Smallest repair: briefly explain pseudo-labels as model-generated, possibly wrong training answers, and self-training as learning from them. Add term-library tooltips for JEPA, SFT and latent targets. The title and question are otherwise sound.
During self-training, AC-JEPA learns from continuous latent targets derived from imperfect pseudo-labeled pairs
date — pass: The displayed original publication date of 2026-10-27 matches the arXiv v1 submission date. The later feed date is not used.
[Submitted on 27 Oct 2026]
support — pass: All four claims match the abstract, including 76.07% vs 67.40%, 80.23%, and the SFT drop to 63.47%. The limitations paragraph accurately notes that only one testbed and benchmark subset are reported. It does not invent benefits or stakeholders, and the question follows from the evidence.
Using the same pseudo-labeled data for both approaches, AC-JEPA-based self-training further raises accuracy to 80.23%, whereas accuracy under direct SFT drops from 67.40% to 63.47%.
media — pass: The selected media is the verified direct link to the original arXiv abstract page. This is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
Further training of an existing model to adapt it to a particular task or use.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceFurther training of an existing model to adapt it to a particular task or use.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference