arXiv: Selectivity and Shape in the Design of Forward-Forward Goodness Functions

arXiv: Selectivity and Shape in the Design of Forward-Forward Goodness Functions

In their arXiv paper, Talha Ruzgar Akkus, Suayp Talha Kocabay, Kamer Ali Yuksel and Hassan Sawaf study how the local “goodness function” used by the Forward-Forward (FF) algorithm affects learning. FF trains networks layer by layer; the goodness function supplies a learning signal at each layer. The authors compare ways of measuring activity, including selective functions based on top-k and entmax-weighted energy, and objectives based on normalized higher-order moments. They propose burstiness goodness, a parameter-free, scale-invariant excess-kurtosis objective that rewards heavy-tailed activity patterns. In validation-tuned Fashion-MNIST experiments, with ReLU activation, standard label injection and per-layer scoring, burstiness raises reported accuracy from 73.2±0.9% to 88.6±0.4% compared with sum-of-squares. On CIFAR-10, with a block-local ResNet-18 and a separate per-block label pathway, reported accuracy rises from 28.9±0.5% to 46.8±2.5%. The authors say the results show activity-shape statistics can provide effective local learning signals across the tested settings. Their comparisons make the choice of activity statistic a concrete design question for FF, while the reported results concern particular datasets and configurations.

Publication: d81f1408-3d94-48ed-8ae7-baadd5ed6a20

attribution — pass: The reading correctly credits the four listed authors (Akkus, Kocabay, Yuksel, Sawaf). It keeps the proposals, results and conclusion attributed to them as reported and source-stated, not as verified facts.

Authors:Talha Ruzgar Akkus, Suayp Talha Kocabay, Kamer Ali Yuksel, Hassan Sawaf

summary — pass: The summary leads with the actors and the question studied. It explains FF and the goodness function in plain terms and keeps the source's terms exact. Scope conditions such as validation-tuned, ReLU, label injection and block-local ResNet-18 are preserved. The closing sentence draws no conclusion beyond the source. The terms excess kurtosis, heavy-tailed, top-k, entmax, Fashion-MNIST and CIFAR-10 should have term-library tooltips. Omitting five-seed and the NeurIPS acceptance is minor. The question follows from the stated limits.

These results show that activity-shape statistics can provide effective local learning signals across the tested settings.

date — pass: originalPublished 2026-03-28 matches the v1 submission date. Later revisions (v2 on 16 Apr, v3 on 5 Nov) and the Nov 6 feed date were correctly not used.

[Submitted on 28 Mar 2026 (v1), last revised 5 Nov 2026 (this version, v3)]

support — uncertain: Claim 3 states that on CIFAR-10 burstiness beat sum-of-squares. The abstract names sum-of-squares as the baseline only for Fashion-MNIST; for CIFAR-10 it gives only from/to figures under the same label pathway. The summary text itself does not name a baseline, which is fine. The smallest repair is to drop 'than sum-of-squares' from claim 3 or say 'than the baseline reported'. The other claims and the limitations are supported.

On CIFAR-10, burstiness improves block-local ResNet-18 accuracy from $28.9\pm0.5\%$ to $46.8\pm2.5\%$ under the same separate per-block label pathway.

media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to reach the source; no other source media was found.