SPERA Trained on 80,000 Hours of EEG From 29,048 People and Tested on 9 Tasks

Researchers have introduced SPERA, a foundation model for EEG built on the JEPA architecture. It predicts the signal in latent space instead of reconstructing it directly. The model encodes electrode placement geometry through Legendre polynomials built into attention. Pretraining used roughly 80,000 hours of recordings from 29,048 subjects across 106 datasets. SPERA leads on mean balanced accuracy across nine downstream tasks: clinical, cognitive, and brain-computer interface. • JEPA instead of signal reconstruction • A spatial prior based on Legendre polynomials • Best mean result across 9 tasks, strong performance under linear probing

AI-processed from arXiv cs.LG; edited by Hamidun News
SPERA Trained on 80,000 Hours of EEG From 29,048 People and Tested on 9 Tasks
Source: arXiv cs.LG. Collage: Hamidun News.
Listen to article
Article Fact Sheet & Key Figures
ParameterDetails
Primary sourcearXiv cs.LG ↗
Editor-in-Chief
Key metric #1JEPA instead of signal reconstruction
Key metric #2A spatial prior based on Legendre polynomials
Key metric #3Best mean result across 9 tasks, strong performance under linear probing

The authors of the arXiv:2610.10571 preprint have introduced SPERA (Spherical Prior EEG Representation Architecture), a foundation model for electroencephalography. Pretraining used roughly 80,000 hours of recordings from 29,048 subjects across 106 datasets. On nine downstream tasks (clinical, cognitive, and brain-computer interface), the model posted the highest mean balanced accuracy among the compared solutions. The key architectural choice: SPERA predicts latent representations of the signal, not the signal itself.

Where existing EEG models break down

EEG records the brain's electrical activity cheaply and non-invasively, but building general-purpose models on it is hard. Recordings differ across subjects, hardware, and montages: some devices have 19 electrodes, others more than a hundred, and they are placed differently. A model used to one layout performs worse on another.

The second problem is the objective function. Most current EEG foundation models learn by reconstruction: mask part of the signal and ask the model to restore it. But an observed recording contains more than neural activity. It also holds non-neural components, meaning noise and artifacts. A model that tries to reproduce the signal exactly has to spend capacity on them as well.

How SPERA works

The authors use JEPA (joint-embedding predictive architecture), where prediction happens in latent space and part of the noise can be ignored. They add three EEG-specific adaptations to this scheme.

  • A spatial prior based on Legendre polynomials. It is built into attention and encodes the geometry of electrode placement on the scalp. This lets a single model work with different montages.
  • Factorized attention. Temporal and spatial attention alternate, with full-attention blocks inserted at regular intervals.
  • A relational spectral regularizer. It aligns the similarity structure in latent space with spectral representations of the signal, that is, with the frequency rhythms on which a large part of EEG analysis is built.

Key parameters from the abstract:

  • pretraining volume: about 80,000 hours of EEG;
  • subjects: 29,048;
  • data sources: 106 datasets;
  • evaluation: nine downstream tasks, balanced accuracy metric;
  • the authors also claim parameter efficiency under linear probing and robustness to different recording conditions.

The last point matters in practice. Linear probing freezes the backbone and trains only a linear head on top of the representations. If quality holds up, the embeddings themselves are informative and do not require heavy fine-tuning for each task.

Where this could be useful and what to watch

For now this is a preprint, and the abstract gives no specific metric values or names of the models SPERA was compared against. The claim of leading on mean accuracy needs to be checked against the full tables: an average over nine tasks can hide failures on individual ones. It is also worth checking which datasets went into pretraining and whether they overlap with the test sets, a common weak point in EEG benchmarks.

If the claims hold up, three groups benefit. Clinical teams can build detectors on small labeled samples by training a linear head on top of a ready-made backbone. BCI developers may depend less on a specific headset and electrode layout. Researchers working on cognitive tasks get a single base model instead of a set of narrow architectures.

The practical test for any team is this: take your own data with a nonstandard montage, freeze SPERA, train a linear classifier, and compare it with your current pipeline. If the gain holds, the approach of latent prediction with a geometric prior will become established as a standard path for EEG.

Key Questions Answered

Where existing EEG models break down?

EEG records the brain's electrical activity cheaply and non-invasively, but building general-purpose models on it is hard. Recordings differ across subjects, hardware, and montages: some devices have 19 electrodes, others more than a hundred, and they are placed differently. A model used to one layout performs worse on another. The second problem is the objective function. Most current EEG foundation models learn by reconstruction: mask part of the signal and ask the model to restore it. But an observed recording contains more than neural activity. It also holds non-neural

How SPERA works?

The authors use JEPA (joint-embedding predictive architecture), where prediction happens in latent space and part of the noise can be ignored. They add three EEG-specific adaptations to this scheme. A spatial prior based on Legendre polynomials. It is built into attention and encodes the geometry of electrode placement on the scalp. This lets a single model work with different montages. Factorized attention. Temporal and spatial attention alternate, with full-attention blocks inserted at regular intervals. A relational spectral regularizer. It aligns the similarity structur

Where this could be useful and what to watch?

For now this is a preprint, and the abstract gives no specific metric values or names of the models SPERA was compared against. The claim of leading on mean accuracy needs to be checked against the full tables: an average over nine tasks can hide failures on individual ones. It is also worth checking which datasets went into pretraining and whether they overlap with the test sets, a common weak point in EEG benchmarks. If the claims hold up, three groups benefit. Clinical teams can build detectors on small labeled samples by training a linear head on top of a ready-made bac

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Hands-On AI Engineering · Hamidun Academy

Build & Ship Production AI Agents Without Boilerplate Code

Start your free 72-hour trial at Hamidun Academy (academy.hamidun.com) — interactive lessons on Claude Code & Cursor, live Tech Radar, and production agent templates.

Start 72h Free Trial →Vibe-Coding Intensive
What do you think?
Loading comments…