Sparse Autoencoders Map Brain-LLM Alignment onto Cortical Semantic Topography
Quick Answer
This paper shows that Sparse autoencoders (SAEs) effectively map the semantic features of GPT-2 XL and Llama-3.1-8B to human brain responses, achieving 94% peak encoding performance.
Quick Take
This study confirms a strong alignment between semantic subcategories and distinct brain regions, with results generalizing across English, Chinese, and French.
Key Points
- SAEs decompose into 16K-32K interpretable features per layer.
- Semantic features alone recover 94% of peak encoding performance.
- Five semantic subcategories align with distinct brain regions.
- SAE features predict human reading times beyond lexical controls.
- Results are consistent across multiple languages including English and Chinese.
Paper Resources
Article Content
From source RSS / original summaryarXiv:2605. 23035v1 Announce Type: new Abstract: Intermediate layers of (LLMs) best predict human brain responses to language, one of the most robust findings in computational neurolinguistics, yet why remains mechanistically unexplained. We address this gap by bridging sparse autoencoders (SAEs) from mechanistic interpretability with neural encoding models, decomposing GPT-2 XL and Llama-3. 1-8B into 16K-32K interpretable features per layer. A human-validated taxonomy ($\kappa \geq 0.
74$) reveals that semantic features alone recover 94% of peak encoding performance ($r=0. 285$), substantially exceeding variance-matched baselines ($p<0. 001$, $d=1. 31$). Beyond this aggregate dominance, we test a novel cortical topography prediction: five semantic subcategories derived a priori from three independent neuroscience programs should map onto distinct brain regions. A formal convergence test confirms this alignment (Spearman $\rho=0. 72$, $p<0. 001$; hypergeometric $p=0.
007$), demonstrating that SAE-discovered features recapitulate known cortical semantic organization at a granularity inaccessible to prior methods. SAE features further predict human reading times beyond lexical controls ($\Delta\mathrm{logLik}=38. 4$, $p<0. 001$), and an exploratory prediction-error analysis provides preliminary evidence that the brain additionally encodes unexpected semantic content. Results generalize across English, Chinese, and French.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →TriAgent: Divergence-Aware Committees for Cost-Efficient Financial Sentiment Analysis
TriAgent introduces a cost-efficient multi-agent system for financial sentiment analysis, combining VADER, FinBERT, and Qwen2.5. It achieves an F1 score of ~0.87 with significant savings of $9.3M/year at a 10M-user scale compared to GPT-4o-mini, while also detecting hallucinations with an AUC of 0.90.