The Culture Funnel: You Can't Align What isn't in the Data
Quick Answer
This paper shows that Current cultural alignment methods in LLMs are hindered by a cultural data funnel, with explicit cultural signals declining post-training.
Quick Take
A new multidimensional tagging framework reveals that while multilinguality increases geographic diversity, it does not guarantee balanced representation. The authors released a culturally tagged dataset of 5.6M samples to enhance cultural benchmark performance.
Key Points
- Cultural signals in decline sharply during post-training phases.
- Geographically concentrated, task-specialized data dominates current training datasets.
- Multilinguality enhances geographic diversity but lacks balanced cultural representation.
- A new dataset with 5.6M samples is released to improve cultural benchmarks.
- Shifting focus in training data pipelines is essential for cultural alignment.
Paper Resources
Article Excerpt
From source RSS / original summaryarXiv:2606. 13808v1 Announce Type: new Abstract: Current cultural alignment approaches focus on inference-time interventions, assuming models already contain sufficient cultural knowledge. We argue modern pipelines suffer from a cultural data funnel. Using a multidimensional tagging framework across pretraining, fine-tuning, alignment, and reasoning datasets, we show explicit cultural signals decline sharply during post-training, while geographically concentrated, task-specialized data dominates.
Multilinguality enhances geographic diversity of cultural knowledge but does not ensure balanced representation. Our tags improve downstream cultural benchmark performance, demonstrating that advances require shifting focus in training data pipelines. To facilitate future research, we release our culturally tagged dataset with 5. 6M samples at https://huggingface. co/datasets/CohereLabs/CultureMarkers.
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →TriAgent: Divergence-Aware Committees for Cost-Efficient Financial Sentiment Analysis
TriAgent introduces a cost-efficient multi-agent system for financial sentiment analysis, combining VADER, FinBERT, and Qwen2.5. It achieves an F1 score of ~0.87 with significant savings of $9.3M/year at a 10M-user scale compared to GPT-4o-mini, while also detecting hallucinations with an AUC of 0.90.