SafeGene: Reusable Adapters for Transferable Safety Alignment
Quick Answer
SafeGene introduces a reusable safety-adapter module for open-weight LLMs, enhancing safety alignment without compromising performance.
Quick Take
It effectively reduces harmful response rates across various model families while maintaining downstream task efficiency, outperforming existing safe adaptation methods in safety-utility trade-offs.
Key Points
- SafeGene decouples safety capability from task-specific updates for better adaptability.
- It utilizes aligned-degraded model discrepancies to create transferable safety vectors.
- Experiments show reduced harmful response rates while maintaining performance across tasks.
- SafeGene outperforms traditional safe adaptation methods in safety-utility trade-offs.
- The approach is applicable across multiple architecture-compatible model families.
Paper Resources
Source Excerpt
arXiv:2606. 06519v1 Announce Type: new Abstract: Open-weight are increasingly fine-tuned into customized assistants, but downstream fine-tuning can weaken safety alignment and make models more vulnerable to malicious prompts, even when the training data is not intentionally harmful. This creates a recurring safety recovery problem as target models are repeatedly updated with new task data or user interactions.
We propose SafeGene, a reusable safety-adapter module designed for cross-task reuse within each architecture-compatible model family. …
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →RAIL Guard: Closing the Evaluation-to-Remediation Gap in Responsible AI for Agents
RAIL Guard introduces a closed-loop AI pipeline for large language models (LLMs) that evaluates outputs across eight dimensions and iteratively remediates failures, achieving 96.9% convergence compared to 49.1% for traditional block-and-retry methods. The system reduces unsafe agent executions by 33% without impacting task completion and is available as open-source SDKs.