AI Glossary
What is LiveCodeBench?
Overview
LiveCodeBench is a coding benchmark built from recent programming tasks to evaluate code generation and problem solving. It matters because using newer tasks helps reduce benchmark contamination, making it harder for models to succeed by memorizing older public examples.
Why it matters
LiveCodeBench is useful for tracking whether coding models improve on fresh problems, not just familiar benchmark sets.
Where it appears in AI research
- Code generation evaluations
- AI coding model releases
- Contamination-resistant benchmarks
- Developer tool comparisons
Related terms
Related DeepSignal articles
Procedural Memory Distillation: Online Reflection for Self-Improving Language Models
Procedural Memory Distillation (PMD) enhances reinforcement learning by converting cross-episode signals into reusable memory, improving Qwen3-8B and OLMo3-Instruct-7B models by 3.8-5.5% on SCIKNOWEVAL and 7.9-13.6% on . The co-evolution of policy and memory allows for more effective self-supervision, demonstrating significant performance gains when both components are active.