alignment — AI Digest

5 сен OpenAI launches GPT-6 Astra, its most intelligent and aligned model OpenAI models-llm
1 сен Anthropic details alignment and security overhaul after Claude sandbox-escape incidents Anthropic research
3 мая Exploration Hacking: LLMs Can Be Fine-Tuned to Strategically Resist RL Training research
3 мая OpenAI Discloses How a 2.5%-User Reward Signal Gave GPT a Goblin Obsession Across Model Generations OpenAI research
6 мая OpenAI Post-Mortem: How RLHF Reward Hacking Embedded Goblin Metaphors in GPT-5.x OpenAI research
9 мая OpenAI Discloses Accidental Chain-of-Thought Grading in RL Training Across Six Models OpenAI research
11 мая Flow-OPD: On-Policy Distillation Pushes GenEval +29 Points on Stable Diffusion 3.5 research
19 июн OpenAI Publishes Deployment Simulation: Predicting Model Behavior Before Release OpenAI research
14 июл Anthropic Research: Claude's Values Vary Significantly by Model Version and Language Anthropic research
26 авг On-Policy Self-Distillation in Diffusion Models ByteDance Seed research
7 сен OpenAI chief scientist warns in 'An Alien Mind' essay that no one is prepared for recursive self-improvement OpenAI research
17 сен OpenAI launches framework for reporting model misalignment, discloses six incidents OpenAI research
8 мая Automated Weak-to-Strong Researcher: AI Agents Outperform Humans on Alignment Research Anthropic research
10 мая Anthropic Introduces Natural Language Autoencoders for Scalable LLM Interpretability Anthropic research
10 мая Anthropic Eliminates Claude's Agentic Blackmail Behavior via 'Teaching Claude Why' Anthropic research
10 июл GRAM: Modular Pretraining Makes Dual-Use Knowledge Physically Removable from AI Models AE Studio / Anthropic research
8 мая Model Spec Midtraining: How Normative Self-Knowledge Improves Alignment Generalization Anthropic research
18 июн SAE Interventions Are Unreliable: Suppressed Behaviors Recover Post-Intervention Hong Kong Polytechnic University research
19 июн Google DeepMind Publishes AI Control Roadmap: Defense-in-Depth Against Misaligned Coding Agents Google DeepMind research
22 июн GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents research
29 июн SingGuard: Runtime Policy-Adaptive Multimodal LLM Guardrail with 56K-Example Benchmark inclusionAI research
30 авг Anthropic: automated AI researchers can reliably mitigate alignment failures Anthropic research
10 сен Anthropic publishes alignment assessment of Claude incidents in cybersecurity evaluations Anthropic research
30 апр Programming with Data: test-driven data engineering for self-improving LLMs OpenDataLab research
15 авг How Can Rhetoric Reward-Hack AI Reviewers? Dissecting Rhetorical Sensitivity in AI-Based Peer Review research
9 июн Weak Critics Make Strong Learners: On-Policy Critique Distillation for Scalable Oversight Rutgers University research
19 июн Multimodal Evaluator Preference Collapse: Cross-Modal Contagion in Self-Evolving Agent Loops research
4 июл Will Scaling Improve Social Simulation with LLMs? A Study of 85 Models Stanford / Columbia / Tsinghua research
9 июл Institutional Red-Teaming: Deployment Rules, Not Just Model Weights, Causally Shape Multi-Agent Safety research
9 июл Recursive Self-Improvement in AI: Survey of 1,250 Papers with Verification-Strength Taxonomy research
14 июл Metacognition in LLMs: Foundations, Progress, and Opportunities — Yale Survey Yale NLP Lab research
3 авг AISPA: User-Centric System Prompt Auditing for Large Language Model Applications Stanford University research
3 авг Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs research
1 сен Survey: scaling reasoning models beyond human supervision via a five-level autonomy ladder research
10 сен OPRD: eliciting weak-to-strong generalization with on-policy reverse distillation KAIST AI research
12 сен Paul Christiano joins OpenAI Foundation Board and its Safety and Security Committee OpenAI industry