Category: Alignment & Safety

A focused look at this week’s most significant advances in alignment & safety — 4 papers surveyed from arXiv and leading AI labs. — Safety research is broadening from alignment to encompass robustness, interpretability, and the systemic risks of deployed AI. This week brings new attacks, new defenses, and deeper understanding of model internals. Key…

Safety and alignment research continues to mature rapidly in W28, with papers addressing everything from constitutional classifiers and unlearning techniques to watermarking and jailbreak prevention. As AI systems are deployed more widely, the research community is responding with increasingly sophisticated approaches to keeping them beneficial. Key Developments This Week Constitutional and Classifier-Based Safety. HaloGuard 1.0…

Safety and alignment research continues to mature rapidly in W28, with papers addressing everything from constitutional classifiers and unlearning techniques to watermarking and jailbreak prevention. As AI systems are deployed more widely, the research community is responding with increasingly sophisticated approaches to keeping them beneficial. Key Developments This Week Constitutional and Classifier-Based Safety. HaloGuard 1.0…

A focused look at this week’s most significant advances in alignment & safety — 4 papers surveyed from arXiv and leading AI labs. — Safety research is broadening from alignment to encompass robustness, interpretability, and the systemic risks of deployed AI. This week brings new attacks, new defenses, and deeper understanding of model internals. Key…

Agent research had a breakthrough week, with advances in skill optimization, long-horizon memory management, and production-scale deployment of autonomous code review. SkillOpt: Training Agent Skills Like Neural Network Weights SkillOpt by Yifan Yang et al. introduces the first systematic controllable text-space optimizer for agent skills. An optimizer model turns scored rollouts into bounded add/delete/replace edits…