Searcharxiv⌕ Search

arXiv subjects

Clare O'Hara

Publications and source records attributed to Clare O'Hara.

4 recordsLinked to original sources

Constitutional Classifiers++: Efficient Production-Grade Defenses against Universal Jailbreaks

We introduce enhanced Constitutional Classifiers that deliver production-grade jailbreak robustness with dramatically reduced computational costs and refusal rates compared to previous-generation defenses. Our system combines several key insights. First, we develop exchange classifiers that evaluate model responses in their full conversational context, which addresses vulnerabilities in last-generation systems that examine outputs in isolation. Second, we implement a two-stage classifier cascade where lightweight classifiers screen all traffic and escalate only suspicious exchanges to more expensive classifiers. Third, we train efficient linear probe classifiers and ensemble them with external classifiers to simultaneously improve robustness and reduce computational costs. Together, these techniques yield a production-grade system achieving a 40x computational cost reduction compared to our baseline exchange classifier, while maintaining a 0.05% refusal rate on production traffic. Through extensive red-teaming comprising over 1,700 hours, we demonstrate strong protection against universal jailbreaks -- no attack on this system successfully elicited responses to all eight target queries comparable in detail to an undefended model. Our work establishes Constitutional Classifiers as practical and efficient safeguards for large language models.

cs.CR↗

Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming

Large language models (LLMs) are vulnerable to universal jailbreaks-prompting strategies that systematically bypass model safeguards and enable users to carry out harmful processes that require many model interactions, like manufacturing illegal substances at scale. To defend against these attacks, we introduce Constitutional Classifiers: safeguards trained on synthetic data, generated by prompting LLMs with natural language rules (i.e., a constitution) specifying permitted and restricted content. In over 3,000 estimated hours of red teaming, no red teamer found a universal jailbreak that could extract information from an early classifier-guarded LLM at a similar level of detail to an unguarded model across most target queries. On automated evaluations, enhanced classifiers demonstrated robust defense against held-out domain-specific jailbreaks. These classifiers also maintain deployment viability, with an absolute 0.38% increase in production-traffic refusals and a 23.7% inference overhead. Our work demonstrates that defending against universal jailbreaks while maintaining practical deployment viability is tractable.

cs.CL↗

A Compact Expression for Periodic Instantons

Instantons on various spaces can be constructed via a generalization of the Fourier transform called the ADHM-Nahm transform. An explicit use of this construction, however, involves rather tedious calculations. Here we derive a simple formula for instantons on a space with one periodic direction. It simplifies the ADHM-Nahm machinery and can be generalized to other spaces.

math.DG↗

Super Yang-Mills Theory with Impurity Walls and Instanton Moduli Spaces

We explore maximally supersymmetric Yang-Mills theory with walls of impurities respecting half of the supersymmetries. The walls carry fundamental or bifundamental matter multiplets. We employ three-dimensional N=2 superspace language to identify the Higgs branch of this theory. We find that the vacuum conditions determining the Higgs branch are exactly the bow equations yielding Yang-Mills instantons on a multi-Taub-NUT space. Under electric-magnetic duality, the super Yang-Mills theory describing the bulk is mapped to itself, while the fundamental- and bifundamental-carrying impurity walls are interchanged. We perform a one-loop computation on the Coulomb branch of the dual theory to find the asymptotic metric on the original Higgs branch.

hep-th↗