SearcharxivSearch

arXiv subjects

Daniel Zhu

Publications and source records attributed to Daniel Zhu.

3 recordsLinked to original sources

New bounds on randomized metric distortion of top-$k$ voting

We prove new upper and lower bounds on metric distortion for randomized social choice mechanisms. Under first-choice voting where each voter reports only their most preferred candidate, we show that selecting a candidate with probability proportional to the $\frac{n}{n-1}$-th power of their vote share achieves the optimal worst-case distortion of $3 - \frac{2}{n}$. This is a simpler single-rule alternative to prior work. We also study instance-specific metric distortion of first-choice mechanisms in terms of the vote vector $\nu$. We show that there is a uniquely optimal rule achieving distortion $1 + \frac{2}{\sum_i \frac{\nu_i}{1 - \nu_i}}$. Finally, we extend our results to top-$k$ voting where each voter reports their $k$ nearest candidates. We derive a formula for the worst-case distortion for any $k\ge 2$. For the cyclic profile family this improves the previously best known $3 - \frac{2}{\lfloor \frac{n}{k} \rfloor}$ lower bound.

cs.GT

Jailbroken Frontier Models Retain Their Capabilities

As language model safeguards become more robust, attackers are pushed toward developing increasingly complex jailbreaks. Prior work has found that this complexity imposes a "jailbreak tax" that degrades the target model's task performance. We show that this tax scales inversely with model capability and that the most advanced jailbreaks effectively yield no reduction in model capabilities. Evaluating 28 jailbreaks on five benchmarks across Claude models ranging in capability from Haiku 4.5 to Opus 4.6, we find Haiku 4.5 loses an average of 33.1% on benchmark performance when jailbroken, while Opus 4.6 at max thinking effort loses only 7.7%. We also observe that across all models, reasoning-heavy tasks display considerably more degradation than knowledge-recall tasks. Finally, Boundary Point Jailbreaking, currently the strongest jailbreak against deployed classifiers, achieves near-perfect classifier evasion with near-zero degradation across safeguarded models. We recommend that safety cases for frontier models should not rely on a meaningful capability degradation from jailbreaks.

cs.LG

AI Organizations are More Effective but Less Aligned than Individual Agents

AI is increasingly deployed in multi-agent systems; however, most research considers only the behavior of individual models. We experimentally show that multi-agent "AI organizations" are simultaneously more effective at achieving business goals, but less aligned, than individual AI agents. We examine 12 tasks across two practical settings: an AI consultancy providing solutions to business problems and an AI software team developing software products. Across all settings, AI Organizations composed of aligned models produce solutions with higher utility but greater misalignment compared to a single aligned model. Our work demonstrates the importance of considering interacting systems of AI agents when doing both capabilities and safety research.

cs.AI