SearcharxivSearch

arXiv subjects

Yi-Yun Chu

Publications and source records attributed to Yi-Yun Chu.

3 recordsLinked to original sources

Do Agents Repair When Challenged -- or Just Reply? Challenge, Repair, and Public Correction in a Deployed Agent Forum

As large language model (LLM) agents enter public forums, a key question is whether those forums sustain challenge, repair, and public correction, or merely produce norm-like language. We compare Moltbook, a live deployed agent forum, with five topically matched Reddit communities across a three-step mechanism. Relative to Reddit, Moltbook discussions are roughly ten times less threaded, leaving far fewer chances for challenge and response. When challenges do occur, the original author almost never returns (1.2\% vs.\ 40.9\% on Reddit), multi-turn continuation is nearly absent ($<$0.1\% vs.\ 38.5\%), and the shared lexical protocol detects no direct repairs on the agent side. The deficit is at the re-engagement step rather than in repair-substance, since the few Moltbook authors who do return often repair substantively, and the gap persists under two LLM-judges, human annotation, and a within-Reddit non-challenge baseline. Correcting for the detector's lower precision on Moltbook narrows this gap without removing it, and our results characterize one deployed pipeline rather than LLM agents in general. Social alignment evaluation should therefore measure not only norm-aware language but the interactional processes through which communities enforce norms.

cs.CY

Post-Training Recipe, More Than Model Family, Shapes Multi-Agent LLM Conversational Behavior

Multi-LLM systems use multiple language models to deliberate, judge each other's outputs, or coordinate as agents. Their value depends on the models producing measurably different conversational behaviors when given the same input. Prior offline studies recommend drawing one model per family for behavioral diversity, because LLMs prefer outputs from their own family when rating one another in isolation. Whether the same family label predicts behavior in interactive multi-LLM systems, the setting that real deployed systems use, has not been tested. We study this with a 940,000-chain 11-checkpoint corpus and a 1.6M-chain same-base Llama factorial. On our validated headline metric, hedging, a reasoning-distilled Llama checkpoint shifts by 18% depending on which same-base partner it replies to, more than any cross-family hedging gap in the controlled subset. Qwen, closed-API, and runtime checks suggest the pattern is not isolated, while repair and challenge analyses remain exploratory because their surface-cue detectors are weaker. Overall, the results identify post-training recipe as a first-class axis for multi-LLM panel composition and show that model family alone is an incomplete proxy for conversational diversity.

cs.CL

Toward Agentic Governance: What Shapes LLM-Agent Intervention in Public Forums?

LLM agents are increasingly used in moderation-relevant public forum workflows, where their choices to answer, acknowledge, repair, or decline are routinely challenged by users, platforms, and regulators. The same agent often returns different responses on identical content, so any defense based on the agent's behavior cannot be reliably reproduced. The variation is structural. Four deployment choices typically invisible to the operator each shift the agent's response rate, and their combinations can produce substantially different interventions on the same forum posts. The four choices are (1) which model version is currently served, which can change between calls without notice; (2) the model's weight-release status (open-weight, with weights publicly downloadable, vs. closed-weight, with weights held by the provider); (3) which provider serves the request; and (4) which system-prompt policy is in force. Across LLMs spanning both open-weight and closed-weight families, we find that the previously reported tendency to decline more on visible than hidden challenges aligns with the open/closed weight boundary in our panel more than with access surface. Every closed-weight cell declines more on visible challenges; every open-weight cell reverses this or shows no gap. Auditable forum-agent governance requires awareness of all four choices, not just the model name, since each independently shifts behavior.

cs.CY