Searcharxiv⌕ Search

arXiv subjects

Erin Wertz

Publications and source records attributed to Erin Wertz.

3 recordsLinked to original sources

Using LLM Agents to Evaluate Prosocial Interventions on Social Media Platforms

Social media platforms are a primary source of information for many users. Although research explores various interventions to promote prosocial content or demote harmful content on platforms, there are few systematic methods for evaluating competing intervention designs before conducting costly human-subject experiments. We develop a simulation-based evaluation pipeline built on the OASIS framework. We generate 13,835 LLM-based agents, each with a unique profile. Over 20 time steps, we expose them to real-world Twitter/X posts and let them comment, like, repost, or follow. We use those agents to systematically evaluate three interventions that increase exposure to verified news: adding content, upranking content, and celebrity source cues. All interventions significantly increase news engagement, with upranking news to prominent feed positions producing the largest effects. These effects hold across agents' gender, age, and education levels. We validate our injection treatment results against a comparable human-subject study and find strong directional alignment and similar dose-normalized efficiency. Our results suggest that LLM-based agent simulations can support early-stage evaluation of platform interventions before human-subject deployment, and upranking may be more effective than news volume or source.

cs.SI↗

AI-Powered Browsers Are Broadly Accurate News Summarizers That Reduce Political Bias and Negative Affect

Web browsers now provide AI-generated news summaries for millions of users. Despite their popularity and influence, we lack a systematic understanding of how these systems transform news before people read it. Through a large-scale audit, we investigate the factual accuracy of browser-based AI summarizers and how they alter the political bias, negative affect, and journalistic writing quality of news. Drawing on 13,777 articles from 15 U.S. news outlets, we evaluate their 41,331 summaries generated by three leading AI-powered browsers: Google Chrome (Gemini), Microsoft Edge (Copilot), and Perplexity Comet. We find that browser-based AI summarizers are broadly accurate. Furthermore, they consistently transform news by attenuating ideological bias, partisan stances, negativity, anger, and fear, while increasing clarity and reducing personal tone. With some variations, these patterns hold across browsers, outlet ideologies, and topics. Our findings identify AI-powered browsers as a new class of editorial intermediaries that systematically reshape news, with implications for democratic discourse and AI governance.

cs.CY↗

Changes to the Facebook Algorithm Decreased News Visibility Between 2021-2024

Platforms, especially Facebook, are primary news sources in the US. In its widely criticized "War on News," Meta algorithmically deprioritized news and political content. We use data from 40 news organizations (5,243,302 Facebook posts, 7,875,372,958 user reactions) and 21 non-news pages (396,468 posts; 1,909,088,308 reactions) between January 1, 2016 and February 13, 2025 to examine how these changes influenced news visibility on the platform. Reactions to news declined by 78% between 2021 and 2024 while reactions to non-news pages increased, indicating targeted suppression of news visibility. Low-quality sources were especially suppressed, yet the 2025 end to "War on News" increased user reactions to news, especially low-quality ones. These changes do not reflect decreased news supply, Facebook user base, or interest in news over this period.

cs.SI↗