Searcharxiv⌕ Search

arXiv subjects

Carolyn Semmler

Publications and source records attributed to Carolyn Semmler.

3 recordsLinked to original sources

When Reasoning looks like Hidden Understanding: How Chain-of-Thought Fosters Anthropomorphism, Perceptions of Epistemic Superiority, and Cognitive Deference

As AI-based products permeate society, specifically systems using generative models, a belief system is emerging about what these products are and what they can and cannot do. One common belief concerns the perception of the form of language as evidence of 'understanding' language. As these generative models reproduce linguistic patterns rather than understand meaning, interpreting these patterns as evidence of understanding is a misattribution. This misconception is extended by the notion that generative models can 'explain their reasoning.' Anecdotally, these misconceptions which mistake the form of language for its meaning are driving cognitive deference to AI systems in a way that displaces human agency. Such mistakes involve attributions of cognitive properties to the system, allowing them to be treated like intentional 'minds'. Importantly, perceived epistemic authority and superiority make that 'mind' worth deferring to. Anthropomorphism in tandem with epistemic authority and superiority, we argue, increases the risk that users generalise from narrow task performance to broader competencies, committing the "fallacy of composition". This paper explores misconceptions of Chain of Thought (CoT) reasoning as sufficient transparent 'explanation'. We explore how anthropomorphism acts as a vehicle for cognitive deference of decision-making and perceptions of epistemic superiority in AI systems. Finally, we explore CoT's ramifications using medicine as an example. Taken together, we conclude that explainability operationalised through CoT is highly problematic and undercuts the very ethical principles it is intended to serve. While CoT may be valuable for improving output accuracy and moderation, we suggest that the practice of asking models to provide user facing reasons for their outputs should be actively discouraged, and AI literacy training should explicitly caution against its use.

cs.AI↗

A Hybrid Theory and Data-driven Approach to Persuasion Detection with Large Language Models

Traditional psychological models of belief revision focus on face-to-face interactions, but with the rise of social media, more effective models are needed to capture belief revision at scale, in this rich text-based online discourse. Here, we use a hybrid approach, utilizing large language models (LLMs) to develop a model that predicts successful persuasion using features derived from psychological experiments. Our approach leverages LLM generated ratings of features previously examined in the literature to build a random forest classification model that predicts whether a message will result in belief change. Of the eight features tested, \textit{epistemic emotion} and \textit{willingness to share} were the top-ranking predictors of belief change in the model. Our findings provide insights into the characteristics of persuasive messages and demonstrate how LLMs can enhance models of successful persuasion based on psychological theory. Given these insights, this work has broader applications in fields such as online influence detection and misinformation mitigation, as well as measuring the effectiveness of online narratives.

cs.CL↗

A Praxis of Influence: Framing the Observation and Measurement of Information Power

Information power is the capacity to convert data flows into durable shifts in attention, belief, and behavior. We argue that this power has migrated from broadcast persuasion to platform-ized, data-driven operations that fuse computational delivery with cognitive effects. In this context, we define and bound information power within international relations and the information environment while demonstrating why observing and measuring it demands an integrated lens that combines politics (goals and governance), computing (data movement and algorithmic delivery), and psychology (attention, affect, memory, and belief). The article contributes three elements: (1) a triadic analytical framework that specifies the minimum variables and instrumentation needed for study; (2) two crosswalks that map common objectives (persuade, disrupt, shape) and target classes (leaders, elites, publics) to political, computational, and psychological tactics, yielding practical coding heuristics and testable hypotheses; and (3) a McCumber-style cube for information influence that integrates targets, operations, as well as machines (automation and AI) into a single space. The space provides for comparative analysis, data fusion, and effect measurement. Using recent cases across state and commercial platforms, we illustrate how virality, stickiness, and denial of logic exploit fast cognition, why conventional reach metrics understate impact, and where instrumentation should focus. We conclude with a mixed-methods research program coupling computational sensing including large-language-model text mining with experiments and polling. The intention is to move from detecting activity to estimating belief change and decision effects.

cs.CY↗