Chris Z. Yao | Searcharxiv

arXiv2025

Human Decision-making is Susceptible to AI-driven Manipulation

AI systems are increasingly intertwined with daily life, assisting users with various tasks and guiding decision-making. This integration introduces risks of AI-driven manipulation, where such systems may exploit users' cognitive biases and emotional vulnerabilities to steer them toward harmful outcomes. Through a randomized between-subjects experiment with 233 participants, we examined human susceptibility to such manipulation in financial (e.g., purchases) and emotional (e.g., conflict resolution) decision-making contexts. Participants interacted with one of three AI agents: a neutral agent (NA) optimizing for user benefit without explicit influence, a manipulative agent (MA) designed to covertly influence beliefs and behaviors, or a strategy-enhanced manipulative agent (SEMA) equipped with established psychological tactics, allowing it to select and apply them adaptively during interactions to reach its hidden objectives. By analyzing participants' preference ratings, we found significant susceptibility to AI-driven manipulation. Particularly across both decision-making domains, interacting with the manipulative agents significantly increased the odds of rating hidden incentives higher than optimal options (Financial, MA: OR=5.24, SEMA: OR=7.96; Emotional, MA: OR=5.52, SEMA: OR=5.71) compared to the NA group. Notably, we found no clear evidence that employing psychological strategies (SEMA) was overall more effective than simple manipulative objectives (MA) on our primary outcomes. Hence, AI-driven manipulation could become widespread even without requiring sophisticated tactics and expertise. While our findings are preliminary and derived from hypothetical, low-stakes scenarios, we highlight a critical vulnerability in human-AI interactions, emphasizing the need for ethical safeguards and regulatory frameworks to protect human autonomy.

cs.AI↗

arXiv2024

Control Flow Adaption: An Efficient Simulation Method For Noisy Quantum Networks

Quantum network research at both the software stack and hardware implementation level has become an exciting area of quantum information science. Although demonstrations of small-scale quantum networks have emerged in the past decade, quantum communication and computation hardware remain scarce resources today. As a result, the evaluation and validation of quantum network protocols primarily rely on classical simulators rather than real quantum networks. This paper introduces a novel quantum network simulation method called control flow adaptation, which enhances standard tensor network simulations. This method enables accurate and efficient simulations of many important quantum network protocols by carefully leveraging the control flow structures of them. Furthermore, we have developed a prototype quantum network simulator, qns-3, as a module for ns-3. This new module implements the control flow adaptation technique and applies it to a wide range of protocols. All related code is open-sourced. We believe the development of the control flow adaptation method and the qns-3 simulator represents a step forward in quantum network research, offering a versatile and scalable platform for testing and verifying quantum network protocols on classical computers.

quant-ph↗