arXiv subjects

Gordon Gao

Publications and source records attributed to Gordon Gao.

4 recordsLinked to original sources

arXiv2026

Beyond One-shot: AI Agents for Learning in Field Experiments

Organizations routinely run experiments for A/B testing, yet the data generated from one experiment is underutilized to inform subsequent intervention design. Significant barriers exist to extracting actionable knowledge from prior experimental data to inform new interventions. We study whether tool-augmented agentic AI can automatically learn from experimental data to generate new interventions in subsequent experiments. Through two-stage field experiments in healthcare prescription messaging (693,139 patient visits), we compare a Human + Chatbot method (Stage 1: behavioral experts with conversational AI co-designing 13 message variants, 444,691 patient visits) against a Tool-Augmented Agentic AI method (Stage 2: AI autonomously extracting principles from Stage 1 data to generate 17 new variants, 248,448 patient visits). The Agentic AI method, equipped with analytical tools, structured Data-Information-Knowledge-Wisdom (DIKW) reasoning agents, and transparent evidence chains, produces superior interventions: the best AI-generated message achieved a 69.8% CTR (+6.5 percentage points over baseline). Critically, our results suggest that the value comes from domain-specific experimental data, not from general reasoning ability: frontier LLMs operating without experimental data failed to predict which interventions would succeed. The field experiments also revealed that general-purpose behavioral theories used for intervention design do not extend uniformly to specific healthcare contexts, motivating an agentic AI approach to theory audits at field-experiment scale. Our research shows that tool-augmented AI can learn from experimental data and generate improved domain-relevant interventions, transforming behavioral experimentation from one-shot evaluation into a scalable system for cumulative design learning.

cs.AI↗

arXiv2025

Mapping Patient-Perceived Physician Traits from Nationwide Online Reviews with LLMs

Understanding how patients perceive their physicians is essential to improving trust, communication, and satisfaction. Patients increasingly consult large language models (LLMs) to summarize physician reviews and shape provider choices, yet the national landscape of patient-perceived physician traits remains poorly characterized. We present an LLM-based pipeline that extracts ten patient-perceived physician trait scores from review text: five Big-Five-style and five patient-oriented dimensions. From one million U.S. physicians, we analyze 4.1 million reviews of 226,999 physicians. We validate the pipeline through multi-model comparison and human expert benchmarking. LLM and human-rater trait scores from reviews are consistent. Trait scores correlate strongly with review rating scores yet retain substantial independent variance. Two national-scale patterns emerge: male physicians receive higher trait scores across all traits, with the largest gap in clinical competence; specialty differences are driven by encounter context, with surgical specialties leading interpersonal qualities and psychiatry lowest. Cluster analysis identifies four physician archetypes, from "Uniform High" (33.8%, high across traits) to "Uniform Low" (22.6%, low across traits). This map of LLM-derived physician traits exposes how LLMs read the U.S. clinical workforce. Pending clinical validation, it opens future research on fairness, bias, and how LLM-mediated provider search shapes patient choice.

cs.CL↗

arXiv2025

PAME-AI: Patient Messaging Creation and Optimization using Agentic AI

Messaging patients is a critical part of healthcare communication, helping to improve things like medication adherence and healthy behaviors. However, traditional mobile message design has significant limitations due to its inability to explore the high-dimensional design space. We develop PAME-AI, a novel approach for Patient Messaging Creation and Optimization using Agentic AI. Built on the Data-Information-Knowledge-Wisdom (DIKW) hierarchy, PAME-AI offers a structured framework to move from raw data to actionable insights for high-performance messaging design. PAME-AI is composed of a system of specialized computational agents that progressively transform raw experimental data into actionable message design strategies. We demonstrate our approach's effectiveness through a two-stage experiment, comprising of 444,691 patient encounters in Stage 1 and 74,908 in Stage 2. The best-performing generated message achieved 68.76% engagement compared to the 61.27% baseline, representing a 12.2% relative improvement in click-through rates. This agentic architecture enables parallel processing, hypothesis validation, and continuous learning, making it particularly suitable for large-scale healthcare communication optimization.

cs.AI↗

arXiv2024

A Large Sensor Foundation Model Pretrained on Continuous Glucose Monitor Data for Diabetes Management

Continuous glucose monitoring (CGM) combined with AI offers new opportunities for proactive diabetes management through real-time glucose forecasting. However, most existing models are task-specific and lack generalization across patient populations. Inspired by the autoregressive paradigm of large language models, we introduce CGM-LSM, a Transformer decoder-based Large Sensor Model (LSM) pretrained on 1.6 million CGM records from patients with different diabetes types, ages, and genders. We model patients as sequences of glucose time steps to learn latent knowledge embedded in CGM data and apply it to the prediction of glucose readings for a 2-hour horizon. Compared with prior methods, CGM-LSM significantly improves prediction accuracy and robustness: a 48.51% reduction in root mean square error in one-hour horizon forecasting and consistent zero-shot prediction performance across held-out patient groups. We analyze model performance variations across patient subgroups and prediction scenarios and outline key opportunities and challenges for advancing CGM foundation models.

q-bio.QM↗