SearcharxivSearch

arXiv subjects

Thomas N. Robinson

Publications and source records attributed to Thomas N. Robinson.

4 recordsLinked to original sources

Within-person prediction of depressive symptom change using year-long Screenome data and CES-D assessments

Predicting whether an individual's depressive symptoms will worsen, remain stable, or improve over the coming weeks can enable earlier and more targeted care, yet prospective within-person trajectory prediction remains largely unaddressed in digital phenotyping. We combine fortnightly CES-D assessments with over 100 million screenshots captured every five seconds via the Stanford Screenomics platform from 96 adults followed for approximately one year (M = 20.9, SD = 3.9 assessments per participant, 2,002 total observations). We frame prediction as a within-person classification task: whether symptoms will worsen, remain stable, or improve over the subsequent fortnight, operationalized in three ways to capture clinically meaningful change. Under temporal holdout, XGBoost achieves an AUC of 0.906 for crossings of established CES-D severity bands and 0.755 for change relative to each participant's own within-person variability, generalizing to unseen individuals (AUC = 0.821). Each person's typical symptom level was the only statistically significant predictor above the most recent CES-D score; without it, the most consequential worsening transitions go undetected. Screenome-derived behavioral features revealed prodromal patterns of worsening, including escalating social media use, fragmented device engagement, and changes in overnight activity, with substantial individual heterogeneity. These findings establish a proof-of-concept foundation for monitoring systems that could identify individuals approaching clinical deterioration before symptoms reach a crisis point.

cs.HC

Daily Affect Fluctuations in Phone Screen Content Predict Anxiety and Depressive Symptoms

The relationship between digital media use and mental health remains poorly understood, in part because real-world digital behavior is rarely captured at scale. This intensive longitudinal study tracked participants' complete natural smartphone interactions over one year. We collected screenshots every 5 seconds from 145 adults (yielding 111 million screenshots), alongside biweekly assessments of anxiety and depression (mean = 24 surveys). The valence and arousal of each screenshot were assessed using a deep learning affect model. Individuals showed highly idiosyncratic media patterns, with substantially more variance in anxiety and depression accounted for within-person than between-person. Day-to-day fluctuations in the valence and arousal of a person's screen content predicted subsequent changes in depression and anxiety, whereas between-person differences did not. Specifically, greater exposure to low-arousal negative content was associated with higher depression and anxiety. These findings underscore the dynamic, idiosyncratic nature of digital consumption and the need for targeted measurement and intervention.

cs.HC

Clustering-based accelerometer measures to model relationships between physical activity and key outcomes

Accelerometers produce enormous amounts of data. Research that incorporates such data often involves a derived summary metric to describe physical activity. Traditional metrics have often ignored the temporal nature of the data. We build on previous work that applies unsupervised machine learning techniques to describe physical activity patterns over time. Specifically, we evaluate a summary measure of accelerometer data derived from unsupervised clustering in a regression framework through comparisons with other traditional measures: duration of time spent in different activity intensity states, Time Active Mean (TAM), Time Active Variability (TAV), Activity Intensity Mean (AIM), and Activity Intensity Variability (AIV) using data from 268 children participating in the Stanford GOALS trial. The proportion of variation explained by the new measure was comparable to that of traditional measures across regressions of three pre-specified clinical outcomes (waist circumference, fasting insulin levels, and fasting triglyceride levels). For example, cluster membership explained 25%, 11%, and 6% of the variation in waist circumference, fasting insulin levels, and fasting triglyceride levels whereas TAM explained 25%, 10%, and 6% for these same outcomes. Importantly, however, there are challenges when regressing an outcome on a variable derived from unsupervised machine learning techniques, particularly regarding replicability. This includes the processing involved in deriving the variable as well as the machine learning approach itself. While these remain open topics to resolve, our findings demonstrate the promise of a new summary measure that enables addressing questions involving a temporal component that other traditional summary metrics do not reflect.

stat.ME

Media Content Atlas: A Pipeline to Explore and Investigate Multidimensional Media Space using Multimodal LLMs

As digital media use continues to evolve and influence various aspects of life, developing flexible and scalable tools to study complex media experiences is essential. This study introduces the Media Content Atlas (MCA), a novel pipeline designed to help researchers investigate large-scale screen data beyond traditional screen-use metrics. Leveraging multimodal large language models (MLLMs), MCA enables moment-by-moment content analysis, content-based clustering, topic modeling, image retrieval, and interactive visualizations. Evaluated on 1.12 million smartphone screenshots continuously captured during screen use from 112 adults over an entire month, MCA facilitates open-ended exploration and hypothesis generation as well as hypothesis-driven investigations at an unprecedented scale. Expert evaluators underscored its usability and potential for research and intervention design, with clustering results rated 96% relevant and descriptions 83% accurate. By bridging methodological possibilities with domain-specific needs, MCA accelerates both inductive and deductive inquiry, presenting new opportunities for media and HCI research.

cs.HC