SearcharxivSearch

arXiv subjects

Steven Morse

Publications and source records attributed to Steven Morse.

3 recordsLinked to original sources

Comment-level Topic Drift Analysis in the Reddit Corpus

We present a novel application of embedding-based dynamic topic modeling techniques to detect and quantify topic drift at the comment level in a massive corpus. By leveraging pretrained language models to generate contextualized semantic embeddings for short text, we analyzed 12.7 billion Reddit comments spanning 2006 to 2022. Using unsupervised methods on these embeddings, we identify dynamically evolving topic clusters over time. Our primary contribution is a methodology for analysis of semantic drift and discourse evolution in the embedding space itself. We also demonstrate modifications to existing methods that enable this analysis at scale, and we propose and demonstrate a null model comparison test to filter spurious dynamics. Key findings suggest that politically and socially contentious topics exhibit significant directional drift in embedding space, with inter-topic distances changing systematically over time beyond what the null model can explain, whereas domains such as music and sports remain comparatively stable.

cs.CL

Modeling Human Dynamics and Lifestyle Using Digital Traces

Human behavior drives a range of complex social, urban, and economic systems, yet understanding its structure and dynamics at the individual level remains an open question. From credit card transactions to communications data, human behavior appears to exhibit bursts of activity driven by task prioritization and periodicity, however, current research does not offer generative models capturing these mechanisms. We propose a multivariate, periodic Hawkes process (MPHP) model that captures -- at the individual level -- the temporal clustering of human activity, the interdependence structure and co-excitation of different activities, and the periodic effects of weekly rhythms. We also propose a scalable parameter estimation technique for this model using maximum-aposteriori expectation-maximization that additionally provides estimation of latent variables revealing branching structure of an individual's behavior patterns. We apply the model to a large dataset of credit card transactions, and demonstrate the MPHP outperforms a non-homogeneous Poisson model and LDA in both statistical fit for the distribution of inter-event times and an activity prediction task.

cs.SI

Trace Diagrams, Matrix Minors, and Determinant Identities

Trace diagrams are structured graphs with edges labeled by matrices. Each diagram has an interpretation as a particular multilinear function. We provide a rigorous combinatorial definition of these diagrams using a notion of signed graph coloring, and prove that they may be efficiently represented in terms of matrix minors. Using this viewpoint, we provide new proofs of several standard determinant formulas and a new generalization of the Jacobi determinant theorem.

math.CO