arXiv subjects

Jeffrey Cohn

Publications and source records attributed to Jeffrey Cohn.

13 recordsLinked to original sources

arXiv2026

Beyond the Fold: Quantifying Split-Level Noise and the Case for Leave-One-Dataset-Out AU Evaluation

Subject-exclusive cross-validation is the standard evaluation protocol for facial Action Unit (AU) detection, yet reported improvements are often small. We show that cross-validation itself introduces measurable stochastic variance. On BP4D+, repeated 3-fold subject-exclusive splits produce an empirical noise floor of $\pm 0.065$ in average F1, with substantially larger variation for low-prevalence AUs. Operating-point metrics such as F1 fluctuate more than threshold-independent measures such as AUC, and model ranking can change under different fold assignments. We further evaluate cross-dataset robustness using a Leave-One-Dataset-Out (LODO) protocol across five AU datasets. LODO removes partition randomness and exposes domain-level instability that is not visible under single-dataset cross-validation. Together, these results suggest that gains often reported in cross-fold validation may fall within protocol variance. Leave-one-dataset-out cross-validation yields more stable and interpretable findings

cs.CV↗

arXiv2025

Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos

Computational measurement of human behavior from video has recently become feasible due to major advances in AI. These advances now enable granular and precise quantification of facial expression, head movement, body action, and other behavioral modalities and are increasingly used in psychology, psychiatry, neuroscience, and mental health research. However, mainstream adoption remains slow. Most existing methods and software are developed for engineering audiences, require specialized software stacks, and fail to provide behavioral measurements at a level directly useful for hypothesis-driven research. As a result, there is a large barrier to entry for researchers who wish to use modern, AI-based tools in their work. We introduce Bitbox, an open-source toolkit designed to remove this barrier and make advanced computational analysis directly usable by behavioral scientists and clinical researchers. Bitbox is guided by principles of reproducibility, modularity, and interpretability. It provides a standardized interface for extracting high-level behavioral measurements from video, leveraging multiple face, head, and body processors. The core modules have been tested and validated on clinical samples and are designed so that new measures can be added with minimal effort. Bitbox is intended to serve both sides of the translational gap. It gives behavioral researchers access to robust, high-level behavioral metrics without requiring engineering expertise, and it provides computer scientists a practical mechanism for disseminating methods to domains where their impact is most needed. We expect that Bitbox will accelerate integration of computational behavioral measurement into behavioral, clinical, and mental health research. Bitbox has been designed from the beginning as a community-driven effort that will evolve through contributions from both method developers and domain scientists.

cs.CV↗

arXiv2025

Digital Quantum Simulation of Spin Transport

Understanding transport phenomena in quantum spin systems has long intrigued physicists due to their potential applications in spintronic devices and spin qubits. Here, using a superconducting-qubit-based transmon device, we show that pre-fault-tolerant digital quantum simulation is reliable for studying transport phenomena via spin-current autocorrelation function (ACF). While quantum simulations of the spin-spin ACF have been used to probe spin transport, methods based on the spin-current ACF have yet to be demonstrated due to their high gate cost, despite offering more direct information relevant to the transport properties. Overcoming the resource constraints set by indirect measurement schemes like the Hadamard test, we showcase a direct measurement scheme that utilizes non-unitary operations, in particular mid-circuit measurements, to investigate spin transport for the 40-site 1D XXZ Heisenberg model in the near-ballistic, superdiffusive, and diffusive regimes. We successfully reproduce the expected power-law behavior in the superdiffusive regime and vanishing of the Drude weight in the diffusive regime.

quant-ph↗

arXiv2025

Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning frameworks for Action Unit (AU) detection. Despite intense efforts spanning three decades, the detection accuracy for many AUs is considered to be below the threshold needed for behavioral research. Also, many AUs are excluded altogether, making it impossible to fulfill the ultimate goal of FACS-the representation of any facial expression in its entirety. This paper considers an alternative approach. Instead of creating automated tools that mimic FACS experts, we propose to use a new coding system that mimics the key properties of FACS. Specifically, we construct a data-driven coding system called the Facial Basis, which contains units that correspond to localized and interpretable 3D facial movements, and overcomes three structural limitations of automated FACS coding. First, the proposed method is completely unsupervised, bypassing costly, laborious and variable manual annotation. Second, Facial Basis reconstructs all observable movement, rather than relying on a limited repertoire of recognizable movements (as in automated FACS). Finally, the Facial Basis units are additive, whereas AUs may fail detection when they appear in a non-additive combination. The proposed method outperforms the most frequently used AU detector in predicting autism diagnosis from in-person and remote conversations, highlighting the importance of encoding facial behavior comprehensively. To our knowledge, Facial Basis is the first alternative to FACS for deconstructing facial expressions in videos into localized movements. We provide an open source implementation of the method at github.com/sariyanidi/FacialBasis.

cs.CV↗

arXiv2025

Superdiffusion resilience in Heisenberg Chains with 2D interactions on a quantum processor

Observing superdiffusive scaling in the spin transport of the integrable 1D Heisenberg model is one of the key discoveries in non-equilibrium quantum many-body physics. Despite this remarkable theoretical development and the subsequent experimental observation of the phenomena in KCuF$_3$, real materials are often imperfect and contain integrability breaking interactions. Understanding the effect of such terms on the superdiffusion is crucial in identifying connections to such materials. Current quantum hardware has already ascertained its utility in studying such non-equilibrium phenomena by simulating the superdiffusion of the 1D Heisenberg model. In this work, we perform a quantum simulation of the superdiffusion breakdown by generalizing the superdiffusive Floquet-type 1D Heisenberg model to a general 2D model. We comprehensively study the effect of different 2D interactions on the superdiffusion breakdown by tuning up their strength from zero, corresponding to the 1D Heisenberg chain, to finite nonzero values. We observe that certain 2D interactions are more resilient against superdiffusion breakdown than others and that the $SU(2)$ preserving 2D interaction has the highest resilience among all the 2D interactions we study. Importantly, this observed resilience has direct implications for sustaining superdiffusive spin transport in two-dimensional lattices. We reason out the relative resilience against the superdiffusion breakdown through an analysis of the scattering coefficients off the 2D interaction in otherwise 1D chains. The relative resilience of different interaction types against superdiffusion breakdown was also captured in quantum hardware with remarkable accuracy, further establishing the current quantum hardware's applicability in simulating interesting non-equilibrium quantum many-body phenomena.

quant-ph↗

arXiv2023

Subspace methods for electronic structure simulations on quantum computers

Quantum subspace methods (QSMs) are a class of quantum computing algorithms where the time-independent Schrodinger equation for a quantum system is projected onto a subspace of the underlying Hilbert space. This projection transforms the Schrodinger equation into an eigenvalue problem determined by measurements carried out on a quantum device. The eigenvalue problem is then solved on a classical computer, yielding approximations to ground- and excited-state energies and wavefunctions. QSMs are examples of hybrid quantum-classical methods, where a quantum device supported by classical computational resources is employed to tackle a problem. QSMs are rapidly gaining traction as a strategy to simulate electronic wavefunctions on quantum computers, and thus their design, development, and application is a key research field at the interface between quantum computation and electronic structure. In this review, we provide a self-contained introduction to QSMs, with emphasis on their application to the electronic structure of molecules. We present the theoretical foundations and applications of QSMs, and we discuss their implementation on quantum hardware, illustrating the impact of noise on their performance.

quant-ph↗

arXiv2023

Gibbs state sampling via cluster expansions

Gibbs states (i.e., thermal states) can be used for several applications such as quantum simulation, quantum machine learning, quantum optimization, and the study of open quantum systems. Moreover, semi-definite programming, combinatorial optimization problems, and training quantum Boltzmann machines can all be addressed by sampling from well-prepared Gibbs states. With that, however, comes the fact that preparing and sampling from Gibbs states on a quantum computer are notoriously difficult tasks. Such tasks can require large overhead in resources and/or calibration even in the simplest of cases, as well as the fact that the implementation might be limited to only a specific set of systems. We propose a method based on sampling from a quasi-distribution consisting of tensor products of mixed states on local clusters, i.e., expanding the full Gibbs state into a sum of products of local "Gibbs-cumulant" type states easier to implement and sample from on quantum hardware. We begin with presenting results for 4-spin linear chains with XY spin interactions, for which we obtain the $ZZ$ dynamical spin-spin correlation functions. We also present the results of measuring the specific heat of the 8-spin chain Gibbs state $\rho_8$.

quant-ph↗

arXiv2023

High-fidelity dimer excitations using quantum hardware

Many-body entangled quantum spin systems exhibit emergent phenomena such as topological quantum spin liquids with distinct excitation spectra accessed in inelastic neutron scattering (INS) experiments. Here we simulate the dynamics of a quantum spin dimer, the basic quantum unit of emergent many-body spin systems. While canonical Trotterization methods require deep circuits precluding long time-scale simulations, we demonstrate 'direct' Resource-Efficient Fast-forwarding (REFF) measurements with short-depth circuits that can be used to capture longer time dynamics on quantum hardware. The temporal evolution of the 2-spin correlation coefficients enabled the calculation of the dynamical structure factor $S(\mathbf{Q},\omega)$ - the key component of the neutron scattering cross-section. We simulate the triplet gap and the triplet splitting of the quantum dimer with sufficient fidelity to compare to experimental neutron data. Our results on current circuit hardware pave an important avenue to benchmark, or even predict, the outputs of the costly INS experiments.

quant-ph↗

arXiv2023

Enhancing the Expressivity of Variational Neural, and Hardware-Efficient Quantum States Through Orbital Rotations

Variational approaches, such as variational Monte Carlo (VMC) or the variational quantum eigensolver (VQE), are powerful techniques to tackle the ground-state many-electron problem. Often, the family of variational states is not invariant under the reparametrization of the Hamiltonian by single-particle basis transformations. As a consequence, the representability of the ground-state wave function by the variational ansatz strongly dependents on the choice of the single-particle basis. In this manuscript we study the joint optimization of the single-particle basis, together with the variational state in the VMC (with neural quantum states) and VQE (with hardware-efficient circuits) approaches. We show that the joint optimization of the single-particle basis with the variational state parameters yields significant improvements in the expressive power and optimization landscape in a variety of chemistry and condensed matter systems. We also realize the first active-space calculation using neural quantum states, where the single-particle basis transformations are applied to all of the orbitals in the basis set.

quant-ph↗

arXiv2022

A stochastic quantum Krylov protocol with double factorized Hamiltonians

We propose a class of randomized quantum Krylov diagonalization (rQKD) algorithms capable of solving the eigenstate estimation problem with modest quantum resource requirements. Compared to previous real-time evolution quantum Krylov subspace methods, our approach expresses the time evolution operator, $e^{-i\hat{H} \tau}$, as a linear combination of unitaries and subsequently uses a stochastic sampling procedure to reduce circuit depth requirements. While our methodology applies to any Hamiltonian with fast-forwardable subcomponents, we focus on its application to the explicitly double-factorized electronic-structure Hamiltonian. To demonstrate the potential of the proposed rQKD algorithm, we provide numerical benchmarks for a variety of molecular systems with circuit-based statevector simulators, achieving ground state energy errors of less than 1~kcal~mol$^{-1}$ with circuit depths orders of magnitude shallower than those required for low-rank deterministic Trotter-Suzuki decompositions.

quant-ph↗

arXiv2021

Quantum Filter Diagonalization with Double-Factorized Hamiltonians

We demonstrate a method that merges the quantum filter diagonalization (QFD) approach for hybrid quantum/classical solution of the time-independent electronic Schr\"odinger equation with a low-rank double factorization (DF) approach for the representation of the electronic Hamiltonian. In particular, we explore the use of sparse "compressed" double factorization (C-DF) truncation of the Hamiltonian within the time-propagation elements of QFD, while retaining a similarly compressed but numerically converged double-factorized representation of the Hamiltonian for the operator expectation values needed in the QFD quantum matrix elements. Together with significant circuit reduction optimizations and number-preserving post-selection/echo-sequencing error mitigation strategies, the method is found to provide accurate predictions for low-lying eigenspectra in a number of representative molecular systems, while requiring reasonably short circuit depths and modest measurement costs. The method is demonstrated by experiments on noise-free simulators, decoherence- and shot-noise including simulators, and real quantum hardware.

quant-ph↗

arXiv2018

Minimal Effective Gibbs Ansatz (MEGA): A simple protocol for extracting an accurate thermal representation for quantum simulation

Quantum Gibbs state sampling algorithms generally suffer from either scaling exponentially with system size or requiring specific knowledge of spectral properties \textit{a priori}. Also, these algorithms require a large overhead of bath or scratch/ancilla qubits. We propose a method, termed the minimal effective Gibbs ansatz (MEGA), which uses a quantum computer to determine a minimal ensemble of pure states that accurately reproduce thermal averages of typical observables. This technique employs properties of correlation functions that can be split into a lesser and greater part; here, we primarily focus on single-particle Green's functions. When properly measured, these correlation functions provide a simple test to indicate how close a given pure state or ensemble of pure states are to providing accurate thermal expectation values. Further, we show that when properties such as the eigenstate thermalization hypothesis hold, this approach leads to accurate results with a sparse ensemble of pure states; sometimes only one suffices. We illustrate the ansatz using exact diagonalization simulations on small clusters for the Fermi-Hubbard and Hubbard-like models. Even if MEGA becomes as computationally complex as other Gibbs state samplers, it still gains an advantage due to its ease of implementation without any \textit{a priori} information about the Hamiltonian and in the efficient allocation of available qubits by eliminating bath qubits and using a minimal number of ancilla.

quant-ph↗

arXiv2013

Emotional Expression Classification using Time-Series Kernels

Estimation of facial expressions, as spatio-temporal processes, can take advantage of kernel methods if one considers facial landmark positions and their motion in 3D space. We applied support vector classification with kernels derived from dynamic time-warping similarity measures. We achieved over 99% accuracy - measured by area under ROC curve - using only the 'motion pattern' of the PCA compressed representation of the marker point vector, the so-called shape parameters. Beyond the classification of full motion patterns, several expressions were recognized with over 90% accuracy in as few as 5-6 frames from their onset, about 200 milliseconds.

cs.CV↗