arXiv subjects

Chris Harrison

Publications and source records attributed to Chris Harrison.

At least 19 recordsLinked to original sources

arXiv2026

GlintMarkers: Spatial Perception on XR Eyewear using Corneal Reflections

We present GlintMarkers, the first system to perform gaze-driven spatial perception using the inward-facing cameras on XR eyewear. Our key observation is that the cornea acts as a mirror that encodes both gaze direction and visual information about the environment in a small, low-contrast reflection. To extract spatial and semantic information from this reflection despite the camera's limited pixel budget, we present a passive retroreflective marker design that concentrates reflected near-infrared light onto the cornea, producing bright glint patterns. We develop a custom Perspective-n-Point (PnP) estimation framework adapted to corneal imaging and perform orientation and distance estimation of tagged objects, as well as unique object identification.

cs.HC↗

arXiv2026

HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge

We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops - 4K or greater in high-end devices - such that it is now possible to capture the 2D reflection of a device's screen in the user's eyes. This alone is insufficient for accurate gaze tracking due to the near-infinite variety of screen content. Crucially, however, the device knows what is being displayed on its own screen - in this work, we show this information allows for robust segmentation of the reflection, the location and size of which encodes the user's screen-relative gaze target. We explore several strategies to leverage this useful signal, quantifying performance in a user study. Our best performing model reduces mean tracking error by ~8% compared to a baseline appearance-based model. A supplemental study reveals an additional 10-20% improvement if the gaze-tracking camera is located at the bottom of the device.

cs.HC↗

arXiv2026

Acoustic Field Video for Multimodal Scene Understanding

We introduce and explore a new multimodal input representation for vision-language models: acoustic field video. Unlike conventional video (RGB with stereo/mono audio), our video stream provides a spatially grounded visualization of sound intensity across a scene, offering a new and powerful dimension of perceptual understanding. Our real-time pipeline uses low-cost beamforming microphone arrays that are already common in smart speakers and increasingly present in robotics and XR headsets, yet this sensing capability remains unutilized for scene understanding. To assess the value of spatial acoustic information, we constructed an evaluation set of 402 question-answer scenes, comparing a state-of-the-art VLM given conventional video with and without paired acoustic field video. Results show a clear and consistent improvement when incorporating spatial acoustic data; the VLM we test improves from 38.3% correct to 67.4%. Our findings highlight that many everyday scene understanding tasks remain underconstrained when relying solely on visual and audio input, and that acoustic field data provides a promising and practical direction for multimodal reasoning. A video demo is available at https://daehwakim.com/seeingsound

cs.HC↗

arXiv2025

EclipseTouch: Touch Segmentation on Ad Hoc Surfaces using Worn Infrared Shadow Casting

The ability to detect touch events on uninstrumented, everyday surfaces has been a long-standing goal for mixed reality systems. Prior work has shown that virtual interfaces bound to physical surfaces offer performance and ergonomic benefits over tapping at interfaces floating in the air. A wide variety of approaches have been previously developed, to which we contribute a new headset-integrated technique called \systemname. We use a combination of a computer-triggered camera and one or more infrared emitters to create structured shadows, from which we can accurately estimate hover distance (mean error of 6.9~mm) and touch contact (98.0\% accuracy). We discuss how our technique works across a range of conditions, including surface material, interaction orientation, and environmental lighting.

cs.HC↗

arXiv2025

SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data

The ability to track a user's arm pose could be valuable in a wide range of applications, including fitness, rehabilitation, augmented reality input, life logging, and context-aware assistants. Unfortunately, this capability is not readily available to consumers. Systems either require cameras, which carry privacy issues, or utilize multiple worn IMUs or markers. In this work, we describe how an off-the-shelf smartphone and smartwatch can work together to accurately estimate arm pose. Moving beyond prior work, we take advantage of more recent ultra-wideband (UWB) functionality on these devices to capture absolute distance between the two devices. This measurement is the perfect complement to inertial data, which is relative and suffers from drift. We quantify the performance of our software-only approach using off-the-shelf devices, showing it can estimate the wrist and elbow joints with a \hl{median positional error of 11.0~cm}, without the user having to provide training data.

cs.HC↗

arXiv2025

EgoTouch: On-Body Touch Input Using AR/VR Headset Cameras

In augmented and virtual reality (AR/VR) experiences, a user's arms and hands can provide a convenient and tactile surface for touch input. Prior work has shown on-body input to have significant speed, accuracy, and ergonomic benefits over in-air interfaces, which are common today. In this work, we demonstrate high accuracy, bare hands (i.e., no special instrumentation of the user) skin input using just an RGB camera, like those already integrated into all modern XR headsets. Our results show this approach can be accurate, and robust across diverse lighting conditions, skin tones, and body motion (e.g., input while walking). Finally, our pipeline also provides rich input metadata including touch force, finger identification, angle of attack, and rotation. We believe these are the requisite technical ingredients to more fully unlock on-skin interfaces that have been well motivated in the HCI literature but have lacked robust and practical methods.

cs.HC↗

arXiv2025

STRAUSS: Sonification Tools & Resources for Analysis Using Sound Synthesis

Sonification, or conveying data using non-verbal audio, is a relatively niche but growing approach for presenting data across multiple specialist domains including astronomy, climate science, and beyond. The STRAUSS Python package aims to provide such a tool, which builds upon previous approaches to provide a powerful means to explore different ways of expressing data, with fine control over the output audio and its format. STRAUSS is a free, open source (FOSS) package, designed to allow flexible and effective sonification to be integrated into data workflows, in analogy to widely used visualisation packages. The remit of STRAUSS is broad; it is intended to be able to bridge between ad-hoc solutions for sonifying very particular datasets, and highly technical compositional and sound-design tools that are not optimised for sonification, or may have a steep learning curve. The code offers a range of approaches to sonification for a variety of contexts (e.g. science education, science communication, technical data analysis, etc). To this end, STRAUSS is packaged with a number of examples of different sonification approaches, and preset configurations to support "low-barrier, high-ceiling" approach. STRAUSS has been used to produce both educational resources and analysis tools.

astro-ph.IM↗

arXiv2024

Evaluation and insights from a sonification-based planetarium show intended for improving inclusivity

Audio Universe: Tour of the Solar System is an audio-visual show for planetariums and flatscreen viewing. It is designed in collaboration with members of the blind and vision impaired (BVI) community, BVI specialist teachers and their pupils. It aims to be suitable for audiences with all sight levels by representing key concepts through sound and using a carefully constructed narration. We present results from 291 audience evaluations from online viewers and audience members of several planetarium showings in the UK and Italy. We find a strong appreciation from BVI and non-BVI audiences, with ~90% scoring 4 or 5 (out of 5) for both how useful and enjoyable the sounds are. We also present results from surveying planetariums and communication leaders known to have downloaded the show. We find international success for special events, for BVI audiences and for those with other special educational needs and disabilities (SEND; including sensory needs and learning difficulties). Feedback suggests this is due to its multi-sensory, clearly narrated, and low sensory load (calm) production. However, we also describe limitations identified during this evaluation exercise, including the show's limited incorporation into regular (non-special) planetarium programmes. This highlights an ongoing challenge of creating a fully inclusive planetarium experience.

physics.ed-ph↗

arXiv2023

Obscuration beyond the nucleus: infrared quasars can be buried in extreme compact starbursts

In the standard quasar model, the accretion disk obscuration is due to the canonical dusty torus. Here, we argue that a substantial part of the quasar obscuration can come from the interstellar medium (ISM) when the quasars are embedded in compact starbursts. We use an obscuration-unbiased sample of 578 infrared (IR) quasars at $z\approx 1-3$ and archival ALMA submillimeter host galaxy sizes to investigate the ISM contribution to the quasar obscuration. We calculate SFR and ISM column densities for the IR quasars and a control sample of submillimeter galaxies (SMGs) not hosting quasar activity and show that: (1) the quasar obscured fraction is constant up to $\rm SFR\approx 300 \: M_{\odot} \: yr^{-1}$, and then increases towards higher SFR, suggesting that the ISM obscuration plays a significant role in starburst host galaxies, and (2) at $\rm SFR\gtrsim 300 \: M_{\odot} \: yr^{-1}$, the SMGs and IR quasars have similarly compact submillimeter sizes ($R_{\rm e}\approx 0.5-3\rm \: kpc$) and, consequently, the ISM can heavily obscure the quasar, even reaching Compton-thick ($N_{\rm H}>10^{24} \rm \: cm^{-2}$) levels in extreme cases. Based on our results, we infer that $\approx 10-30\%$ of the IR quasars with $\rm SFR\gtrsim 300 \: M_{\odot} \: yr^{-1}$ are obscured solely by the ISM.

astro-ph.GA↗

arXiv2023

KURVS: The outer rotation curve shapes and dark matter fractions of $z \sim 1.5 $ star-forming galaxies

We present first results from the KMOS Ultra-deep Rotation Velocity Survey (KURVS), aimed at studying the outer rotation curves shape and dark matter content of 22 star-forming galaxies at $z\sim1.5$. These galaxies represent `typical' star-forming discs at $z \sim 1.5$, being located within the star-forming main sequence and stellar mass-size relation with stellar masses $9.5\leqslant$log$(M_{\star}/\mathrm{M_{\odot}})\leqslant11.5$. We extract individual rotation curves out to 4 times the effective radius, on average, or $\sim 10-15$ kpc. Most rotation curves are flat or rising between three- and six-disc scale radii. Only three objects with dispersion-dominated dynamics ($v_{\rm rot}/\sigma_0\sim0.2$) have declining outer rotation curves at more than 5$\sigma$ significance. After accounting for seeing and pressure support, the nine rotation-dominated discs with $v_{\rm rot}/\sigma_0\geqslant1.5$ have average dark matter fractions of $50 \pm 20\%$ at the effective radius, similar to local discs. Together with previous observations of star-forming galaxies at cosmic noon, our measurements suggest a trend of declining dark matter fraction with increasing stellar mass and stellar mass surface density at the effective radius. Simulated EAGLE galaxies are in quantitative agreement with observations up to log$(M_{\star}R_{\rm eff}^{-2}/\mathrm{M_{\odot}kpc^{-2}}) \sim 9.2$, and over-predict the dark matter fraction of galaxies with higher mass surface densities by a factor of $\sim 3$. We conclude that the dynamics of typical rotationally-supported discs at $z \sim 1.5$ is dominated by dark matter from effective radius scales, in broad agreement with cosmological models. The tension with observations at high stellar mass surface density suggests that the prescriptions for baryonic processes occurring in the most massive galaxies (such as bulge growth and quenching) need to be reassessed.

astro-ph.GA↗

arXiv2023

IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds

Tracking body pose on-the-go could have powerful uses in fitness, mobile gaming, context-aware virtual assistants, and rehabilitation. However, users are unlikely to buy and wear special suits or sensor arrays to achieve this end. Instead, in this work, we explore the feasibility of estimating body pose using IMUs already in devices that many users own -- namely smartphones, smartwatches, and earbuds. This approach has several challenges, including noisy data from low-cost commodity IMUs, and the fact that the number of instrumentation points on a users body is both sparse and in flux. Our pipeline receives whatever subset of IMU data is available, potentially from just a single device, and produces a best-guess pose. To evaluate our model, we created the IMUPoser Dataset, collected from 10 participants wearing or holding off-the-shelf consumer devices and across a variety of activity contexts. We provide a comprehensive evaluation of our system, benchmarking it on both our own and existing IMU datasets.

cs.HC↗

arXiv2022

A panchromatic view of infrared quasars: excess star formation and radio emission in the most heavily obscured systems

To understand the Active Galactic Nuclei (AGN) phenomenon and their impact on the evolution of galaxies, a complete AGN census is required; however, finding heavily obscured AGNs is observationally challenging. Here we use the deep and extensive multi-wavelength data in the COSMOS field to select a complete sample of 578 infrared (IR) quasars ($L_{\rm AGN,IR}>10^{45}\rm \: erg\: s^{-1}$) at $z<3$, with minimal obscuration bias, using detailed UV-to-far IR spectral energy distribution (SED) fitting. We complement our SED constraints with X-ray and radio observations to further investigate the properties of the sample. Overall, 322 of the IR quasars are detected by Chandra and have individual X-ray spectral constraints. From a combination of X-ray stacking and $L_{\rm 2-10\rm keV}$ - $L_{\rm 6\: \mu m}$ analyses, we show that the majority of the X-ray faint and undetected quasars are heavily obscured (many are likely Compton thick), highlighting the effectiveness of the mid-IR band to find obscured AGNs. We find that 355 ($\approx$61%) IR quasars are obscured ($N_{\rm H}>10^{22}\rm \: cm^{-2}$) and identify differences in the average properties between the obscured and unobscured quasars: (1) obscured quasars have star-formation rates $\approx 3$ times higher than unobscured systems for no significant difference in stellar mass and (2) obscured quasars have stronger radio emission than unobscured systems, with a radio-loudness parameter $\approx 0.2 \rm \: dex$ higher. These results are inconsistent with a simple orientation model but in general agreement with either extreme host-galaxy obscuration towards the obscured quasars or a scenario where obscured quasars are an early phase in the evolution of quasars.

astro-ph.GA↗

arXiv2022

Audible universe

A multi-disciplinary team recently came together online to discuss the application of sonification in astronomy, focussing on the effective use of sound for scientific discovery and for improving accessibility to astronomy research and education. Here we provide a meeting report.

astro-ph.IM↗

arXiv2022

Cosmological simulations predict that AGN preferentially live in gas-rich, star-forming galaxies despite effective feedback

Negative feedback from active galactic nuclei (AGN) is the leading mechanism for the quenching of massive galaxies in the vast majority of modern galaxy evolution models. However, direct observational evidence that AGN feedback causes quenching on a population scale is lacking. Studies have shown that luminous AGN are preferentially located in gas-rich and star-forming galaxies, an observation that has sometimes been suggested to be in tension with a negative AGN feedback picture. We investigate three of the current cosmological simulations (IllustrisTNG, EAGLE and SIMBA) along with post-processed models for molecular hydrogen gas masses and perform similar tests to those used by observers. We find that the simulations predict: (i) no strong negative trends between AGN luminosity and molecular gas fraction or sSFR; (ii) both high-luminosity ($L_{bol}>10^{44}$ erg/s) and high-Eddington ratio (>1%) AGN are preferentially located in galaxies with high molecular gas fractions and sSFR; and (iii) that the gas-depleted and quenched fractions of AGN host galaxies are lower than a control sample of non-active galaxies. These three findings are in qualitative agreement with observational samples at $z=0$ and $z=2$ and show that such results are not in tension with the presence of strong AGN feedback, which all simulations we employ require to produce realistic massive galaxies. However, we also find quantifiable differences between predictions from the simulations, which could allow us to observationally test the different subgrid feedback models.

astro-ph.GA↗

arXiv2021

Audio Universe: Tour of the Solar System

We have created a show about the Solar System, freely available for both planetariums and home viewing, where objects in space are represented with sound as well as with visuals. For example, the audience listens to the stars appear above the European Southern Observatory's Very Large Telescope and they hear the planets orbit around their heads. The aim of this show is that it can be enjoyed and understood, irrespective of level of vision. Here we describe how we used our new computer code, STRAUSS, to convert data into sound for the show. We also discuss the lessons learnt during the design of the show, including how it was imperative to obtain a range of diverse perspectives from scientists, a composer and representatives of the blind and vision impaired community.

astro-ph.IM↗

arXiv2020

Gaze-based Autism Detection for Adolescents and Young Adults using Prosaic Videos

Autism often remains undiagnosed in adolescents and adults. Prior research has indicated that an autistic individual often shows atypical fixation and gaze patterns. In this short paper, we demonstrate that by monitoring a user's gaze as they watch commonplace (i.e., not specialized, structured or coded) video, we can identify individuals with autism spectrum disorder. We recruited 35 autistic and 25 non-autistic individuals, and captured their gaze using an off-the-shelf eye tracker connected to a laptop. Within 15 seconds, our approach was 92.5% accurate at identifying individuals with an autism diagnosis. We envision such automatic detection being applied during e.g., the consumption of web media, which could allow for passive screening and adaptation of user interfaces.

cs.HC↗

arXiv2019

The energetics of starburst-driven outflows at z=1 from KMOS

We present an analysis of the gas outflow energetics of 529 main-sequence star-forming galaxies at z~1 using KMOS observations of the broad, underlying H-alpha and forbidden lines of [N II] and [S II]. Based on the stacked spectra for a sample with median star-formation rates and stellar masses of SFR ~ 7 Mo/yr and M* = (1.0+/-0.1)x10^10 Mo respectively, we derive a typical mass outflow rate of dM/dt = 1-4 Mo/yr and a mass loading of dM/dt/SFR = 0.2--0.4. The mass loading of the wind does not show a strong trend with star-formation rate over the range SFR ~ 2--20 Mo/yr, although we identify a trend with stellar mass such that dM/dt/SFR ~ M*^(0.26+/-0.07). Finally, we find that the line width of the broad H-alpha increases with disk circular velocity with a sub-linear scaling relation FWHM_broad ~ v^(0.21+/-0.05). As a result of this behavior, in the lowest mass galaxies (M* < 10^10 Mo), a significant fraction of the outflowing gas should have sufficient velocity to escape the gravitational potential of the halo whilst in the highest mass galaxies (M* > 10^10 Mo) most of the gas will be retained, flowing back on to the galaxy disk at later times.

astro-ph.GA↗

arXiv2017

Galaxy Makers: creating an online component to a science exhibition for re-engagement, evaluation and content legacy

For the Royal Society Summer Science Exhibition 2016, the Institute of Computational Cosmology from Durham University created the Galaxy Makers exhibit to communicate our computational cosmology and astronomy research. In addition to the physical exhibit we created an online component to foster re-engagement, create a permanent home for our content and to allow us to collect the ever-more important information about participation and impact. Here we summarise the details of the exhibit and the successes of creating an online component. We also share suggestions of further uses and improvements that could be implemented for online components of other science exhibitions.

physics.soc-ph↗