arXiv subjects

Jamy Li

Publications and source records attributed to Jamy Li.

4 recordsLinked to original sources

arXiv2026

GeoTEAM: A Geospatial Tangible User Interface for Exploration and Visual Analysis of Migration Data

Migration studies is an interdisciplinary field, requiring collaboration between researchers with varying levels of geospatial and quantitative data literacy. Geospatial tangible user interfaces (GTUIs) offer promising opportunities for embodied and collaborative spatial exploration of migration data. Few GTUIs, however, provide real-time visual feedback of data values to help users collaboratively identify trends. To address this gap, we present GeoTEAM, a novel tangible system for real-time, dynamic regional exploration, co-designed with migration and HCI researchers. GeoTEAM features active tangible dials with built-in touchscreens designed to control time and navigate map layers for net migration and various environmental sub-drivers in a multi-surface environment with tabletop and wall displays. We evaluated this system with nine pairs of researchers possessing multi-expertise in geospatial data literacy. Qualitative findings show that our system promotes collaboration, intuitive sense-making, and increased user confidence, enabled by physical interaction and real-time feedback from the active tangibles.

cs.HC↗

arXiv2026

Collaboratively Eliciting Gestures for Geospatial Data Exploration on an MSE with Tangibles and Styluses

Large tabletop displays and multi-surface environments offer potential for enhancing visual data exploration and collaborative work with geospatial datasets. These systems typically rely on multi-touch interactions, which can pose challenges when the multi-touch sensors misrepresent transitory movements as control inputs, leading to interruptions. Active tangibles and styluses offer an alternative to multi-touch interactions in MSEs, and have shown the potential to facilitate sense-making around large datasets. However, further research is needed to better understand how these modalities can be effectively leveraged for interacting with geospatial data visualizations. To address this, a gesture elicitation study was conducted in which users suggested interactions for 16 geospatial data visualization tasks, presented as a realistic collaborative workflow co-designed with geography and migration researchers. The study produced a taxonomy of user-defined gestures using tangibles and styluses for engaging with geospatial data, along with a thematic analysis of users' experiences with visualization tasks and interaction techniques.

cs.HC↗

arXiv2020

Usability of a Robot's Realistic Facial Expressions and Peripherals in Autistic Children's Therapy

Robot-assisted therapy is an emerging form of therapy for autistic children, although designing effective robot behaviors is a challenge for effective implementation of such therapy. A series of usability tests assessed trends in the effectiveness of modelling a robot's facial expressions on realistic facial expressions and of adding peripherals enabling child-led control of emotion learning activities with autistic children. Nineteen autistic children interacted with a small humanoid robot and an adult therapist in several emotion-learning activities that featured realistic facial expressions modelled on either a pre-existing database or live facial mirroring, and that used peripherals (tablets or tangible 'squishies') to enable child-led activities. Both types of realistic facial expressions by the robot were less effective than exaggerated expressions, with the mirroring being unintuitive for children. The tablet was usable but required more feedback and lower latency, while the tactile tangibles were engaging aids.

cs.RO↗

arXiv2020

Formalizing and Guaranteeing* Human-Robot Interaction

Robot capabilities are maturing across domains, from self-driving cars, to bipeds and drones. As a result, robots will soon no longer be confined to safety-controlled industrial settings; instead, they will directly interact with the general public. The growing field of Human-Robot Interaction (HRI) studies various aspects of this scenario - from social norms to joint action to human-robot teams and more. Researchers in HRI have made great strides in developing models, methods, and algorithms for robots acting with and around humans, but these "computational HRI" models and algorithms generally do not come with formal guarantees and constraints on their operation. To enable human-interactive robots to move from the lab to real-world deployments, we must address this gap. This article provides an overview of verification, validation and synthesis techniques used to create demonstrably trustworthy systems, describes several HRI domains that could benefit from such techniques, and provides a roadmap for the challenges and the research needed to create formalized and guaranteed human-robot interaction.

cs.RO↗