Searcharxiv⌕ Search

arXiv subjects

Yilan Elan Tao

Publications and source records attributed to Yilan Elan Tao.

4 recordsLinked to original sources

Allow Me Into Your Dream: A Handshake-and-Pull Protocol for Sharing Mixed Realities in Spontaneous Encounters

Mixed reality systems support shared anchors and co-located interaction, yet they lack a socially legible protocol for entering another person's mixed reality in public settings. We frame this as a protocol problem: co-located MR sharing requires a staged sequence -- Discover, Consent, Confirm, Allow, Spatial Colocation, Sync Objects, Permission Management -- each demanding user understanding and agreement. Using AirDrop and Apple Vision Pro SharePlay as a baseline, we show that MR encounter complexity far exceeds file transfer, yet must feel equally effortless. We present TouchPort, an embodied sharing protocol that collapses this multi-stage sequence into a single gesture: a handshake and pull that simultaneously signals intent, negotiates consent, and initiates a temporary shared encounter layer between otherwise separate mixed realities. Through three implied scenarios, we demonstrate the protocol's expressive range in the transition from isolated to spontaneously shared realities. We discuss how embodied gestures can address the consent problem in ubiquitous MR and examine the ethical tensions of encounter protocols for MR futures.

cs.HC↗

Entangling Like Mycorrhizae: Mixing Realities Through Touch in "FungiSync"

Mycorrhizal networks -- often called nature's ``wood-wide web'' -- are vast underground mycelial systems that connect individual plants through countless hyphae of mycorrhizal fungi joining with plant roots. Through these hyphal webs, resources and signals -- carbohydrates, minerals, and biochemical cues -- are mutualistically exchanged and redistributed across plants, sustaining forests as relational symbiotic ecologies rather than isolated individuals. What is it like to be a plant within the wood-wide web? We present \emph{FungiSync}, a multi-person, co-located mixed reality (MR) experience that translates mycorrhizal interdependence into a felt, somaesthetic participatory ritual. Participants embody different forest plants by holding masquerade-style MR headset masks with wood-branch-like handles decorated with mushrooms. In MR, each participant perceives a distinct, audio-reactive psychedelic augmented reality overlay -- composed of resource-representing visual elements -- layered atop a shared physical terrain, symbolizing an individualized digital \emph{umwelt} (perceptual world). FungiSync reprograms human hand touch into a metaphorical mycorrhizal exchange. When participants touch hands, their digital \emph{umwelten} begin to entangle: visual elements leak, mix, and merge across perspectives, as if hyphae were forging new connections and carrying resources between hosts within a larger mycelial network. By making mycorrhizal interdependence perceptible through embodied contact, FungiSync invites participants to feel with \emph{fungal epistemics} -- a more-than-human alternative way of knowing grounded in symbiotic relationality as both an aesthetic experience and an ethical orientation -- offering a critique of the accelerated individualism characterizing our technology-mediated posthuman era.

cs.HC↗

Nudging the Somas: Exploring How Live-Configurable Mixed Reality Objects Shape Open-Ended Intercorporeal Movements

Mixed Reality (MR) increasingly explores how virtual elements can shape physical behavior, yet how MR objects guide group movement remains underexplored. We address this gap by examining how virtual objects can nudge collective, co-located movement without relying on explicit instructions or choreography. We developed GravField, a research-through-design, co-located MR performance system where an "object jockey" live-configures virtual objects (e.g., ropes, springs, magnetic fields) with real-time, parameterized "digital physics" (e.g., weight, elasticity, force) to influence headset-wearing participants' movement, made perceptible through augmented visual and audio feedback serving as cognitive-somatic cues. Our bricolage analysis of the performances, based on video, interviews, soma trajectories, and field notes, indicates that these live nudges support emergent intercorporeal coordination and that ambiguity and real-time configuration sustain open-ended, exploratory engagement. Ultimately, our work offers empirical insights and design principles for MR systems that can guide group movement through embodied, felt dynamics while preserving participants' sense of agency.

cs.HC↗

Towards Immersive Mixed Reality Street Play: Understanding Co-located Bodily Play with See-through Head-mounted Displays in Public Spaces

As see-through Mixed Reality Head-Mounted Displays (MRHMDs) proliferate, their usage is gradually shifting from controlled, private settings to spontaneous, public contexts. While location-based augmented reality mobile games such as Pokemon GO have been successful, the embodied interaction afforded by MRHMDs moves play beyond phone-based screen-tapping toward co-located, bodily, movement-based play. In anticipation of widespread MRHMD adoption, major technology companies have teased concept videos envisioning urban streets as vast mixed reality playgrounds-imagine Harry Potter-style wizard duels in city streets-which we term Immersive Mixed Reality Street Play (IMRSP). However, few real-world studies examine such scenarios. Through empirical, in-the-wild studies of our research-through-design game probe, Multiplayer Omnipresent Fighting Arena (MOFA), deployed across diverse public venues, we offer initial insights into the social implications, challenges, opportunities, and design recommendations of IMRSP. The MOFA framework, which includes three gameplay modes-"The Training," "The Duel," and "The Dragon"-is open-sourced at https://github.com/realitydeslab/mofa.

cs.HC↗