arXiv subjects

Lung-Pan Cheng

Publications and source records attributed to Lung-Pan Cheng.

5 recordsLinked to original sources

arXiv2026

FlueBricks: A Construction Kit of Flute-like Instruments for Acoustic Reasoning

We present FlueBricks, a construction kit for acoustic reasoning via building and customizing flute-like instruments. By assembling generator, resonator, and connector modules that embody various aeroacoustic properties, users gain deeper understanding of how blowhole, tube length, and tone-hole placement alter onset, pitch, and timbre through hands-on experimentation. This forms a designer-player loop of configuring and playing to form, test, and refine acoustic behaviors-acoustic reasoning-shifting acoustic instruments from static artifacts to dynamic systems. To understand how users engage with this system, we conducted an exploratory study with 12 participants ranging from novices to professional musicians. During their explorations, we observed participants fluently switching between designer and player roles, scaffolding designs from familiar instruments, forming and refining their acoustic understanding of length, tone holes, and generator geometry, reinterpreting modules beyond their intended functions, and using their creations for performative acts such as pedagogical showing and musical expression. These collectively demonstrated FlueBricks's potential as a pedagogical tool for embodied acoustic reasoning.

cs.HC↗

arXiv2024

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

Audience feedback is crucial for refining video content, yet it typically comes after publication, limiting creators' ability to make timely adjustments. To bridge this gap, we introduce SimTube, a generative AI system designed to simulate audience feedback in the form of video comments before a video's release. SimTube features a computational pipeline that integrates multimodal data from the video-such as visuals, audio, and metadata-with user personas derived from a broad and diverse corpus of audience demographics, generating varied and contextually relevant feedback. Furthermore, the system's UI allows creators to explore and customize the simulated comments. Through a comprehensive evaluation-comprising quantitative analysis, crowd-sourced assessments, and qualitative user studies-we show that SimTube's generated comments are not only relevant, believable, and diverse but often more detailed and informative than actual audience comments, highlighting its potential to help creators refine their content before release.

cs.HC↗

arXiv2023

FeltingReel: Density Varying Soft Fabrication with Reeling and Felting

FeltingReel is a soft fabrication system that allows users to create a 3D non-woven textile with various structural strengths. Our system coils wool yarn onto a central reel to form a basic shape and uses actuated barbed needles to refine it. By controlling the coiling tension and the felting times, our system varies the density of the workpiece in a target area to achieve various structural strengths. Specifically, our system controls the tilt of coiling and felting using a Stewart platform around a motorized rotating reel. Our system also allows different basic shapes with hollow internal structures to be formed by changing the detachable reel core. We investigate the effects of different felting needles, frequencies, and coiling directions that influence the density, structural strength, and fabrication time of a workpiece. We propose three methods to combine felting and reeling. We evaluate their performances and final products by producing two example workpieces using our system. We demonstrate several objects made by our working system and discuss its capabilities and limitations.

cs.HC↗

arXiv2023

BetterMinton Service: Analyzing the Badminton Service using Open Kinetic Chain

We present a badminton training system that focuses on the backhand short service. Unlike the prior motor skill training systems which focus on the trainee's posture, our system analyzes the process of moving joints with the open kinetic chain (OKC), which helps align movement and minimize muscle use for better joint control. We process the users' mocap data to visually show their last service process comparing to 4 ideal OKC characteristics that we collected from a 6-sub-elite formative study as well as recommended contact posture. We validate our system through a 12-user study that measures serving accuracy, qualitative feedback, and skeletal data with users at various skill levels and open source our skeletal analysis model for future use. While the participants' overall service accuracy was not significantly improved, our results show that our system helps participants in the short term to fine-tune their service motion closer to our ideal 4 OKC characteristics.

cs.HC↗

arXiv2023

Clonemator: Composing Spatiotemporal Clones to Create Interactive Automators in Virtual Reality

Clonemator is a virtual reality (VR) system allowing users to create their avatar clones and configure them spatially and temporally, forming automators to accomplish complex tasks. In particular, clones can (1) freeze at a user's body pose as static objects, (2) synchronously mimic the user's movement, and (3) replay a sequence of the user's actions in a period of time later. Combined with traditional techniques such as scaling, positional rearrangement, group selection, and duplication, Clonemator enables users to iteratively develop customized and reusable solutions by breaking down complex tasks into a sequence of collaborations with clones. This bypasses implementing dedicated interaction techniques or scripts while allowing flexible interactions in VR applications. We demonstrate the flexibility of Clonemator with several examples and validate its usability and effectiveness through a preliminary user study. Finally, we discuss the potential of Clonemator in VR applications such as gaming mechanisms, spatial interaction techniques, and multi-robot control and provide our insights for future research.

cs.HC↗