arXiv subjects

Carsten Neumann

Publications and source records attributed to Carsten Neumann.

3 recordsLinked to original sources

arXiv2026

A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence

360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.

cs.HC↗

arXiv2025

A Human Digital Twin Architecture for Knowledge-based Interactions and Context-Aware Conversations

Recent developments in Artificial Intelligence (AI) and Machine Learning (ML) are creating new opportunities for Human-Autonomy Teaming (HAT) in tasks, missions, and continuous coordinated activities. A major challenge is enabling humans to maintain awareness and control over autonomous assets, while also building trust and supporting shared contextual understanding. To address this, we present a real-time Human Digital Twin (HDT) architecture that integrates Large Language Models (LLMs) for knowledge reporting, answering, and recommendation, embodied in a visual interface. The system applies a metacognitive approach to enable personalized, context-aware responses aligned with the human teammate's expectations. The HDT acts as a visually and behaviorally realistic team member, integrated throughout the mission lifecycle, from training to deployment to after-action review. Our architecture includes speech recognition, context processing, AI-driven dialogue, emotion modeling, lip-syncing, and multimodal feedback. We describe the system design, performance metrics, and future development directions for more adaptive and realistic HAT systems.

cs.HC↗

arXiv2017

Vibrationally resolved electronic spectra including vibrational pre-excitation: Theory and application to VIPER spectroscopy

Vibrationally resolved electronic absorption spectra including the effect of vibrational pre-excitation are computed in order to interpret and predict vibronic transitions that are probed in the Vibrationally Promoted Electronic Resonance (VIPER) experiment [L. J. G. W. van Wilderen et al., Angew. Chem. Int. Ed. 53, 2667 (2014)]. To this end, we employ time-independent and time-dependent methods based on the evaluation of Franck-Condon overlap integrals and Fourier transformation of time-domain wavepacket autocorrelation functions, respectively. The time-independent approach uses a generalized version of the FCclasses method [F. Santoro et al., J. Chem. Phys. 126, 084509 (2007)]. In the time-dependent approach, autocorrelation functions are obtained by wavepacket propagation and by evaluation of analytic expressions, within the harmonic approximation including Duschinsky rotation effects. For several medium-sized polyatomic systems, it is shown that selective pre-excitation of particular vibrational modes leads to a red-shift of the low-frequency edge of the electronic absorption spectrum, which is a prerequisite for the VIPER experiment. This effect is typically most pronounced upon excitation of ring distortion modes within an aromatic pi-system. Theoretical predictions as to which modes show the strongest VIPER effect are found to be in excellent agreement with experiment.

physics.chem-ph↗