Searcharxiv⌕ Search

arXiv subjects

Christoph Hoelscher

Publications and source records attributed to Christoph Hoelscher.

3 recordsLinked to original sources

Kolibri: Color Finds the Place, Refinement Sets the Pose for RGB-D Localization in Colored Point Clouds

An agent or robot in a scanned building must locate its camera in rooms that no model saw during training. Point cloud registration methods can align each RGB-D frame with the building's colored point cloud, accurately but at a high cost. We observe that geometric refinement brings nearby initial poses to the same final pose, so the learned component only needs to find the place. Kolibri does this with a graph network of 55,712 parameters that describes 10 cm cubes of points, called cells, by their color, local shape and neighbors. With the same refinement, it matches GeDi on 96 unseen ScanNet rooms (81.4% against 80.3% within 5 cm and 5°) and on a held-out test of 10 further rooms, in 82 ms per frame on an RTX 2080 Ti. The saved time allows for search without a room label. In one point cloud of 100 rooms, Kolibri loses 1.3 points against knowing the room, while retrieving the room first loses 56.0. In a hospital emergency department scene from a real scan, it localizes 86.5% of the frames rendered from the scan in 384 ms each, where GeDi needs 91 minutes per frame on cubes of the scan for a similar recall. The method needs colors that agree between the frame and the point cloud. On gray frames and across cameras with different color responses, point cloud registration methods keep the lead.

cs.CV↗

Does Your Neural Network Extrapolate? Feature Engineering as Identifiability Bias for OOD Generalization

Deep neural networks can learn salient features from an in-distribution (ID) training window without identifying the data-generating structure needed for out-of-distribution (OOD) generalization. Understanding this limitation requires examining the identifiability of the data-generating process (DGP). From a single training window, the DGP that yields the correct OOD extrapolation is not identifiable: infinitely many DGPs are observationally equivalent within a fixed tolerance on that window yet diverge arbitrarily beyond it, and no ID criterion alone can reliably distinguish them. A structural commitment---the feature map, label map, and model class $(φ, ψ, \mathcal{M})$---specifies the assumed DGP and governs OOD generalization while leaving ID performance essentially unchanged. When architecture, pretraining, data augmentation, input formats, or domain knowledge implicitly supply the correct commitment, the model generalizes beyond the training window. When it cannot infer OOD-relevant structure from ID evidence, it fails to generalize. When the commitment is correct {\em and} identifiable, OOD error vanishes. We demonstrate this mechanism in models trained from scratch and in foundation models across four natural-science settings (chemistry, physics, biology, and histopathology), as well as in a positional-encoding study spanning Transformer, Mamba, and S4D architectures. Finally, a controlled study shows that correct features are necessary but not sufficient for OOD generalization.

cs.LG↗

Cognitive Agent Based Simulation Model For Improving Disaster Response Procedures

In the event of a disaster, saving human lives is of utmost importance. For developing proper evacuation procedures and guidance systems, behavioural data on how people respond during panic and stress is crucial. In the absence of real human data on building evacuation, there is a need for a crowd simulator to model egress and decision-making under uncertainty. In this paper, we propose an agent-based simulation tool, which is grounded in human cognition and decision-making, for evaluating and improving the effectiveness of building evacuation procedures and guidance systems during a disaster. Specifically, we propose a predictive agent-wayfinding framework based on information theory that is applied at intersections with variable route choices where it fuses N dynamic information sources. The proposed framework can be used to visualize trajectories and prediction results (i.e., total evacuation time, number of people evacuated) for different combinations of reinforcing or contradicting information sources (i.e., signage, crowd flow, familiarity, and spatial layout). This tool can enable designers to recreate various disaster scenarios and generate simulation data for improving the evacuation procedures and existing guidance systems.

cs.MA↗