arXiv · 2611.18706
Small Data in Long-Term Environmental Vision: Annotation Noise, Gamification, and Label-Budget Scaling
Abstract
Long-running environmental camera networks produce abundant images but few reliable annotations. Using FujiView, a network of webcams around Mount Fuji, we study three linked questions: whether gamification affects annotation participation and agreement, how annotators disagree on ordinal visibility labels, and how label budget affects downstream classification. Across seven nonrandomized sessions with 22 labelers, gamification showed a more promising pattern for sustained participation than for labeling speed or agreement. In the closest remote-session comparison, the session recorded as gamified had longer active labeling time, while throughput and reference agreement remained similar. Annotation disagreement was substantial at fine granularity: crowd votes matched the single-annotator reference on 49.1% of exact visibility classes, versus 90.2% after grouping them into Good/Poor. In five-replicate label-budget experiments, models using 25% of the available label pool achieved held-out exact accuracy only 2.8 percentage points below the full-pool model on average. Together, these findings highlight the importance of designing reliable annotation targets, evaluating engagement mechanisms without assuming causal benefits, and using empirical scaling curves to plan labeling effort.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Bryceton Bible, Hairong Qi, Masahiro Toyoura. 2026-11-06. Small Data in Long-Term Environmental Vision: Annotation Noise, Gamification, and Label-Budget Scaling. https://searcharxiv.com/abs/2611.18706
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.