arXiv · 2609.31392
PANEL: An Open-Source, Self-Hosted Web Platform for Human Evaluation of Generative Models
Abstract
Human judgement is the reference measure for evaluating generative models, yet the software used to collect it lags behing the methodology. Researchers adapt listening-test frameworks designed for perceptual protocols such as MUSHRA, rely on closed commercial survey platforms, or implement single-use web applications. Live arenas such as Chatbot Arena and Music Arena rank publicly deployed systems at scale, but do not support controlled comparisons of a laboratory's own models with its own participants. We present PANEL, an open-source, self-hosted platform for such studies. A study is authored in the browser and distributed as a single link, with audio, video, image, and text stimuli, seven question types, and screening and skip logic. The platform reports per-question summaries, across-condition significance tests, pairwise win rates and Bradley--Terry scores, and supports power analysis from pilot data. Consent versioning, self-service withdrawal, retention enforcement, and audit logging support GDPR-compliant operation. Each study exports as a machine-readable specification. PANEL is available at https://github.com/matteospanio/panel.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Matteo Spanio, Andrea Poltronieri, Mart\'ın Rocamora. 2026-09-25. PANEL: An Open-Source, Self-Hosted Web Platform for Human Evaluation of Generative Models. https://searcharxiv.com/abs/2609.31392
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.