arXiv · 2611.21957
Operating an Agent-Driven Dataset Factory: Discovery, Construction, and Public Release
Abstract
Turning public data into prediction datasets requires connecting source discovery, task definition, construction, and distribution. We deployed Dataset Factory to perform these steps continuously under a standing release policy. Bounded language-model tasks interpret sources, write construction code, and review task meaning; deterministic software manages state, workers, retries, and publication. Over 81.53 hours, the factory published 14 datasets at an estimated recurring operating expenditure of about \$2.74 per publication. The accounting includes failed attempts, inference, workers, and hosting. Separate agents completed prediction experiments on all twelve evaluated releases. Source review nevertheless identified a task whose construction filters contradicted its population declaration. The original reviewer accepted later-record exclusions without reconciling them with the published selection rule. This experience documents an operating source-to-release workflow and shows why successful execution and consumer use need separate checks of task meaning.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Eduardo Ariño de la Rubia, Szilard Pafka. 2026-11-16. Operating an Agent-Driven Dataset Factory: Discovery, Construction, and Public Release. https://searcharxiv.com/abs/2611.21957
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.