NOEMA: Executable Contracts for Learned Wireless Comparisons

Abstract

Learning-based wireless research increasingly combines simulation, external model training, and benchmarking. Rebuilding these stages for every experiment is time-consuming, while differences introduced between them can silently change the conditions of a comparison. We present NOEMA, an open-source toolkit that prepares model development and baseline evaluation from a shared, machine-checkable wireless scenario. From the same scenario, NOEMA can prepare benchmark execution, capture aligned training data, and export differentiable components for model development. Researchers can therefore focus on training and selecting their models, then return the selected component to the same controlled experiment for evaluation. NOEMA checks the returned model and verifies that declared comparison conditions, including available information, random conditions, and failure accounting, remain consistent through benchmarking and reporting. An included agentic-control example applies these contracts to a language-model supervisor that selects allocation policies and power budgets from historical link feedback. All 43 regression tests of the workflow checks produced their expected outcomes, including rejection of all 31 cases containing known inconsistencies. Separate fidelity tests showed that captured data and returned-model behavior were preserved. In a 20-replicate quadrature phase-shift keying phase-tracking study, the mean bit-error-rate difference between the learned receiver and five- pilot smoothing was -0.01526 (95% confidence interval: -0.01547 to -0.01506). NOEMA therefore provides both a reusable path for developing learned wireless components and a way to keep their final comparisons inspectable and checkable.