Architecture of the data aggregation and streaming system for the European Spallation Source neutron instrument suite

A. H. C. Mukai; M. J. Clarke; M. J. Christensen; J. M. C. Nilsson; M. G. Shetty; M. Brambilla; D. Werder; M. Könnecke; J. Harper; M. D. Jones; F. A. Akeroyd; C. Reis; G. Kourousias; T. S. Richter

doi:10.1088/1748-0221/13/10/t10001

arXiv · 1807.10388

Architecture of the data aggregation and streaming system for the European Spallation Source neutron instrument suite

A. H. C. Mukai·M. J. Clarke·M. J. Christensen·J. M. C. Nilsson·M. G. Shetty·M. Brambilla·D. Werder·M. Könnecke·J. Harper·M. D. Jones·F. A. Akeroyd·C. Reis·G. Kourousias·T. S. Richter

View original source ↗Read source document ↗Export metadata ↓

Abstract

The European Spallation Source (ESS) will provide long neutron pulses for experiments on a suite of different instruments. Most of these will perform neutron data acquisition in event mode, i.e. each detected neutron will be characterised by one absolute timestamp and pixel identifier pair. Slow controls metadata from EPICS, such as sample environment measurements and motor positions, will also be timestamped at their source, so that all data and metadata are streamed as a list of events instead of histograms. A flexible data aggregation and streaming system is being developed combining both open source third-party software and in-house development. This is to be used at ESS and other neutron scattering facilities like ISIS and SINQ, replacing legacy solutions by a shared software collection maintained by a cross-facility effort. The architecture of the Apache Kafka-based system, its metadata forwarding and NeXus file writing components are presented, along with test results demonstrating their integration and the scalability in terms of performance.

Explore related subjects

physics.ins-det

Keep this discovery

BibTeX RIS

A. H. C. Mukai, M. J. Clarke, M. J. Christensen, J. M. C. Nilsson, M. G. Shetty, M. Brambilla, D. Werder, M. Könnecke, J. Harper, M. D. Jones, F. A. Akeroyd, C. Reis, G. Kourousias, T. S. Richter. 2018-07-26. Architecture of the data aggregation and streaming system for the European Spallation Source neutron instrument suite. https://doi.org/10.1088/1748-0221/13/10/t10001

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

High-Speed Semi-FE Readout Module for ATLAS MDT at HL-LHC: Design and Production-Level Characterization

The High-Luminosity upgrade of the Large Hadron Collider (HL-LHC) introduces increased demands on the ATLAS Muon Spectrometer, particularly in terms of data throughput, timing distribution and system reliability. The Phase-II Chamber Service Module (CSM) is a key component of the upgraded Monitored Drift Tube (MDT) trigger and readout system, providing a high-speed interface between the front-end electronics and the backend systems. This paper describes the design and implementation of the Phase-II CSM, together with its validation. The results show that the CSM supports two independent optical uplinks, each operating at a line rate of 10.24 Gbps, together with clock distribution and slow control in the expected operating environment. Integration with small-diameter MDT (sMDT) chambers and tests with the prototype L0MDT trigger system are also presented. The CSM boards are now in production and will be used for installation and integration during the upcoming LHC Long Shutdown.

physics.ins-det↗

arXiv2026

Spectral Discrimination of Deposited Gamma-Ray Energies in a Simulated CeBr$_3$ Scintillator

We show that wavelength measurements of individual detected optical photons may provide additional information about gamma-ray energy deposited in a CeBr$_3$ crystal when the detected-photon-count distributions overlap for nearby gamma-ray energies. Monoenergetic 662 and 629 keV gammas are used in a Geant4 simulation of a $25\times25\times20~\mathrm{mm^3}$ CeBr$_3$ crystal. Assuming a light yield of $6.0\times10^4$ photons/MeV, a wavelength-independent photon-detection efficiency of 30%, and a wavelength resolution of $\sigma_{\lambda}=40$ nm, we find that the fraction of photons reconstructed above 385 nm gives an event-level separation of $\sim$ 2 standard deviations between the 662 and 629 keV event populations selected within the same $\sim$ 1%-wide detected-photon-count interval. No timing or reconstructed interaction-position information is used. The result demonstrates, within the present simulation model, that event-dependent optical spectra can retain energy information beyond an undifferentiated photon count.

physics.ins-det↗

arXiv2026

Operation of a negative ion gas time projection chamber without electronegative fill gases

The high fidelity reconstruction of particle tracks in micropatterned gaseous time projection chambers renders this technology ideal for future rare-event searches, including direction-sensitive dark matter experiments. Large drift distances are typically required for such experiments, so that the overall spatial resolution is limited by diffusion. Negative ion drift exhibits lower diffusion than electron drift and is thus an attractive option for realising a large-scale detector. The use of electronegative gases to create negative ions introduces technical challenges, most notably a reduction in gain when compared to conventional gas mixtures. In this study, we demonstrate a new method for negative ion generation via dissociative electron attachment using the conventional molecular fill gas CF$_4$. Our optical measurements of negative ion drift indicate electron attachment lengths of $<$1 mm and comparable gain to electron avalanches. The individual negative ion avalanches were also time-resolved, allowing the number of ions reaching the readout to be counted. We measure an improved energy resolution by single ion counting, relative to an integrated electron avalanche signal measured under identical gain conditions.

physics.ins-det↗