SearcharxivSearch

arXiv subjects

Brian Freeman

Publications and source records attributed to Brian Freeman.

3 recordsLinked to original sources

Toward Epistemic Stability: Engineering Consistent Procedures for Industrial LLM Hallucination Reduction

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design, enterprise resource planning, and IoT telemetry platforms. We present and compare five prompt engineering strategies intended to reduce the variance of model outputs and move toward repeatable, grounded results without modifying model weights or creating complex validation models. These methods include: (M1) Iterative Similarity Convergence, (M2) Decomposed Model-Agnostic Prompting, (M3) Single-Task Agent Specialization, (M4) Enhanced Data Registry, and (M5) Domain Glossary Injection. Each method is evaluated against an internal baseline using an LLM-as-Judge framework over 100 repeated runs per method (same fixed task prompt, stochastic decoding at tau = 0.7. Under this evaluation setup, M4 (Enhanced Data Registry) received ``Better'' verdicts in all 100 trials; M3 and M5 reached 80% and 77% respectively; M1 reached 75%; and M2 was net negative at 34% when compared to single shot prompting with a modern foundation model. We then developed enhanced version 2 (v2) implementations and assessed them on a 10-trial verification batch; M2 recovered from 34% to 80%, the largest gain among the four revised methods. We discuss how these strategies help overcome the non-deterministic nature of LLM results for industrial procedures, even when absolute correctness cannot be guaranteed. We provide pseudocode, verbatim prompts, and batch logs to support independent assessment.

cs.SE

Conceptual Design of Highly-Constrained Splitters for the FFA@CEBAF Energy Upgrade Study

The Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab is investigating a significant energy upgrade utilizing Fixed-Field Alternating-gradient (FFA) recirculating arcs. This upgrade requires the design of complex horizontal beam splitters to manage up to six concurrent beam passes. This paper presents the conceptual design of these splitters, which are subject to severe physical constraints imposed by the existing accelerator tunnel and multifaceted beam dynamics requirements for matching into the permanent-magnet FFA arcs. The design methodology, centered on multi-pass simulations in the Bmad toolkit, is detailed from the initial geometric layout through the advanced optics matching. Key results include a robust geometric arrangement that fits within the spatial boundaries and the development of multiple, flexible optics matching solutions. Furthermore, the design integrates a viable scheme for extracting high-energy beams for the experimental halls, a critical operational requirement. This work establishes a comprehensive and viable conceptual design, forming a baseline for future engineering and performance optimization studies.

physics.acc-ph

Anomaly Detection of Particle Orbit in Accelerator using LSTM Deep Learning Technology

A stable, reliable, and controllable orbit lock system is crucial to an electron (or ion) accelerator because the beam orbit and beam energy instability strongly affect the quality of the beam delivered to experimental halls. Currently, when the orbit lock system fails operators must manually intervene. This paper develops a Machine Learning based fault detection methodology to identify orbit lock anomalies and notify accelerator operations staff of the off-normal behavior. Our method is unsupervised, so it does not require labeled data. It uses Long-Short Memory Networks (LSTM) Auto Encoder to capture normal patterns and predict future values of monitoring sensors in the orbit lock system. Anomalies are detected when the prediction error exceeds a threshold. We conducted experiments using monitoring data from Jefferson Lab's Continuous Electron Beam Accelerator Facility (CEBAF). The results are promising: the percentage of real anomalies identified by our solution is 68.6%-89.3% using monitoring data of a single component in the orbit lock control system. The accuracy can be as high as 82%.

cs.LG