SearcharxivSearch

arXiv subjects

Xianming Song

Publications and source records attributed to Xianming Song.

6 recordsLinked to original sources

State-Space Model-Enabled Reinforcement Learning for Magnetic Configuration Controlon EXL-50U

Accurate feedback control of the plasma current ($I_p$) and centroid position $(R_c,Z_c)$ is essential for the stable operation of spherical torus (ST) plasmas. Conventional proportional-integral-derivative (PID) controllers require extensive manual tuning and struggle with the fast, strongly coupled dynamics that arise as plasma performance improves. Reinforcement learning (RL) has recently emerged as a promising alternative to such complex magnetic control problems, yet its practical deployment on ST devices remains challenging. This paper presents a practical RL controller for the EXL-50U ST, trained within a rigid RZIP state-space model (SSM) that enables efficient offline policy learning. A lightweight plasma position reconstructor is developed to estimate $(R_c,Z_c)$ from magnetic probe signals within the real-time control cycle. The trained policy is seamlessly deployed on the EXL-50U plasma control system, achieving stable regulation of $I_p$ and $(R_c,Z_c)$ and sustaining discharges up to 650 ms under RL control. These results demonstrate the feasibility and practical potential of model-informed RL for magnetic configuration control in ST devices, offering a promising direction beyond conventional PID-based schemes.

physics.plasm-ph

Advantage-level Aggregation Reinforcement Learning for X-point Target Magnetic Configuration Control in an EXL-50U Experiment-Calibrated Simulation Environment

Managing divertor heat loads is a central challenge for compact, high-power tokamaks. To increase local flux expansion and decouple the dissipation volume from the core, EHL-2 adopts the X-point target (XPT) divertor. This requires the secondary X-point to remain on the divertor leg; displacement degrades the topology and exhaust geometry. Current experiments, including EXL-50U discharges, rely on precomputed feedforward waveforms with PID loops on global quantities. Lacking dedicated closed-loop feedback for the secondary null, XPT operation is repeatable but not routine. We formulate XPT feedback as a multi-objective reinforcement learning (RL) control problem in a free-boundary environment calibrated to EXL-50U discharge #13906. To address strong coupling among plasma current, shape, and null constraints - where reward scalarisation collapses objective-specific temporal credit - we develop Advantage Aggregation (AdvA). AdvA preserves objective-wise temporal credit before worst-objective-aware nonlinear scalarisation and introduces a residual correction to policy updates. AdvA-PPO is evaluated against Reward-PPO and a feedforward-plus-PID baseline under nominal operation, measurement uncertainties, and unseen initial equilibria. On a 500 ms rollout, AdvA-PPO raises the mean worst-channel score from 0.23 to 0.81 over Reward-PPO, reducing X-point flux RMSE by ~20x. Under combined measurement uncertainties, it is the only learned controller completing the horizon while retaining a usable XPT shape. Multi-initialization fine-tuning enables a single AdvA-PPO policy to complete full-horizon operation across divertor and limiter initial equilibria. These results provide a simulation-based foundation for future real-time XPT validation on EXL-50U.

physics.plasm-ph

Non-Inductive Current Start-Up Using Multi-Harmonic Electron Cyclotron Wave and Current Ramp-Up Through Combined Electron Cyclotron Wave and Ohmic Heating in EXL-50U Spherical Torus

The non-inductive current start-up by multi-harmonic electron cyclotron wave has been systematically investigated in the EXL-50U spherical torus. Significant enhancements of the driven current with increasing number of resonance layers have been demonstrated by variation of the number of harmonic resonance layers of the ECW through adjustment of the magnetic field or plasma cross section. The critical role of multi-harmonic ECW in enhancing the driven current has been experimentally verified for the first time. To explain the related experimental observations, a physical mechanism involving multi-harmonic heating, multiple reflections, and multi-pass absorption - leading to the generation of high-energy electrons via X-mode wave or electron Bernstein wave has been proposed. The current drive capacity of the first harmonic extraordinary mode of the ECW has also been experimentally confirmed for the first time. After the application of Ohmic heating during the current ramp-up phase, the current drive efficiency of ECW is further enhanced. Leveraging the synergistic effect between ECW and Ohmic heating, EXL-50U achieved a plasma current of 1 MA, with the non-inductively driven current fraction reaching 70%.

physics.plasm-ph

Overview of EXL-50 Research Progress and Future Plan

XuanLong-50 (EXL-50) is the first medium-size spherical torus (ST) in China, with the toroidal field at major radius at 50 cm around 0.5T. CS-free and non-inductive current drive via electron cyclotron resonance heating (ECRH) was the main physics research issue for EXL-50. Discharges with plasma currents of 50 kA - 180 kA were routinely obtained in EXL-50, with the current flattop sustained for up to or beyond 2 s. The current drive effectiveness on EXL-50 was as high as 1 A/W for low-density discharges using 28GHz ECRH alone for heating power less than 200 kW. The plasma current reached Ip>80 kA for high-density (5*10e18m-2) discharges with 150 kW 28GHz ECRH. Higher performance discharge (Ip of about 120 kA and core density of about 1*10e19m-3) was achieved with 150 kW 50GHz ECRH. The plasma current in EXL-50 was mainly carried by the energetic electrons.Multi-fluid equilibrium model has been successfully applied to reconstruct the magnetic flux surface and the measured plasma parameters of the EXL-50 equilibrium. The physics mechanisms for the solenoid-free ECRH current drive and the energetic electrons has also been investigated. Preliminary experimental results show that 100 kW of lower hybrid current drive (LHCD) waves can drive 20 kA of plasma current. Several boron injection systems were installed and tested in EXL-50, including B2H6 gas puffing, boron powder injection, boron pellet injection. The research plan of EXL-50U, which is the upgrade machine of EXL-50, is also presented.

physics.plasm-ph

Observation of whistler wave instability driven by temperature anisotropy of energetic electrons on EXL-50 spherical torus

Electromagnetic modes in the frequency range of 30-120MHz were observed in electron cyclotron wave (ECW) steady state plasmas on the ENN XuanLong-50 (EXL-50) spherical torus. These modes were found to have multiple bands of frequencies proportional to the Alfvén velocity. This indicates that the observed mode frequencies satisfy the dispersion relation of whistler waves. In addition, suppression of the whistler waves by the synergistic effect of Lower Hybrid Wave (LHW) and ECW was also observed. This suggests that the whistler waves were driven by temperature anisotropy of energetic electrons. These are the first such observations (not runaway discharge) made in magnetically confined toroidal plasmas and may have important implications for studying wave-particle interactions, RF wave current driver, and runaway electron control in future fusion devices.

physics.plasm-ph

Solenoid-free current drive via ECRH in EXL-50 spherical torus plasmas

As a new spherical tokamak (ST) designed to simplify engineering requirements of a possible future fusion power source, the EXL-50 experiment features a low aspect ratio (A) vacuum vessel (VV), encircling a central post assembly containing the toroidal field coil conductors without a central solenoid. Multiple electron cyclotron resonance heating (ECRH) resonances are located within the VV to improve current drive effectiveness. Copious energetic electrons are produced and measured with hard X-ray detectors, carry the bulk of the plasma current ranging from 50kA to 150kA, which is maintained for more than 1s duration. It is observed that over one Ampere current can be maintained per Watt of ECRH power issued from the 28-GHz gyrotrons. The plasma current reaches Ip>80kA for high density (>5e18me-2) discharge with 150kW ECHR heating. An analysis was carried out combining reconstructed multi-fluid equilibrium, guiding-center orbits of energetic electrons, and resonant heating mechanisms. It is verified that in EXL-50 a broadly distributed current of energetic electrons creates smaller closed magnetic-flux surfaces of low aspect ratio that in turn confine the thermal plasma electrons and ions and participate in maintaining the equilibrium force-balance.

physics.plasm-ph