arXiv subjects

Bowei Huang

Publications and source records attributed to Bowei Huang.

4 recordsLinked to original sources

arXiv2026

Heterogeneous Multi-Expert Reinforcement Learning for Long-Horizon Multi-Goal Tasks in Autonomous Forklifts

Autonomous mobile manipulation in unstructured warehouses requires a balance between efficient large-scale navigation and high-precision object interaction. Traditional end-to-end learning approaches often struggle to handle the conflicting demands of these distinct phases. Navigation relies on robust decision-making over large spaces, while manipulation needs high sensitivity to fine local details. Forcing a single network to learn these different objectives simultaneously often causes optimization interference, where improving one task degrades the other. To address these limitations, we propose a Heterogeneous Multi-Expert Reinforcement Learning (HMER) framework tailored for autonomous forklifts. HMER decomposes long-horizon tasks into specialized sub-policies controlled by a Semantic Task Planner. This structure separates macro-level navigation from micro-level manipulation, allowing each expert to focus on its specific action space without interference. The planner coordinates the sequential execution of these experts, bridging the gap between task planning and continuous control. Furthermore, to solve the problem of sparse exploration, we introduce a Hybrid Imitation-Reinforcement Training Strategy. This method uses expert demonstrations to initialize the policy and Reinforcement Learning for fine-tuning. Experiments in Gazebo simulations show that HMER significantly outperforms sequential and end-to-end baselines. Our method achieves a task success rate of 94.2\% (compared to 62.5\% for baselines), reduces operation time by 21.4\%, and maintains placement error within 1.5 cm, validating its efficacy for precise material handling.

cs.RO↗

arXiv2020

EasyRL: A Simple and Extensible Reinforcement Learning Framework

In recent years, Reinforcement Learning (RL), has become a popular field of study as well as a tool for enterprises working on cutting-edge artificial intelligence research. To this end, many researchers have built RL frameworks such as openAI Gym and KerasRL for ease of use. While these works have made great strides towards bringing down the barrier of entry for those new to RL, we propose a much simpler framework called EasyRL, by providing an interactive graphical user interface for users to train and evaluate RL agents. As it is entirely graphical, EasyRL does not require programming knowledge for training and testing simple built-in RL agents. EasyRL also supports custom RL agents and environments, which can be highly beneficial for RL researchers in evaluating and comparing their RL models.

cs.AI↗

arXiv2019

Design of reversible low-field magnetocaloric effect at room temperature in hexagonal MnMX ferromagnets

Giant magnetocaloric effect is widely achieved in hexagonal MnMX-based (M = Co or Ni, X = Si or Ge) ferromagnets at their first-order magnetostructural transition. However, the thermal hysteresis and the low sensitivity of the magnetostructural transition to the magnetic field inevitably lead to a sizeable irreversibility of the low-field magnetocaloric effect. In this work, we show an alternative way to realize a reversible low-field magnetocaloric effect in MnMX-based alloys by taking advantage of the second-order phase transition. With introducing Cu into Co in MnCoGe alloy, the martensitic transition is stabilized at high temperature, while the Curie temperature of the orthorhombic phase is reduced to room temperature. As a result, a second-order magnetic transition with negligible thermal hysteresis and a large magnetization change can be observed, enabling a large reversible magnetocaloric effect. By both calorimetric and direct measurements, a reversible adiabatic temperature change of about 1 K is obtained under a field change of 0-1 T at 304 K, which is larger than that obtained in a first-order magnetostructural transition. To get a better insight into the origin of these experimental results, first-principles calculations are carried out to characterize the chemical bonds and the magnetic exchange interaction. Our work provides a new understanding of the MnCoGe alloy and indicates a feasible route to improve the reversibility of the low-field magnetocaloric effect in the MnMX system.

cond-mat.mtrl-sci↗

arXiv2018

Ultra-low Hysteresis in Giant Magnetocaloric Mn1-xVxFe(P,Si,B) Compounds

Large thermal hysteresis in the MnFe(P, Si, B) system hinders the heat exchange rate and thus limits the magnetocaloric applications at high frequencies. Substitution of Mn by V in Mn1-xVxFe0.95P0.593Si0.33B0.077 and Mn1-xVxFe0.95P0.563Si0.36B0.077 alloys was found to reduce the thermal hysteresis due to a decrease in the latent heat. Introducing V increases both the field-induced transition temperature shift and the magnetic moment per formula unit. Thus, a decease in the thermal hysteresis is obtained without losing the giant magnetocaloric effect. In consequence, an ultralow hysteresis (0.7 K) and a giant adiabatic temperature change of 2.3 K were achieved, which makes these alloys promising candidates for commercial magnetic refrigerator using permanent magnets.

cond-mat.mtrl-sci↗