Searcharxiv⌕ Search

arXiv subjects

Tao Liu

Publications and source records attributed to Tao Liu.

At least 271 records · Page 15Linked to original sources

Anchor-Changing Regularized Natural Policy Gradient for Multi-Objective Reinforcement Learning

We study policy optimization for Markov decision processes (MDPs) with multiple reward value functions, which are to be jointly optimized according to given criteria such as proportional fairness (smooth concave scalarization), hard constraints (constrained MDP), and max-min trade-off. We propose an Anchor-changing Regularized Natural Policy Gradient (ARNPG) framework, which can systematically incorporate ideas from well-performing first-order methods into the design of policy optimization algorithms for multi-objective MDP problems. Theoretically, the designed algorithms based on the ARNPG framework achieve $\tilde{O}(1/T)$ global convergence with exact gradients. Empirically, the ARNPG-guided algorithms also demonstrate superior performance compared to some existing policy gradient-based approaches in both exact gradients and sample-based scenarios.

cs.LG↗

Distributed exponential state estimation of linear systems over jointly connected switching networks

Recently, the distributed state estimation problem for continuous-time linear systems over jointly connected switching networks was solved. It was shown that the estimation errors will asymptotically converge to the origin by using the generalized Barbalat's Lemma. This paper further studies the same problem with two new features. First, the asymptotic convergence is strengthened to the exponential convergence. This strengthened result not only offers a guaranteed convergence rate, but also renders the error system total stability and thus is able to withstand small disturbances. Second, the coupling gains of our local observers can be distinct and thus offers greater design flexibility, while the coupling gains in the existing result were required to be identical. These two new features are achieved by establishing exponential stability for two classes of linear time-varying systems, which may have other applications.

math.OC↗

Epitaxial growth of high quality $Mn_3Sn$ thin films by pulsed laser deposition

Non-collinear antiferromagnet Weyl semimetal $Mn_3Sn$ have attracted great research interest recently. Although large anomalous Hall effect, anomalous Nernst effect and magneto-optical effect have been observed in $Mn_3Sn$, most studies are based on single crystals. So far, it is still challenging to grow high quality epitaxial $Mn_3Sn$ thin films with transport and optical properties comparable to their single crystal counterparts. Here, we report the structure, magneto-optical and transport properties of epitaxial $Mn_3Sn$ thin films fabricated by pulsed laser deposition (PLD). Highly oriented $Mn_{3+x}Sn_{1-x}$ (0001) and (11$\bar2$0) epitaxial films are successfully growth on single crystalline $Al_2O_3$ and MgO substrates. Large anomalous Hall effect (AHE) up to $\left| ΔR_H\right|$=3.02 $μΩ\cdot cm$, and longitudinal magneto-optical Kerr effect (LMOKE) with $θ_K$ = 38.1 mdeg at 633 nm wavelength are measured at 300 K temperature, which are comparable to $Mn_3Sn$ single crystals. Our work demonstrates that high quality $Mn_3Sn$ epitaxial thin films can be fabricated by PLD, paving the way for future device applications.

cond-mat.mtrl-sci↗

Consensus-based Frequency and Voltage Regulation for Fully Inverter-based Islanded Microgrids

This paper proposes a new distributed consensus-based control method for voltage and frequency control of fully inverter-based islanded microgrids (MGs). The proposed method includes the active power sharing in voltage control to improve the reactive power sharing accuracy and thus generalizes some existing secondary frequency and voltage control methods. Firstly, frequency is regulated by distributed secondary frequency control. Secondly, voltage is regulated by distributed average voltage control and decentralized individual voltage control. It offers a tunable trade-off between voltage regulation, active, and reactive power sharing accuracy. Therefore, it avoids the abuse of sacrificing reactive power sharing accuracy for exact voltage regulation which is a common issue of existing methods. The proposed method is implemented in a distributed way that does not require a prior knowledge of the MG network structure and loads and hence can ensure scalability. Simulation results shows that the proposed controller achieves different compromise between the above three targets under different modes of operation.

eess.SY↗

Data-driven discovery of quasi-disordered mechanical metamaterials failed progressively

Natural cellular materials, such as honeycombs, woods, foams, trabecular bones, plant parenchyma, and sponges, may benefit from the disorderliness within their internal microstructures to achieve damage tolerant behaviours. Inspired by this, we have created quasi-disordered truss metamaterials (QTMs) via introducing spatial coordinate perturbations or strut thickness variations to the perfect, periodic truss lattices. Numerical studies have suggested that the QTMs can exhibit either ductile, damage tolerant behaviours or sudden, catastrophic failure mode, depending on the distribution of the introduced disorderliness. A data-driven approach has been developed, combining deep-learning and global optimization algorithms, to tune the distribution of the disorderliness to achieve the damage tolerant QTM designs. A case study on the QTMs created from a periodic Face Centred Cubic (FCC) lattice has demonstrated that the optimised QTMs can achieve up to 100% increase in ductility at the expense of less than 5% stiffness and less than 10% tensile strength. Our results suggest a novel design pathway for architected materials to improve damage tolerance.

cond-mat.dis-nn↗

Enhanced Higgs pair production from higgsino decay at the HL-LHC

The scenario of multi-sector SUSY breaking predicts pseudo-goldstinos which are not absorbed by the gravitino and their mass can be as low as ${{\cal O} (0.1)}$ GeV. Since the interactions of pseudo-goldstinos are not so weak as gravitino, a produced higgsino can decay to a pseudo-goldstino plus a Higgs boson insider the detector at the LHC, and thus the higgsino pair production can lead to the signal of Higgs pair plus missing energy. For the scenario of natural SUSY which requires rather light higgsinos, such events may sizably outnumber the Higgs pair events predicted by the SM and be accessible at the HL-LHC (14 TeV with a luminosity of 3~$\rm{ab}^{-1}$). In this work we examine the observability of such Higgs pair plus missing energy from the decay of light higgsinos produced at the HL-LHC. Considering three channels of the Higgs-pair decay ($bbWW^*$, $bbγγ$, $bbbb$), our detailed Monte Carlo simulations for the signal and backgrounds show that the best channel is $bbbb+\textrm{E\!\!\!\! \!\slash}_T$, whose statistical significance can reach $2σ$ level for a light higgsino allowed by current experiments. This is over the SM Higgs pair result which is about $1.8σ$.

hep-ph↗

The Roads One Must Walk Down: Commute and Depression for Beijing's Residents

As a vital aspect of individual's quality of life, mental health has been included as an important component of the U.N. Sustainable Development Goals. This study focuses on a specific aspect of mental health: depression, and examines its relationship with commute patterns. Using survey data from 1,528 residents in Beijing, China, we find that every 10 additional minutes of commute time is associated with 1.1% higher likelihood of depression. We test for the mechanisms of the commute-depression link and find that commute is associated with depression as a direct stressor rather than triggering higher work stress. When decomposing commute time into mode-specific time, we found that time on mopeds/motorcycles has the strongest association with depression. Moreover, the commute-depression associations are stronger for older workers and blue-collar workers. Hence, policies that could reduce commute time, encourage work from home, improve job-housing balance or increase motorcyclists' safety would help promote mental health.

econ.GN↗

Home-made blues: Residential crowding and mental health in Beijing, China

Although residential crowding has many well-being implications, its connection to mental health is yet to be widely examined. Using survey data from 1613 residents in Beijing, China, we find that living in a crowded place - measured by both square metres per person and persons per bedroom - is significantly associated with a higher risk of depression. We test for the mechanisms of such associations and find that the residential crowding-depression link arises through increased living space-specific stress rather than increased life stress. We also identify the following subgroups that have relatively stronger residential crowding-depression associations: females, those living with children, those not living with parents, and those living in non-market housing units. Our findings show that inequality in living space among urban residents not only is an important social justice issue but also has health implications.

econ.GN↗

Normalized Feature Distillation for Semantic Segmentation

As a promising approach in model compression, knowledge distillation improves the performance of a compact model by transferring the knowledge from a cumbersome one. The kind of knowledge used to guide the training of the student is important. Previous distillation methods in semantic segmentation strive to extract various forms of knowledge from the features, which involve elaborate manual design relying on prior information and have limited performance gains. In this paper, we propose a simple yet effective feature distillation method called normalized feature distillation (NFD), aiming to enable effective distillation with the original features without the need to manually design new forms of knowledge. The key idea is to prevent the student from focusing on imitating the magnitude of the teacher's feature response by normalization. Our method achieves state-of-the-art distillation results for semantic segmentation on Cityscapes, VOC 2012, and ADE20K datasets. Code will be available.

cs.CV↗

The BH-PSR Gravitational Molecule

While an axion-clouded black hole (BH) encounters a pulsar (PSR) or has a PSR companion, a "gravitational molecule" can be formed. In such a system, the axion cloud evolves at the binary hybrid orbitals, as it happens at microscopic level to electron cloud in a chemical molecule. To demonstrate this picture, we develop a semi-analytical formalism using the method of linear combination of atomic orbitals with an adiabatic approximation. An oscillating axion-cloud profile and a perturbed binary rotation, together with unique and novel detection signals, are then predicted. Remarkably, the proposed PSR timing and polarization observables, namely the oscillation of periastron time shift and the birefringence with multiple modulations, correlate in pattern, and thus can be properly combined to strengthen the detection.

astro-ph.HE↗

ATC-Based Scenario Decomposition Algorithm for Optimal Power Flow of Distribution Networks Considering High Photovoltaic Penetration

This paper focuses on the analytical target cascading (ATC) based scenario decomposition method which applies to the stochastic OPF problem of distribution networks with high photovoltaic penetration. The original two-stage stochastic OPF model is decomposed into a master problem in the upper level and multiple subproblems in the lower level. This decomposition makes subproblems easier to be solved and can also effectively overcome the curse of dimensionality in the traditional scenario-based model. The global optimal solution can be obtained by only transferring some necessary coupling information between the upper and lower levels. Moreover, all the subproblems in the lower level can be solved in a parallel manner which improves the computational efficiency, in particular, for cases with a larger number of scenarios. Case studies on the IEEE 33-bus system and various larger systems verify the effectiveness and adaptability of the proposed algorithm.

eess.SY↗

Rethinking the Defense Against Free-rider Attack From the Perspective of Model Weight Evolving Frequency

Federated learning (FL) is a distributed machine learning approach where multiple clients collaboratively train a joint model without exchanging their data. Despite FL's unprecedented success in data privacy-preserving, its vulnerability to free-rider attacks has attracted increasing attention. Existing defenses may be ineffective against highly camouflaged or high percentages of free riders. To address these challenges, we reconsider the defense from a novel perspective, i.e., model weight evolving frequency.Empirically, we gain a novel insight that during the FL's training, the model weight evolving frequency of free-riders and that of benign clients are significantly different. Inspired by this insight, we propose a novel defense method based on the model Weight Evolving Frequency, referred to as WEF-Defense.Specifically, we first collect the weight evolving frequency (defined as WEF-Matrix) during local training. For each client, it uploads the local model's WEF-Matrix to the server together with its model weight for each iteration. The server then separates free-riders from benign clients based on the difference in the WEF-Matrix. Finally, the server uses a personalized approach to provide different global models for corresponding clients. Comprehensive experiments conducted on five datasets and five models demonstrate that WEF-Defense achieves better defense effectiveness than the state-of-the-art baselines.

cs.LG↗

Snowmass 2021 White Paper: Resummation for future colliders

Resummation techniques are essential for high-precision phenomenology at current and future high-energy collider experiments. Perturbative computations of cross sections often suffer from large logarithmic corrections, which must be resummed to all orders to restore the reliability of predictions from first principles. The precise understanding of the all-order structure of field theories allows for fundamental tests of the Standard Model and new physics searches. In this white paper, we review recent progress in modern resummation techniques and outline future directions. In particular, we focus on the resummation beyond leading power, the joint resummation of different classes of logarithms relevant for jets and their substructure, small-$x$ resummation in the high-energy regime and the QCD fragmentation process in the small-$z_h$ limit.

hep-ph↗

Design and Commissioning of A Beam Distribution System for Multiple Undulator Line Operation of the SXFEL-UF

As an important measure of improving the efficiency and usability of X-ray free electron laser facilities, simultaneous operation of multiple undulator lines realized by a beam distribution system has become a standard configuration in the recent built XFEL facilities. In Shanghai, SXFEL-UF, the first soft X-ray free electron laser user facility in China, has finished construction and started commissioning recently. Electron beam from linac is alternately distributed between the two parallel undulator beam lines by a beam distribution system with a 6° deflection line. The beam distribution system is designed to keep the beam properties like low emittance, high peak charge and small bunch length from being spoiled. Beam collective effects such as the dispersion, coherent synchrotron radiation and micro-bunching instability should be well suppressed to guarantee the beam quality. In this work, the detailed physics design of the beam distribution system is described and the recent commissioning result is reported.

physics.acc-ph↗

Convex Relaxation of AC Optimal Power Flow with Flexible Transmission Line Impedances

Flexible transmission line impedances on one hand are a promising control resource for facilitating grid flexibility, but on the other hand add much complexity to the concerned optimization problems. This paper develops a convexification method for the AC optimal power flow with flexible line impedances. First, it is discovered that a flexible-impedance line is equivalent to a constant-impedance line linking a pair of transformers with correlated and continuously adjustable tap ratios. Then, with this circuit equivalent, the original optimization problem is reformulated into a semi-definite program under the existing convex relaxation framework, which improves the solution tractability and optimality in an easy-to-implement manner. The proposed method is verified by numerical tests on the IEEE 118-bus system.

math.OC↗

Autonomous Bikebot Control for Crossing Obstacles with Assistive Leg Impulsive Actuation

As a single-track mobile platform, bikebot (i.e., bicycle-based robot) has attractive navigation capability to pass through narrow, off-road terrain with high-speed and high-energy efficiency. However, running crossing step-like obstacles creates challenges for intrinsically unstable, underactuated bikebots. This paper presents a novel autonomous bikebot control with assistive leg actuation to navigate crossing obstacles. The proposed design integrates the external/internal convertible-based control with leg-assisted impulse control. The leg-terrain interaction generates assistive impulsive torques to help maintain the navigation and balance capability when running across obstacles. The control performance is analyzed and guaranteed. The experimental results confirm that under the control design, the bikebot can smoothly run crossing multiple step-like obstacles with height more than one third of the wheel radius. The comparison results demonstrate the superior performance than those under only the velocity and steering control without leg assistive impulsive actuation.

cs.RO↗

Coordinated Pose Control of Mobile Manipulation with an Unstable Bikebot Platform

Bikebot manipulation has advantages of the single-track robot mobility and manipulation dexterity. We present a coordinated pose control of mobile manipulation with the stationary bikebot. The challenges of the bikebot manipulation include the limited steering balance capability of the unstable bikebot and kinematic redundancy of the manipulator. We first present the steering balance model to analyze and explore the maximum steering capability to balance the stationary platform. A balancing equilibrium manifold is then proposed to describe the necessary condition to fulfill the simultaneous platform balance and posture control of the end-effector. A coordinated planning and control design is presented to determine the balance-prioritized posture control under kinematic and dynamic constraints. Extensive experiments are conducted to demonstrate the mechatronic design for autonomous plant inspection in agricultural applications. The results confirm the feasibility to use the bikebot manipulation for a plant inspection with end-effector position and orientation errors about 5 mm and 0.3 degs, respectively.

cs.RO↗

Radio Signals from Axion Star-Neutron Star Binaries

Axion stars could form binaries with neutron stars. Given the extremely strong external magnetic field exhibited by individual neutron stars, there can be a substantial conversion of axions to photons in these binaries. The photon emission is doubly modulated due to the neutron star spinning and the axion star orbiting, yielding a unique discovery signal. Similar features are also generated in binaries between a neutron star and an axion-clouded black hole. Encouragingly, such binaries are found to be within the reach of ongoing and upcoming experiments (e.g., the Five hundred meter Aperture Spherical Telescope and the future Square Kilometer Array) for certain parameter regions. They thus provide a promising astronomical laboratory for detecting axions and axion dark matter.

astro-ph.HE↗