arXiv subjects

Jian Shen

Publications and source records attributed to Jian Shen.

At least 55 records · Page 3Linked to original sources

arXiv2022

Direct visualization of edge state in even-layer MnBi2Te4 at zero magnetic field

Being the first intrinsic antiferromagnetic(AFM) topological insulator(TI), MnBi2Te4 is argued to be a topological axion state in its even-layer form due to the antiparallel magnetization between the top and bottom layers. Here we combine both transport and scanning microwave impedance microscopy(sMIM) to investigate such axion state in atomically thin MnBi2Te4 with even-layer thickness at zero magnetic field. While transport measurements show a zero Hall plateau signaturing the axion state, sMIM uncovers an unexpected edge state raising questions regarding the nature of the 'axion state'. Based on our model calculation, we propose that the edge state of even-layer MnBi2Te4 at zero field is derived from gapped helical edge states of the quantum spin Hall effect with time-reversal-symmetry breaking, when a crossover from a three-dimensional TI MnBi2Te4 to a two-dimensional TI occurs. Our finding thus signifies the richness of topological phases in MnB2Te4 that has yet to be fully explored.

cond-mat.mes-hall↗

arXiv2022

Electronically phase separated nano-network in antiferromagnetic insulating LaMnO3/PrMnO3/CaMnO3 tricolor superlattice

Strongly correlated materials often exhibit an electronic phase separation (EPS) phenomena whose domain pattern is random in nature. The ability to control the spatial arrangement of the electronic phases at microscopic scales is highly desirable for tailoring their macroscopic properties and/or designing novel electronic devices. Here we report the formation of EPS nanoscale network in a mono-atomically stacked LaMnO3/CaMnO3/PrMnO3 superlattice grown on SrTiO3 (STO) (001) substrate, which is known to have an antiferromagnetic (AFM) insulating ground state. The EPS nano-network is a consequence of an internal strain relaxation triggered by the structural domain formation of the underlying STO substrate at low temperatures. The same nanoscale network pattern can be reproduced upon temperature cycling allowing us to employ different local imaging techniques to directly compare the magnetic and transport state of a single EPS domain. Our results confirm the one-to-one correspondence between ferromagnetic (AFM) to metallic (insulating) state in manganite. It also represents a significant step in a paradigm shift from passively characterizing EPS in strongly correlated systems to actively engaging in its manipulation.

cond-mat.str-el↗

arXiv2022

Helical Luttinger liquid on the edge of a 2-dimensional topological antiferromagnet

Boundary helical Luttinger liquid (HLL) with broken bulk time-reversal symmetry belongs to a unique topological class which may occur in antiferromagnets (AFM). Here, we search for signatures of HLL on the edge of a recently discovered topological AFM, MnBi2Te4 even-layer. Using scanning superconducting quantum interference device, we directly image helical edge current in the AFM ground state appearing at its charge neutral point. Such helical edge state accompanies an insulating bulk which is topologically distinct from the ferromagnetic Chern insulator phase as revealed in a magnetic field driven quantum phase transition. The edge conductance of the AFM order follows a power-law as a function of temperature and source-drain bias which serves as strong evidence for HLL. Such HLL scaling is robust at finite fields below the quantum critical point. The observed HLL in a layered AFM semiconductor represents a highly tunable topological matter compatible with future spintronics and quantum computation.

cond-mat.mes-hall↗

arXiv2022

On Effective Scheduling of Model-based Reinforcement Learning

Model-based reinforcement learning has attracted wide attention due to its superior sample efficiency. Despite its impressive success so far, it is still unclear how to appropriately schedule the important hyperparameters to achieve adequate performance, such as the real data ratio for policy optimization in Dyna-style model-based algorithms. In this paper, we first theoretically analyze the role of real data in policy training, which suggests that gradually increasing the ratio of real data yields better performance. Inspired by the analysis, we propose a framework named AutoMBPO to automatically schedule the real data ratio as well as other hyperparameters in training model-based policy optimization (MBPO) algorithm, a representative running case of model-based methods. On several continuous control tasks, the MBPO instance trained with hyperparameters scheduled by AutoMBPO can significantly surpass the original one, and the real data ratio schedule found by AutoMBPO shows consistency with our theoretical analysis.

cs.LG↗

arXiv2022

Direct visualization of percolating metal-insulator transition in V2O3 using scanning microwave impedance microscopy

Using the extensively studied V2O3 as a prototype system, we investigate the role of percolation in metal-insulator transition (MIT). We apply scanning microwave impedance microscopy to directly determine the metallic phase fraction p and relate it to the macroscopic conductance G, which shows a sudden jump when p reaches the percolation threshold. Interestingly, the conductance G exhibits a hysteretic behavior against p, suggesting two different percolating processes upon cooling and warming. Based on our image analysis and model simulation, we ascribe such hysteretic behavior to different domain nucleation and growth processes between cooling and warming, which is likely caused by the decoupled structural and electronic transitions in V2O3 during MIT. Our work provides a microscopic view of how the interplay of structural and electronic degrees of freedom affects MIT in strongly correlated systems.

cond-mat.str-el↗

arXiv2022

Model-based Multi-agent Policy Optimization with Adaptive Opponent-wise Rollouts

This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL, and conduct a theoretic analysis of return discrepancy upper bound. To reduce the upper bound with the intention of low sample complexity during the whole learning process, we propose a novel decentralized model-based MARL method, named Adaptive Opponent-wise Rollout Policy Optimization (AORPO). In AORPO, each agent builds its multi-agent environment model, consisting of a dynamics model and multiple opponent models, and trains its policy with the adaptive opponent-wise rollout. We further prove the theoretic convergence of AORPO under reasonable assumptions. Empirical experiments on competitive and cooperative tasks demonstrate that AORPO can achieve improved sample efficiency with comparable asymptotic performance over the compared MARL methods.

cs.LG↗

arXiv2022

Towards Return Parity in Markov Decision Processes

Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in static settings over temporal domains may lead to delayed and adverse effects. To understand the dynamics of performance disparity, we study a fairness problem in Markov decision processes (MDPs). Specifically, we propose return parity, a fairness notion that requires MDPs from different demographic groups that share the same state and action spaces to achieve approximately the same expected time-discounted rewards. We first provide a decomposition theorem for return disparity, which decomposes the return disparity of any two MDPs sharing the same state and action spaces into the distance between group-wise reward functions, the discrepancy of group policies, and the discrepancy between state visitation distributions induced by the group policies. Motivated by our decomposition theorem, we propose algorithms to mitigate return disparity via learning a shared group policy with state visitation distributional alignment using integral probability metrics. We conduct experiments to corroborate our results, showing that the proposed algorithm can successfully close the disparity gap while maintaining the performance of policies on two real-world recommender system benchmark datasets.

cs.LG↗

arXiv2022

Influences of the dissipative topological edge state on quantized transport in MnBi2Te4

The beauty of quantum Hall (QH) effect is the metrological precision of Hall resistance quantization that originates from the topological edge states. Understanding the factors that lead to quantization breakdown not only provides important insights on the nature of the topological protection of these edge states, but is beneficial for device applications involving such quantized transport. In this work, we combine conventional transport and real space conductivity mapping to investigate whether the quantization breakdown is tied to the disappearance of edge state in the hotly studied MnBi2Te4 system. Our experimental results unambiguously show that topological edge state does exist when quantization breakdown occurs. Such edge state is dissipative in nature and could lead to a quantization breakdown due to its diffusive character causing overlapping with bulk and other edge states in real devices. Our findings bring attentions to issues that are generally inaccessible in the transport study of QH, but can play important roles in practical measurements and device applications.

cond-mat.mes-hall↗

arXiv2022

Curriculum Offline Imitation Learning

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally impractical due to the training instability and bootstrapping the extrapolation errors, which always require careful hyperparameter tuning via online evaluation. In contrast, offline imitation learning (IL) has no such issues since it learns the policy directly without estimating the value function by bootstrapping. However, IL is usually limited in the capability of the behavioral policy and tends to learn a mediocre behavior from the dataset collected by the mixture of policies. In this paper, we aim to take advantage of IL but mitigate such a drawback. Observing that behavior cloning is able to imitate neighboring policies with less data, we propose \textit{Curriculum Offline Imitation Learning (COIL)}, which utilizes an experience picking strategy for imitating from adaptive neighboring policies with a higher return, and improves the current policy along curriculum stages. On continuous control benchmarks, we compare COIL against both imitation-based and RL-based methods, showing that it not only avoids just learning a mediocre behavior on mixed datasets but is also even competitive with state-of-the-art offline RL methods.

cs.LG↗

arXiv2021

Pressure-induced charge orders and their coupling to magnetism in hexagonal multiferroic LuFe2O4

Hexagonal LuFe2O4 is a promising charge-order (CO) driven multiferroic material with high charge and spin ordering temperatures. The coexisting charge and spin orders on Fe3+/Fe2+ sites result in novel magnetoelectric behaviors, but the coupling mechanism between the charge and spin orders remains elusive. Here, by tuning external pressure, we reveal three correlated spin-charge ordered phases in LuFe2O4: i) a centrosymmetric incommensurate three-dimensional CO with ferrimagnetism, ii) a non-centrosymmetric incommensurate quasi-two-dimensional CO with ferrimagnetism, and iii) a centrosymmetric commensurate CO with antiferromagnetism. Experimental in-situ single-crystal X-ray diffraction and X-ray magnetic circular dichroism measurements combined with density functional theory calculations suggest that the charge density redistribution caused by pressure-induced compression in the frustrated double-layer [Fe2O4] cluster is responsible for the correlated spin-charge phase transitions. The pressure-enhanced effective Coulomb interactions among Fe-Fe bonds drive the frustrated (1/3, 1/3) CO to a less frustrated (1/4, 1/4) CO, which induces the ferrimagnetic to antiferromagnetic transition. Our results not only elucidate the coupling mechanism among charge, spin and lattice degrees of freedom in LuFe2O4 but also provide a new way to tune the spin-charge orders in a highly controlled manner.

cond-mat.mtrl-sci↗

arXiv2021

Task-wise Split Gradient Boosting Trees for Multi-center Diabetes Prediction

Diabetes prediction is an important data science application in the social healthcare domain. There exist two main challenges in the diabetes prediction task: data heterogeneity since demographic and metabolic data are of different types, data insufficiency since the number of diabetes cases in a single medical center is usually limited. To tackle the above challenges, we employ gradient boosting decision trees (GBDT) to handle data heterogeneity and introduce multi-task learning (MTL) to solve data insufficiency. To this end, Task-wise Split Gradient Boosting Trees (TSGB) is proposed for the multi-center diabetes prediction task. Specifically, we firstly introduce task gain to evaluate each task separately during tree construction, with a theoretical analysis of GBDT's learning objective. Secondly, we reveal a problem when directly applying GBDT in MTL, i.e., the negative task gain problem. Finally, we propose a novel split method for GBDT in MTL based on the task gain statistics, named task-wise split, as an alternative to standard feature-wise split to overcome the mentioned negative task gain problem. Extensive experiments on a large-scale real-world diabetes dataset and a commonly used benchmark dataset demonstrate TSGB achieves superior performance against several state-of-the-art methods. Detailed case studies further support our analysis of negative task gain problems and provide insightful findings. The proposed TSGB method has been deployed as an online diabetes risk assessment software for early diagnosis.

cs.LG↗

arXiv2021

MapGo: Model-Assisted Policy Optimization for Goal-Oriented Tasks

In Goal-oriented Reinforcement learning, relabeling the raw goals in past experience to provide agents with hindsight ability is a major solution to the reward sparsity problem. In this paper, to enhance the diversity of relabeled goals, we develop FGI (Foresight Goal Inference), a new relabeling strategy that relabels the goals by looking into the future with a learned dynamics model. Besides, to improve sample efficiency, we propose to use the dynamics model to generate simulated trajectories for policy training. By integrating these two improvements, we introduce the MapGo framework (Model-Assisted Policy Optimization for Goal-oriented tasks). In our experiments, we first show the effectiveness of the FGI strategy compared with the hindsight one, and then show that the MapGo framework achieves higher sample efficiency when compared to model-free baselines on a set of complicated tasks.

cs.AI↗

arXiv2020

Improving Knowledge Tracing via Pre-training Question Embeddings

Knowledge tracing (KT) defines the task of predicting whether students can correctly answer questions based on their historical response. Although much research has been devoted to exploiting the question information, plentiful advanced information among questions and skills hasn't been well extracted, making it challenging for previous work to perform adequately. In this paper, we demonstrate that large gains on KT can be realized by pre-training embeddings for each question on abundant side information, followed by training deep KT models on the obtained embeddings. To be specific, the side information includes question difficulty and three kinds of relations contained in a bipartite graph between questions and skills. To pre-train the question embeddings, we propose to use product-based neural networks to recover the side information. As a result, adopting the pre-trained embeddings in existing deep KT models significantly outperforms state-of-the-art baselines on three common KT datasets.

cs.IR↗

arXiv2020

Accurate phonon blockade detector composed of a quadratically coupled optomechanical system

The observation of phonon blockade in a nanomechanical oscillator is clear evidence of its quantum nature. However, it is still a severe challenge to measure the strong phonon blockade in an optomechanical system with effective nonlinear coupling. In this paper, we propose a theoretical proposal for detecting the phonon blockade effect in a quadratically coupled optomechanical system by exploiting supervised machine learning. The detected optical signals are injected into the neural network as the input, while the output is the mechanical equal-time second-order correlation. Our results show our scheme performs superior performance on detecting phonon blockade. Specifically, it is efficient for nonlinear coupling systems; it performs a high precision for strong photon blockade; it is robust against the small disturbance of system parameters. Our work opens a promising way to build a phonon blockade detector.

quant-ph↗

arXiv2020

Model-based Policy Optimization with Unsupervised Model Adaptation

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between simulated data and real data, this could lead to degraded performance. Despite much effort being devoted to reducing this distribution mismatch, existing methods fail to solve it explicitly. In this paper, we investigate how to bridge the gap between real and simulated data due to inaccurate model estimation for better policy optimization. To begin with, we first derive a lower bound of the expected return, which naturally inspires a bound maximization algorithm by aligning the simulated and real data distributions. To this end, we propose a novel model-based reinforcement learning framework AMPO, which introduces unsupervised model adaptation to minimize the integral probability metric (IPM) between feature distributions from real and simulated data. Instantiating our framework with Wasserstein-1 distance gives a practical model-based approach. Empirically, our approach achieves state-of-the-art performance in terms of sample efficiency on a range of continuous control benchmark tasks.

cs.LG↗

arXiv2020

Bidirectional Model-based Policy Optimization

Model-based reinforcement learning approaches leverage a forward dynamics model to support planning and decision making, which, however, may fail catastrophically if the model is inaccurate. Although there are several existing methods dedicated to combating the model error, the potential of the single forward model is still limited. In this paper, we propose to additionally construct a backward dynamics model to reduce the reliance on accuracy in forward model predictions. We develop a novel method, called Bidirectional Model-based Policy Optimization (BMPO) to utilize both the forward model and backward model to generate short branched rollouts for policy optimization. Furthermore, we theoretically derive a tighter bound of return discrepancy, which shows the superiority of BMPO against the one using merely the forward model. Extensive experiments demonstrate that BMPO outperforms state-of-the-art model-based methods in terms of sample efficiency and asymptotic performance.

cs.LG↗

arXiv2020

GIKT: A Graph-based Interaction Model for Knowledge Tracing

With the rapid development in online education, knowledge tracing (KT) has become a fundamental problem which traces students' knowledge status and predicts their performance on new questions. Questions are often numerous in online education systems, and are always associated with much fewer skills. However, the previous literature fails to involve question information together with high-order question-skill correlations, which is mostly limited by data sparsity and multi-skill problems. From the model perspective, previous models can hardly capture the long-term dependency of student exercise history, and cannot model the interactions between student-questions, and student-skills in a consistent way. In this paper, we propose a Graph-based Interaction model for Knowledge Tracing (GIKT) to tackle the above probems. More specifically, GIKT utilizes graph convolutional network (GCN) to substantially incorporate question-skill correlations via embedding propagation. Besides, considering that relevant questions are usually scattered throughout the exercise history, and that question and skill are just different instantiations of knowledge, GIKT generalizes the degree of students' master of the question to the interactions between the student's current state, the student's history related exercises, the target question, and related skills. Experiments on three datasets demonstrate that GIKT achieves the new state-of-the-art performance, with at least 1% absolute AUC improvement.

cs.AI↗

arXiv2020

Large-Scale Optimal Transport via Adversarial Training with Cycle-Consistency

Recent advances in large-scale optimal transport have greatly extended its application scenarios in machine learning. However, existing methods either not explicitly learn the transport map or do not support general cost function. In this paper, we propose an end-to-end approach for large-scale optimal transport, which directly solves the transport map and is compatible with general cost function. It models the transport map via stochastic neural networks and enforces the constraint on the marginal distributions via adversarial training. The proposed framework can be further extended towards learning Monge map or optimal bijection via adopting cycle-consistency constraint(s). We verify the effectiveness of the proposed method and demonstrate its superior performance against existing methods with large-scale real-world applications, including domain adaptation, image-to-image translation, and color transfer.

cs.CV↗