arXiv subjects

Minghao Zhang

Publications and source records attributed to Minghao Zhang.

36 records · Page 2Linked to original sources

arXiv2023

Elucidating Dynamic Conductive State Changes in Amorphous Lithium Lanthanum Titanate for Resistive Switching Devices

Exploration of novel resistive switching materials attracts attention to replace conventional Si-based transistors and to achieve neuromorphic computing that can surpass the limit of the current Von-Neumann computing for the time of Internet of Things (IoT). Materials priorly used to serve in batteries have demonstrated metal-insulator transitions upon an electrical biasing due to resulting compositional change. This property is desirable for future resistive switching devices. Amorphous lithium lanthanum titanate (a-LLTO) was originally developed as a solid-state electrolyte with relatively high lithium ionic conductivity and low electronic conductivity among oxide-type solid electrolytes. However, it has been suggested that electric conductivity of a-LLTO changes depending on oxygen content. In this work, the investigation of switching behavior of a-LLTO was conducted by employing a range of voltage sweep techniques, ultimately establishing a stable and optimal operating condition within the voltage window of -3.5 V to 3.5 V. This voltage range effectively balances the desirable trait of a substantial resistance change by three orders of magnitude with the imperative avoidance of LLTO decomposition. This switching behavior is also confirmed at nanodevice of Ni/LLTO/Ni through in-situ biasing inside focused-ion beam/scanning electron microscope (FIB-SEM). Experiment and computation with different LLTO composition shows that LLTO has two distinct conductivity states due to Ti reduction. The distribution of these two states is discussed using simplified binary model, implying the conductive filament growth during low resistance state. Consequently, our study deepens understanding of LLTO electronic properties and encourages the interdisciplinary application of battery materials for resistive switching devices.

physics.app-ph↗

arXiv2023

Quantitative Analysis of Sodium Metal Deposition and Interphase in Na Metal Batteries

Sodium-ion batteries exhibit significant promise as a viable alternative to current lithium-ion technologies owing to their sustainability, low cost per energy density, reliability, and safety. Despite recent advancements in cathode materials for this category of energy storage systems, the primary challenge in realizing practical applications of sodium-ion systems is the absence of an anode system with high energy density and durability. Although Na metal is the ultimate anode that can facilitate high-energy sodium-ion batteries, its use remains limited due to safety concerns and the high-capacity loss associated with the high reactivity of Na metal. In this study, titration gas chromatography is employed to accurately quantify the sodium inventory loss in ether- and carbonate-based electrolytes. Uniaxial pressure is developed as a powerful tool to control the deposition of sodium metal with dense morphology, thereby enabling high initial coulombic efficiencies. In ether-based electrolytes, the Na metal surface exhibits the presence of a uniform solid electrolyte interphase layer, primarily characterized by favorable inorganic chemical components with close-packed structures. The full cell, utilizing a controlled electroplated sodium metal in ether-based electrolyte, provides capacity retention of 91.84% after 500 cycles at 2C current rate and delivers 86 mAh/g discharge capacity at 45C current rate, suggesting the potential to enable Na metal in the next generation of sodium-ion technologies with specifications close to practical requirements.

physics.app-ph↗

arXiv2023

Freestanding LiPON: from Fundamental Study to Uniformly Dense Li Metal Deposition Under Zero External Pressure

Lithium phosphorus oxynitride (LiPON) is a well-known amorphous thin film solid electrolyte that has been extensively studied in the last three decades. Despite the promises to pair with Li metal anode and various cathode materials, the presence of rigid substrate and LiPONs unique amorphous, air-sensitive nature set limitations to comprehensively understand its intrinsic properties for future development and applications. This work demonstrates a methodology to synthesize LiPON in a freestanding form that exhibits remarkable flexibility and a Young s modulus of ~33 GPa. Solid-state nuclear magnetic resonance (ss-NMR) and differential scanning calorimetry (DSC) results with unprecedented high signal-to-noise ratio could be obtained with such freestanding LiPON (FS-LiPON), revealing the Li-LiPON interface bonding environments quantitatively and a well-defined glass transition temperature for LiPON. Combining interfacial stress and a seeding layer, FS-LiPON demonstrates a uniform and fully dense Li metal deposition without the aid of external pressure. Such a FS-LiPON film offers new opportunities for fundamental study of LiPON material and associated interfaces, and provides perspectives for interface engineering in bulk solid-state battery.

cond-mat.mtrl-sci↗

arXiv2022

Tianshou: a Highly Modularized Deep Reinforcement Learning Library

In this paper, we present Tianshou, a highly modularized Python library for deep reinforcement learning (DRL) that uses PyTorch as its backend. Tianshou intends to be research-friendly by providing a flexible and reliable infrastructure of DRL algorithms. It supports online and offline training with more than 20 classic algorithms through a unified interface. To facilitate related research and prove Tianshou's reliability, we have released Tianshou's benchmark of MuJoCo environments, covering eight classic algorithms with state-of-the-art performance. We open-sourced Tianshou at https://github.com/thu-ml/tianshou/.

cs.LG↗

arXiv2022

Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising paradigm for agile locomotion skills with vision inputs in simulation, it is still very challenging to deploy the RL policy in the real world. Our key insight is that aside from the discrepancy in the domain gap, in visual appearance between the simulation and the real world, the latency from the control pipeline is also a major cause of difficulty. In this paper, we propose Multi-Modal Delay Randomization (MMDR) to address this issue when training RL agents. Specifically, we simulate the latency of real hardware by using past observations, sampled with randomized periods, for both proprioception and vision. We train the RL policy for end-to-end control in a physical simulator without any predefined controller or reference motion, and directly deploy it on the real A1 quadruped robot running in the wild. We evaluate our method in different outdoor environments with complex terrains and obstacles. We demonstrate the robot can smoothly maneuver at a high speed, avoid the obstacles, and show significant improvement over the baselines. Our project page with videos is at https://mehooz.github.io/mmdr-wild/.

cs.RO↗

arXiv2022

Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers

We propose to address quadrupedal locomotion tasks using Reinforcement Learning (RL) with a Transformer-based model that learns to combine proprioceptive information and high-dimensional depth sensor inputs. While learning-based locomotion has made great advances using RL, most methods still rely on domain randomization for training blind agents that generalize to challenging terrains. Our key insight is that proprioceptive states only offer contact measurements for immediate reaction, whereas an agent equipped with visual sensory observations can learn to proactively maneuver environments with obstacles and uneven terrain by anticipating changes in the environment many steps ahead. In this paper, we introduce LocoTransformer, an end-to-end RL method that leverages both proprioceptive states and visual observations for locomotion control. We evaluate our method in challenging simulated environments with different obstacles and uneven terrain. We transfer our learned policy from simulation to a real robot by running it indoors and in the wild with unseen obstacles and terrain. Our method not only significantly improves over baselines, but also achieves far better generalization performance, especially when transferred to the real robot. Our project page with videos is at https://rchalyang.github.io/LocoTransformer/ .

cs.LG↗

arXiv2022

Unraveling the stable cathode electrolyte interface in all solid-state thin-film battery operating at 5V

Spinel-type LiNi0.5Mn1.5O4 (LNMO) is one of the most promising 5 V-class cathode materials for Li-ion batteries that can achieve high energy density and low production costs. However, in liquid electrolyte cells, the high voltage causes continuous cell degradation through the oxidative decomposition of carbonate-based liquid electrolytes. In contrast, some solid-state electrolytes have a wide electrochemical stability range and can withstand the required oxidative potential. In this work, a thin-film battery consisting of a LNMO cathode with a solid lithium phosphorus oxynitride (LiPON) electrolyte is tested and their interface before and after cycling is characterized. With Li metal as the anode, this system can deliver stable performance for 600 cycles with an average Coulombic efficiency > 99%. Neutron depth profiling indicates a slight overlithiated layer at the interface prior to cycling; a result that is consistent with the excess charge capacity measured during the first cycle. Cryogenic electron microscopy further reveals intimate contact between LNMO and LiPON without noticeable structure and chemical composition evolution after extended cycling, demonstrating the superior stability of LiPON against a high voltage cathode. Consequently, we propose design guidelines for interface engineering that could accelerate the commercialization of a high voltage cell with solid or liquid electrolytes.

cond-mat.mtrl-sci↗

arXiv2021

Disorder Dynamics in Battery Nanoparticles During Phase Transitions Revealed by Operando Single-Particle Diffraction

Structural and ion-ordering phase transitions limit the viability of sodium-ion intercalation materials in grid scale battery storage by reducing their lifetime. However, the combination of phenomena in nanoparticulate electrodes creates complex behavior that is difficult to investigate, especially on the single nanoparticle scale under operating conditions. In this work, operando single-particle x-ray diffraction (oSP-XRD) is used to observe single-particle rotation, interlayer spacing, and layer misorientation in a functional sodium-ion battery. oSP-XRD is applied to Na$_{2/3}$[Ni$_{1/3}$Mn$_{2/3}$]O$_{2}$, an archetypal P2-type sodium-ion positive electrode material with the notorious P2-O2 phase transition induced by sodium (de)intercalation. It is found that during sodium extraction, the misorientation of crystalline layers inside individual particles increases before the layers suddenly align just prior to the P2-O2 transition. The increase in the long-range order coincides with an additional voltage plateau signifying a phase transition prior to the P2-O2 transition. To explain the layer alignment, a model for the phase evolution is proposed that includes a transition from localized to correlated Jahn-Teller distortions. The model is anticipated to guide further characterization and engineering of sodium-ion intercalation materials with P2-O2 type transitions. oSP-XRD therefore opens a powerful avenue for revealing complex phase behavior in heterogeneous nanoparticulate systems.

cond-mat.mtrl-sci↗

arXiv2021

DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation

We address the problem of safely solving complex bimanual robot manipulation tasks with sparse rewards. Such challenging tasks can be decomposed into sub-tasks that are accomplishable by different robots concurrently or sequentially for better efficiency. While previous reinforcement learning approaches primarily focus on modeling the compositionality of sub-tasks, two fundamental issues are largely ignored particularly when learning cooperative strategies for two robots: (i) domination, i.e., one robot may try to solve a task by itself and leaves the other idle; (ii) conflict, i.e., one robot can interrupt another's workspace when executing different sub-tasks simultaneously, which leads to unsafe collisions. To tackle these two issues, we propose a novel technique called disentangled attention, which provides an intrinsic regularization for two robots to focus on separate sub-tasks and objects. We evaluate our method on five bimanual manipulation tasks. Experimental results show that our proposed intrinsic regularization successfully avoids domination and reduces conflicts for the policies, which leads to significantly more efficient and safer cooperative strategies than all the baselines. Our project page with videos is at https://mehooz.github.io/bimanual-attention.

cs.LG↗

arXiv2021

Structure-selective operando x-ray spectroscopy

The relationship between charge and structure dictates the properties of electrochemical systems. For example, reversible Na-ion intercalation - a low-cost alternative to Li-ion technology - often induces detrimental structural phase transformations coupled with charge compensation reactions. However, little is known about the underpinning charge-structure mechanisms because the reduction-oxidation (redox) reactions within coexisting structural phases have so far eluded direct operando investigation. Here, we distinguish x-ray spectra of individual crystalline phases operando during a redox-induced phase transformation in P2-Na2/3Ni1/3Mn2/3O2 - an archetypal layered oxide for sodium-ion batteries. We measure the resonant elastic scattering on the Bragg reflection corresponding to the P2-phase lattice spacing. These resonant spectra become static midway through the sodium extraction in an operando coin cell, while the overall sodium extraction proceeds as evidenced by the X-ray absorption averaging over all electrochemically active Ni atoms. The stop of redox activity in the P2-structure signifies its inability to host Ni4+ ions. The coincident emergence of the O2- structure reveals the rigid link between the local redox and the long-range order during the phase transformation. The structure-selective x-ray spectroscopy thus opens a powerful avenue for resolving the dynamic chemistry of different structural phases in multi-phase electrochemical systems.

cond-mat.mtrl-sci↗

arXiv2021

Conformal Three-Dimensional Interphase of Li Metal Anode Revealed by Low Dose Cryo-Electron Microscopy

Using cryogenic transmission electron microscopy, we revealed three dimensional (3D) structural details of the electrochemically plated lithium (Li) flakes and their solid electrolyte interphase (SEI), including the composite SEI skin-layer and SEI fossil pieces buried inside the Li matrix. As the SEI skin-layer is largely comprised of nanocrystalline LiF and Li2O in amorphous polymeric matrix, when complete Li stripping occurs, the compromised SEI three-dimensional framework buckles, forming nanoscale bends and wrinkles. We showed that the flexibility and resilience of the SEI skin-layer plays a vital role in preserving an intact SEI 3D framework after Li stripping. The intact SEI network enables the nucleation and growth of the newly plated Li inside the previously formed SEI network in the subsequent cycles, preventing additional large amount of SEI formation between newly plated Li metal and the electrolyte. In addition, cells cycled under the accurately controlled uniaxial pressure can further enhance the repeated utilization of the SEI framework and improve the coulombic efficiency (CE) by up to 97%, demonstrating an effective strategy of reducing the formation of additional SEI and inactive dead Li. The identification of such flexible and porous 3D SEI framework clarifies the working mechanism of SEI in lithium metal anode for batteries. The insights provided in this work will inspire researchers to design more functional artificial 3D SEI on other metal anodes to improve rechargeable metal battery with long cycle life.

cond-mat.mtrl-sci↗

arXiv2021

Metaphor Research in the 21st Century: A Bibliographic Analysis

Metaphor is widely used in human communication. The cohort of scholars studying metaphor in various fields is continuously growing, but very few work has been done in bibliographical analysis of metaphor research. This paper examines the advancements in metaphor research from 2000 to 2017. Using data retrieved from Microsoft Academic Graph and Web of Science, this paper makes a macro analysis of metaphor research, and expounds the underlying patterns of its development. Taking into consideration sub-fields of metaphor research, the internal analysis of metaphor research is carried out from a micro perspective to reveal the evolution of research topics and the inherent relationships among them. This paper provides novel insights into the current state of the art of metaphor research as well as future trends in this field, which may spark new research interests in metaphor from both linguistic and interdisciplinary perspectives.

cs.DL↗

arXiv2020

Unveiling the Stable Nature of the Solid Electrolyte Interphase between Lithium Metal and LiPON via Cryogenic Electron Microscopy

The solid electrolyte interphase (SEI) is regarded as the most complex but the least understood constituent in secondary batteries using liquid and solid electrolytes. The nanostructures of SEIs were recently reported to be equally important to the chemistry of SEIs for stabilizing Li metal in liquid electrolyte. However, the dearth of such knowledge in all-solid-state battery (ASSB) has hindered a complete understanding of how certain solid-state electrolytes, such as LiPON, manifest exemplary stability against Li metal. Characterizing such solid-solid interfaces is difficult due to the buried, highly reactive, and beam-sensitive nature of the constituents within. By employing cryogenic electron microscopy (cryo-EM), the interphase between Li metal and LiPON is successfully preserved and probed, revealing a multilayer mosaic SEI structure with concentration gradients of nitrogen and phosphorous, materializing as crystallites within an amorphous matrix. This unique SEI nanostructure is less than 80 nm and is shown stable and free of any organic lithium containing species or lithium fluoride components, in contrast to SEIs often found in state-of-the-art organic liquid electrolytes. Our findings reveal insights on the nanostructures and chemistry of such SEIs as a key component in lithium metal batteries to stabilize Li metal anode.

cond-mat.mtrl-sci↗

arXiv2020

Bridging Imagination and Reality for Model-Based Deep Reinforcement Learning

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary trajectories with a learned world model. However, world model learning may suffer from overfitting to training trajectories, and thus model-based value estimation and policy search will be pone to be sucked in an inferior local policy. In this paper, we propose a novel model-based reinforcement learning algorithm, called BrIdging Reality and Dream (BIRD). It maximizes the mutual information between imaginary and real trajectories so that the policy improvement learned from imaginary trajectories can be easily generalized to real trajectories. We demonstrate that our approach improves sample efficiency of model-based planning, and achieves state-of-the-art performance on challenging visual control benchmarks.

cs.LG↗

arXiv2020

Imaging real-time amorphization of hybrid perovskite solar cells under electrical biasing

Perovskite solar cells have drawn much attention in recent years, owing to its world-record setting photovoltaic performances. Despite its promising use in tandem applications and flexible devices, its practicality is still limited by its structural instability often arising from ion migration and defect formation. While it is generally understood that ion instability is a primary cause for degradation, there is still a lack of direct evidence of structural transformation at the atomistic scale. Such an understanding is crucial to evaluate and pin-point how such instabilities are induced relative to external perturbations such as illumination or electrical bias with time, allowing researchers to devise effective strategies to mitigate them. Here, we designed an in-situ TEM setup to enable real-time observation of amorphization in double cation mixed perovskite materials under electrical biasing at 1 V. It is found that amorphization occurs along the (001) and (002) planes, which represents the observation of in-situ facet-dependent amorphization of a perovskite crystal. To reverse the degradation, the samples were heated at 50 oC and was found to recrystallize, effectively regaining its performance losses. This work is vital toward understanding fundamental ion-migration phenomena and address instability challenges of perovskite optoelectronics.

cond-mat.mtrl-sci↗

arXiv2020

Pressure-tailored lithium deposition and dissolution in lithium metal batteries

A porous electrode resulting from unregulated Li growth is the major cause of the low Coulombic efficiency and potential safety hazards of rechargeable Li metal batteries. Strategies aiming to achieve large granular Li deposits have been extensively explored; yet, the ideal Li deposits, which consist of large Li particles that are seamlessly packed on the electrode and can be reversibly deposited and stripped, have never been achieved. Here, by controlling the uniaxial stack pressure during battery operation, a dense Li deposition (99.49% electrode density) with an ideal columnar structure has been achieved. Using multi-scale characterization and simulation, we elucidated the critical role of stack pressure on Li nucleation, growth and dissolution processes, and developed innovative strategies to maintain the ideal Li morphology during extended cycling. The precision manipulation of Li deposition and dissolution is a critical step to enable fast charging and low temperature operation for Li metal batteries.

physics.app-ph↗

arXiv2020

Glassy Li Metal Anode for High-Performance Rechargeable Li Batteries

Controlling nanostructure from molecular, crystal lattice to the electrode level remains as arts in practice, where nucleation and growth of the crystals still require more fundamental understanding and precise control to shape the microstructure of metal deposits and their properties. This is vital to achieve dendrite-free Li metal anodes with high electrochemical reversibility for practical high-energy rechargeable Li batteries. Here, cryogenic-transmission electron microscopy was used to capture the dynamic growth and atomic structure of Li metal deposits at the early nucleation stage, in which a phase transition from amorphous, disordered states to a crystalline, ordered one was revealed as a function of current density and deposition time. The real-time atomic interaction over wide spatial and temporal scales was depicted by the reactive-molecular dynamics simulations. The results show that the condensation accompanied with the amorphous-to-crystalline phase transition requires sufficient exergy, mobility and time to carry out, contrary to what the classical nucleation theory predicts. These variabilities give rise to different kinetic pathways and temporal evolutions, resulting in various degrees of order and disorder nanostructure in nano-sized domains that dominate in the morphological evolution and reversibility of Li metal electrode. Compared to crystalline Li, amorphous/glassy Li outperforms in cycle life in high-energy rechargeable batteries and is the desired structure to achieve high kinetic stability for long cycle life.

physics.app-ph↗

arXiv2019

Quantifying Inactive Lithium in Lithium Metal Batteries

Inactive lithium (Li) formation is the immediate cause of capacity loss and catastrophic failure of Li metal batteries. However, the chemical component and the atomic level structure of inactive Li have rarely been studied due to the lack of effective diagnosis tools to accurately differentiate and quantify Li+ in solid electrolyte interphase (SEI) components and the electrically isolated unreacted metallic Li0, which together comprise the inactive Li. Here, by introducing a new analytical method, Titration Gas Chromatography (TGC), we can accurately quantify the contribution from metallic Li0 to the total amount of inactive Li. We uncover that the Li0, rather than the electrochemically formed SEI, dominates the inactive Li and capacity loss. Using cryogenic electron microscopies to further study the microstructure and nanostructure of inactive Li, we find that the Li0 is surrounded by insulating SEI, losing the electronic conductive pathway to the bulk electrode. Coupling the measurements of the Li0 global content to observations of its local atomic structure, we reveal the formation mechanism of inactive Li in different types of electrolytes, and identify the true underlying cause of low Coulombic efficiency in Li metal deposition and stripping. We ultimately propose strategies to enable the highly efficient Li deposition and stripping to enable Li metal anode for next generation high energy batteries.

cond-mat.mtrl-sci↗