arXiv subjects

Mao Ye

Publications and source records attributed to Mao Ye.

At least 91 records · Page 5Linked to original sources

arXiv2024

Dynamical Model of Rotation and Orbital Coupling for Deimos

This paper introduces a novel dynamical model, building upon the existing dynamical model for Deimos in the current numerical ephemerides, which only encompasses the simple libration effects of Deimos. The study comprehensively incorporates the rotational dynamics of Deimos influenced by the torque exerted by the major celestial bodies (Mars, the Sun) in the solar system within the inertial space. Consequently, a full dynamical model is formulated to account for the complete coupling between the rotation and orbit of Deimos. Simultaneously, employing precision orbit determination methods used for artificial satellites, we develop an adjustment model for fitting data to the complete model. The 12-order Adams--Bashforth--Moulton (ABM) integration algorithm is employed to synchronously integrate the 12 state variables of the full model to obtain the orbit of Deimos. Numerical simulation results indicate that the full dynamical model and adjustment model are stable and reliable. Compared to the simple model, the polar axis of Deimos in the inertial space exhibits a more complex oscillation in the full model. This work further advances the current dynamical model for Deimos and establishes the foundational model for the generation of a new set of precise numerical ephemerides for Deimos.

astro-ph.EP↗

arXiv2024

Exploring Fermi Surface Nesting and the Nature of Heavy Quasiparticles in the Spin-Triplet Superconductor Candidate CeRh$_2$As$_2$

In this study, we investigate the electronic structure of a spin-triplet superconductor candidate CeRh$_2$As$_2$ using high-resolution angle-resolved photoemission spectroscopy and density functional theory calculations. Notably, Fermi surface nesting hints at connections to magnetic excitation or quadrupole density wave phenomena, elucidating the superconducting mechanisms. Measured band structures reveal primarily localized 4f electrons, with minor itinerant contributions. Additionally, a transition from localized to itinerant behavior and significant c-f hybridization anisotropy underscore the role of f-electrons in shaping electronic properties. These findings deepen our understanding of CeRh$_2$As$_2$'s unconventional superconductivity and magnetism. Further exploration promises advances in superconductivity research.

cond-mat.supr-con↗

arXiv2024

Source-Free Domain Adaptation with Frozen Multimodal Foundation Model

Source-Free Domain Adaptation (SFDA) aims to adapt a source model for a target domain, with only access to unlabeled target training data and the source model pre-trained on a supervised source domain. Relying on pseudo labeling and/or auxiliary supervision, conventional methods are inevitably error-prone. To mitigate this limitation, in this work we for the first time explore the potentials of off-the-shelf vision-language (ViL) multimodal models (e.g.,CLIP) with rich whilst heterogeneous knowledge. We find that directly applying the ViL model to the target domain in a zero-shot fashion is unsatisfactory, as it is not specialized for this particular task but largely generic. To make it task specific, we propose a novel Distilling multimodal Foundation model(DIFO)approach. Specifically, DIFO alternates between two steps during adaptation: (i) Customizing the ViL model by maximizing the mutual information with the target model in a prompt learning manner, (ii) Distilling the knowledge of this customized ViL model to the target model. For more fine-grained and reliable distillation, we further introduce two effective regularization terms, namely most-likely category encouragement and predictive consistency. Extensive experiments show that DIFO significantly outperforms the state-of-the-art alternatives. Code is here

cs.CV↗

arXiv2024

Unveiling the charge density wave mechanism in vanadium-based Bi-layered kagome metals

The charge density wave (CDW), as a hallmark of vanadium-based kagome superconductor AV3Sb5 (A = K, Rb, Cs), has attracted intensive attention. However, the fundamental controversy regarding the underlying mechanism of CDW therein persists. Recently, the vanadium-based bi-layered kagome metal ScV6Sn6, reported to exhibit a long-range charge order below 94 K, has emerged as a promising candidate to further clarify this core issue. Here, employing micro-focusing angle-resolved photoemission spectroscopy (μ-ARPES) and first-principles calculations, we systematically studied the unique CDW order in vanadium-based bi-layered kagome metals by comparing ScV6Sn6 with its isostructural counterpart YV6Sn6, which lacks a CDW ground state. Combining ARPES data and the corresponding joint density of states (DOS), we suggest that the VHS nesting mechanism might be invalid in these materials. Besides, in ScV6Sn6, we identified multiple hybridization energy gaps resulting from CDW-induced band folding, along with an anomalous band dispersion, implying a potential electron-phonon coupling driven mechanism underlying the formation of the CDW order. Our finding not only comprehensively maps the electronic structure of V-based bi-layer kagome metals but also provide constructive experimental evidence for the unique origin of CDW in this system.

cond-mat.mtrl-sci↗

arXiv2024

Observation of plaid-like spin splitting in a noncoplanar antiferromagnet

Spatial, momentum and energy separation of electronic spins in condensed matter systems guides the development of novel devices where spin-polarized current is generated and manipulated. Recent attention on a set of previously overlooked symmetry operations in magnetic materials leads to the emergence of a new type of spin splitting, enabling giant and momentum-dependent spin polarization of energy bands on selected antiferromagnets. Despite the ever-growing theoretical predictions, the direct spectroscopic proof of such spin splitting is still lacking. Here, we provide solid spectroscopic and computational evidence for the existence of such materials. In the noncoplanar antiferromagnet MnTe$_2$, the in-plane components of spin are found to be antisymmetric about the high-symmetry planes of the Brillouin zone, comprising a plaid-like spin texture in the antiferromagnetic (AFM) ground state. Such an unconventional spin pattern, further found to diminish at the high-temperature paramagnetic state, stems from the intrinsic AFM order instead of spin-orbit coupling (SOC). Our finding demonstrates a new type of quadratic spin texture induced by time-reversal breaking, placing AFM spintronics on a firm basis and paving the way for studying exotic quantum phenomena in related materials.

cond-mat.mtrl-sci↗

arXiv2023

Efficient Transformer-based 3D Object Detection with Dynamic Token Halting

Balancing efficiency and accuracy is a long-standing problem for deploying deep learning models. The trade-off is even more important for real-time safety-critical systems like autonomous vehicles. In this paper, we propose an effective approach for accelerating transformer-based 3D object detectors by dynamically halting tokens at different layers depending on their contribution to the detection task. Although halting a token is a non-differentiable operation, our method allows for differentiable end-to-end learning by leveraging an equivalent differentiable forward-pass. Furthermore, our framework allows halted tokens to be reused to inform the model's predictions through a straightforward token recycling mechanism. Our method significantly improves the Pareto frontier of efficiency versus accuracy when compared with the existing approaches. By halting tokens and increasing model capacity, we are able to improve the baseline model's performance without increasing the model's latency on the Waymo Open Dataset.

cs.CV↗

arXiv2023

Spatial-Temporal Transformer based Video Compression Framework

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented with neural networks (NNs). However, within the framework of NNs and its training mechanism using gradient backpropagation, most existing works often struggle to consistently generate stable motion information, which is in the form of geometric features, from the input color features. Moreover, the modules such as the inter-prediction and residual coding are independent from each other, making it inefficient to fully reduce the spatial-temporal redundancy. To address the above problems, in this paper, we propose a novel Spatial-Temporal Transformer based Video Compression (STT-VC) framework. It contains a Relaxed Deformable Transformer (RDT) with Uformer based offsets estimation for motion estimation and compensation, a Multi-Granularity Prediction (MGP) module based on multi-reference frames for prediction refinement, and a Spatial Feature Distribution prior based Transformer (SFD-T) for efficient temporal-spatial joint residual compression. Specifically, RDT is developed to stably estimate the motion information between frames by thoroughly investigating the relationship between the similarity based geometric motion feature extraction and self-attention. MGP is designed to fuse the multi-reference frame information by effectively exploring the coarse-grained prediction feature generated with the coded motion information. SFD-T is to compress the residual information by jointly exploring the spatial feature distributions in both residual and temporal prediction to further reduce the spatial-temporal redundancy. Experimental results demonstrate that our method achieves the best result with 13.5% BD-Rate saving over VTM.

eess.IV↗

arXiv2023

Improvement of image-type very-low-energy-electron-diffraction spin polarimeter

Spin- and angle-resolved photoemission spectroscopy (SARPES) with high efficiency and resolution plays a crucial role in exploring the fine spin-resolved band structures of quantum materials. Here we report the performance of SARPES instrument with a second-generation home-made multichannel very-low-energy-electron-diffraction (VLEED) spin polarimeter. Its energy and angular resolutions achieve 7.2 meV and 0.52°. We present the results of SARPES measurements of Bi(111) film to demonstrate its performance. Combined with the density functional theory (DFT) calculations, the spin polarization of the bulk states was confirmed from the spin-layer locking caused by the local inversion asymmetry. The surface states at binding energy of 0.77 eV are found with 1.0 {\pm} 0.11 spin polarization. The better resolutions and stability compared with the first-generation one provide a good platform to investigate the spin-polarized electronic states in materials.

physics.ins-det↗

arXiv2023

MSMix:An Interpolation-Based Text Data Augmentation Method Manifold Swap Mixup

To solve the problem of poor performance of deep neural network models due to insufficient data, a simple yet effective interpolation-based data augmentation method is proposed: MSMix (Manifold Swap Mixup). This method feeds two different samples to the same deep neural network model, and then randomly select a specific layer and partially replace hidden features at that layer of one of the samples by the counterpart of the other. The mixed hidden features are fed to the model and go through the rest of the network. Two different selection strategies are also proposed to obtain richer hidden representation. Experiments are conducted on three Chinese intention recognition datasets, and the results show that the MSMix method achieves better results than other methods in both full-sample and small-sample configurations.

cs.LG↗

arXiv2023

Bit Allocation using Optimization

In this paper, we consider the problem of bit allocation in Neural Video Compression (NVC). First, we reveal a fundamental relationship between bit allocation in NVC and Semi-Amortized Variational Inference (SAVI). Specifically, we show that SAVI with GoP (Group-of-Picture)-level likelihood is equivalent to pixel-level bit allocation with precise rate \& quality dependency model. Based on this equivalence, we establish a new paradigm of bit allocation using SAVI. Different from previous bit allocation methods, our approach requires no empirical model and is thus optimal. Moreover, as the original SAVI using gradient ascent only applies to single-level latent, we extend the SAVI to multi-level such as NVC by recursively applying back-propagating through gradient ascent. Finally, we propose a tractable approximation for practical implementation. Our method can be applied to scenarios where performance outweights encoding speed, and serves as an empirical bound on the R-D performance of bit allocation. Experimental results show that current state-of-the-art bit allocation algorithms still have a room of $\approx 0.5$ dB PSNR to improve compared with ours. Code is available at \url{https://github.com/tongdaxu/Bit-Allocation-Using-Optimization}.

cs.CV↗

arXiv2023

Single crystal synthesis and low-lying electronic structure of V$_3$S$_4$

We report successful growth of millimeter-sized high quality single crystals of V$_3$S$_4$, a candidate topological semimetal belonging to a low-symmetry space group and consisting of only low atomic number elements. Using density functional theory calculations and angle-resolved photoemission spectroscopy, we show that the nonmagnetic phase of monoclinic V$_3$S$_4$ hosts type-II Dirac-like quasiparticles which opens a sizable gap due to spin orbit coupling, as well as theoretical multiple nodal lines that are eliminated also by spin orbit coupling. These results suggest that relativistic effects give rise to profound modifications of the topological properties even in compounds with low-weight elements.

cond-mat.mtrl-sci↗

arXiv2023

Spectroscopic signature of obstructed surface states in SrIn$_2$P$_2$

The century-long development of surface sciences has witnessed the discoveries of a variety of quantum states. In the recently proposed "obstructed atomic insulators", insulators with symmetric charges pinned at virtual sites where no real atoms reside, the cleavage through these sites could lead to a set of obstructed surface states with partial occupation. Here, utilizing scanning tunneling microscopy, angle-resolved photoemission spectroscopy and first-principles calculations, we observe spectroscopic signature of obstructed surface states in SrIn$_2$P$_2$. We find a pair of surface states originated from the pristine obstructed surface states split by a unique surface reconstruction. The upper branch is marked with a striking differential conductance peak followed by negative differential conductance, signaling its localized nature, while the lower branch is found to be highly dispersive. This pair of surface states is in consistency with our calculational results. Our finding not only demonstrates a surface quantum state induced by a new type of bulk-boundary correspondence, but also provides a platform for exploring efficient catalysts and related surface engineering.

cond-mat.mtrl-sci↗

arXiv2023

Lithospheric loading model for large impact basin where mantle plug presents

Lithosphere is an outer rigid part of the terrestrial body, usually consisting of the crust and part of the mantle. Characterizing the physical properties of the lithosphere is critical in investigating its evolution. By modeling mass-related loads within the lithosphere, physical parameters such as the elastic thickness of the lithosphere can be inferred from gravity and topography data. In the impact basin region, however, the low topography-gravity correlation and the sharp change in admittance from negative to positive within a narrow spheric harmonic degree make this model inapplicable. In this work, we incorporated mantle uplift structures commonly formed in impact basin regions into the lithospheric loading model. The crustal-mantle boundary of this mantle uplift structure is inferred from the global crustal thickness model. The gravity anomaly of the deflected lithosphere is calculated at the surface and crustal-mantle boundary, then the theoretical gravity admittance and correlation can be compared with the observed data. We sampled parameters using this mantle loading model at Argyre and Isidis basin on Mars with a novel crustal thickness model from the InSight mission. Our work suggests that proper modelling of the impact-induced load is critical to understanding the physical properties of the planetary lithosphere in the basin region.

astro-ph.EP↗

arXiv2022

First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Data

We propose a family of First Hitting Diffusion Models (FHDM), deep generative models that generate data with a diffusion process that terminates at a random first hitting time. This yields an extension of the standard fixed-time diffusion models that terminate at a pre-specified deterministic time. Although standard diffusion models are designed for continuous unconstrained data, FHDM is naturally designed to learn distributions on continuous as well as a range of discrete and structure domains. Moreover, FHDM enables instance-dependent terminate time and accelerates the diffusion process to sample higher quality data with fewer diffusion steps. Technically, we train FHDM by maximum likelihood estimation on diffusion trajectories augmented from observed data with conditional first hitting processes (i.e., bridge) derived based on Doob's $h$-transform, deviating from the commonly used time-reversal mechanism. We apply FHDM to generate data in various domains such as point cloud (general continuous distribution), climate and geographical events on earth (continuous distribution on the sphere), unweighted graphs (distribution of binary matrices), and segmentation maps of 2D images (high-dimensional categorical distribution). We observe considerable improvement compared with the state-of-the-art approaches in both quality and speed.

cs.CV↗

arXiv2022

BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach

Bilevel optimization (BO) is useful for solving a variety of important machine learning problems including but not limited to hyperparameter optimization, meta-learning, continual learning, and reinforcement learning. Conventional BO methods need to differentiate through the low-level optimization process with implicit differentiation, which requires expensive calculations related to the Hessian matrix. There has been a recent quest for first-order methods for BO, but the methods proposed to date tend to be complicated and impractical for large-scale deep learning applications. In this work, we propose a simple first-order BO algorithm that depends only on first-order gradient information, requires no implicit differentiation, and is practical and efficient for large-scale non-convex functions in deep learning. We provide non-asymptotic convergence analysis of the proposed method to stationary points for non-convex objectives and present empirical results that show its superior practical performance.

cs.LG↗

arXiv2022

Pareto Navigation Gradient Descent: a First-Order Algorithm for Optimization in Pareto Set

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on the set of (often infinite number of) models that cannot be strictly improved. But it does not provide an actionable procedure for picking one or a few special models to return to practical users. In this paper, we consider \emph{optimization in Pareto set (OPT-in-Pareto)}, the problem of finding Pareto models that optimize an extra reference criterion function within the Pareto set. This function can either encode a specific preference from the users, or represent a generic diversity measure for obtaining a set of diversified Pareto models that are representative of the whole Pareto set. Unfortunately, despite being a highly useful framework, efficient algorithms for OPT-in-Pareto have been largely missing, especially for large-scale, non-convex, and non-linear objectives in deep learning. A naive approach is to apply Riemannian manifold gradient descent on the Pareto set, which yields a high computational cost due to the need for eigen-calculation of Hessian matrices. We propose a first-order algorithm that approximately solves OPT-in-Pareto using only gradient information, with both high practical efficiency and theoretically guaranteed convergence property. Empirically, we demonstrate that our method works efficiently for a variety of challenging multi-task-related problems.

math.OC↗

arXiv2022

Diffusion-based Molecule Generation with Informative Prior Bridges

AI-based molecule generation provides a promising approach to a large area of biomedical sciences and engineering, such as antibody design, hydrolase engineering, or vaccine development. Because the molecules are governed by physical laws, a key challenge is to incorporate prior information into the training procedure to generate high-quality and realistic molecules. We propose a simple and novel approach to steer the training of diffusion-based generative models with physical and statistics prior information. This is achieved by constructing physically informed diffusion bridges, stochastic processes that guarantee to yield a given observation at the fixed terminal time. We develop a Lyapunov function based method to construct and determine bridges, and propose a number of proposals of informative prior bridges for both high-quality molecule generation and uniformity-promoted 3D point cloud generation. With comprehensive experiments, we show that our method provides a powerful approach to the 3D generation task, yielding molecule structures with better quality and stability scores and more uniformly distributed point clouds of high qualities.

cs.LG↗

arXiv2022

Future Gradient Descent for Adapting the Temporal Shifting Data Distribution in Online Recommendation Systems

One of the key challenges of learning an online recommendation model is the temporal domain shift, which causes the mismatch between the training and testing data distribution and hence domain generalization error. To overcome, we propose to learn a meta future gradient generator that forecasts the gradient information of the future data distribution for training so that the recommendation model can be trained as if we were able to look ahead at the future of its deployment. Compared with Batch Update, a widely used paradigm, our theory suggests that the proposed algorithm achieves smaller temporal domain generalization error measured by a gradient variation term in a local regret. We demonstrate the empirical advantage by comparing with various representative baselines.

cs.LG↗