Searcharxiv⌕ Search

arXiv subjects

Bin Yang

Publications and source records attributed to Bin Yang.

At least 181 records · Page 10Linked to original sources

Data Driven Decision Making with Time Series and Spatio-temporal Data

Time series data captures properties that change over time. Such data occurs widely, ranging from the scientific and medical domains to the industrial and environmental domains. When the properties in time series exhibit spatial variations, we often call the data spatio-temporal. As part of the continued digitalization of processes throughout society, increasingly large volumes of time series and spatio-temporal data are available. In this tutorial, we focus on data-driven decision making with such data, e.g., enabling greener and more efficient transportation based on traffic time series forecasting. The tutorial adopts the holistic paradigm of ``data-governance-analytics-decision.'' We first introduce the data foundation of time series and spatio-temporal data, which is often heterogeneous. Next, we discuss data governance methods that aim to improve data quality. We then cover data analytics, focusing on the ``AGREE'' principles: Automation, Generalization, Robustness, Explainability, and Efficiency. We finally cover data-driven decision making strategies and briefly discuss promising research directions. We hope that the tutorial will serve as a primary resource for researchers and practitioners who are interested in value creation from time series and spatio-temporal data.

cs.DB↗

Multiscale thermodynamic nonequilibrium effects in Kelvin-Helmholtz instability and their relative importance

This study investigates the complex kinetics of thermodynamic nonequilibrium effects (TNEs) and their relative importance during the development of Kelvin-Helmholtz instability (KHI) using high-order discrete Boltzmann models (DBMs). First, the capabilities and differences among various discrete velocity sets in capturing TNEs and distribution functions are assessed. Practical guidelines for constructing discrete velocity stencils are proposed to enhance phase-space discretization and improve the robustness of high-order DBM simulation. At different stages of KHI and under varying initial conditions, multiscale TNEs, such as viscous stresses of different orders, emerge with distinct dominant roles. Specifically, three scenarios are identified: (i) regimes dominated by first-order TNEs,(ii) alternation between first- and second-order TNEs, and (iii) states where second-order TNEs govern the system's behavior. To quantitatively capture these transitions, criteria for TNE dominance at different orders in KHI evolution are established based on the relative thermodynamic nonequilibrium intensity (\(R_{\text{TNE}}\)). In scenarios dominated by second-order TNEs, differences between first-order and second-order models are compared in terms of macroscopic quantities, nonequilibrium effects, and kinetic moments, revealing the physical limitations of low-order models in capturing TNEs. Furthermore, the effectiveness, extensibility, and limitations of a representative high-order model are examined under second-order TNE-dominated conditions. To encapsulate these findings, a nonequilibrium phase diagram that visually maps the multiscale characteristics of KHI is constructed. This diagram not only provides intuitive insights into the dynamic interplay of different nonequilibrium effects but also serves as a kinetic roadmap for selecting suitable models under diverse nonequilibrium conditions.

physics.flu-dyn↗

Learning Generalizable Skills from Offline Multi-Task Data for Multi-Agent Cooperation

Learning cooperative multi-agent policy from offline multi-task data that can generalize to unseen tasks with varying numbers of agents and targets is an attractive problem in many scenarios. Although aggregating general behavior patterns among multiple tasks as skills to improve policy transfer is a promising approach, two primary challenges hinder the further advancement of skill learning in offline multi-task MARL. Firstly, extracting general cooperative behaviors from various action sequences as common skills lacks bringing cooperative temporal knowledge into them. Secondly, existing works only involve common skills and can not adaptively choose independent knowledge as task-specific skills in each task for fine-grained action execution. To tackle these challenges, we propose Hierarchical and Separate Skill Discovery (HiSSD), a novel approach for generalizable offline multi-task MARL through skill learning. HiSSD leverages a hierarchical framework that jointly learns common and task-specific skills. The common skills learn cooperative temporal knowledge and enable in-sample exploitation for offline multi-task MARL. The task-specific skills represent the priors of each task and achieve a task-guided fine-grained action execution. To verify the advancement of our method, we conduct experiments on multi-agent MuJoCo and SMAC benchmarks. After training the policy using HiSSD on offline multi-task data, the empirical results show that HiSSD assigns effective cooperative behaviors and obtains superior performance in unseen tasks.

cs.LG↗

A high-resolution microresonator-frequency-comb spectrometer

Spectral analysis is one of the most powerful technologies for studying and understanding matter. As the devices for spectral analysis, spectrometers are widely used in material detection, isotope analysis, trace gas detection, and the study of atomic and molecular hyperfine structures. While high resolution, wide bandwidth and fast speed are essential factors, they are always trade-offs for conventional spectrometers. Here, we present a soliton-microcomb-based spectrometer that overcomes these challenges by integrating dissipative Kerr solitons (DKSs) with double-sideband modulation and parallelized detection. Leveraging a high-quality silicon nitride microresonator, we generate a broadband, fully stabilized soliton microcomb and employ radio-frequency-modulated double sidebands to scan the optical spectrum with the resolution constrained only by the comb-line linewidth. By projecting the comb lines onto a two-dimensional charge-coupled device (CCD) via a virtually imaged phased array (VIPA)-grating system, we enable parallel processing of all spectral components, circumventing sequential scanning delays. The resulting spectrometer achieves 200-kHz resolution across a 4-THz bandwidth with minutes-level processing time while maintaining robustness against environmental fluctuations. Being promising for miniaturization, this work bridges the gap between laboratory-grade performance and field-deployable practicality, unlocking new possibilities for spectroscopy in astronomy, metrology, and integrated photonics.

physics.optics↗

Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent transportation. Traditional deep learning approaches have significantly advanced this field, particularly in the stage of ST data mining. However, these models remain task-specific and often require extensive labeled data. Inspired by the success of Foundation Models (FM), especially large language models, researchers have begun exploring the concept of Spatio-Temporal Foundation Models (STFMs) to enhance adaptability and generalization across diverse ST tasks. Unlike prior architectures, STFMs empower the entire workflow of ST data science, ranging from data sensing, management, to mining, thereby offering a more holistic and scalable approach. Despite rapid progress, a systematic study of STFMs for ST data science remains lacking. This survey aims to provide a comprehensive review of STFMs, categorizing existing methodologies and identifying key research directions to advance ST general intelligence.

cs.DB↗

Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models

Latent diffusion models with Transformer architectures excel at generating high-fidelity images. However, recent studies reveal an optimization dilemma in this two-stage design: while increasing the per-token feature dimension in visual tokenizers improves reconstruction quality, it requires substantially larger diffusion models and more training iterations to achieve comparable generation performance. Consequently, existing systems often settle for sub-optimal solutions, either producing visual artifacts due to information loss within tokenizers or failing to converge fully due to expensive computation costs. We argue that this dilemma stems from the inherent difficulty in learning unconstrained high-dimensional latent spaces. To address this, we propose aligning the latent space with pre-trained vision foundation models when training the visual tokenizers. Our proposed VA-VAE (Vision foundation model Aligned Variational AutoEncoder) significantly expands the reconstruction-generation frontier of latent diffusion models, enabling faster convergence of Diffusion Transformers (DiT) in high-dimensional latent spaces. To exploit the full potential of VA-VAE, we build an enhanced DiT baseline with improved training strategies and architecture designs, termed LightningDiT. The integrated system achieves state-of-the-art (SOTA) performance on ImageNet 256x256 generation with an FID score of 1.35 while demonstrating remarkable training efficiency by reaching an FID score of 2.11 in just 64 epochs--representing an over 21 times convergence speedup compared to the original DiT. Models and codes are available at: https://github.com/hustvl/LightningDiT.

cs.CV↗

Assessing Pre-Trained Models for Transfer Learning Through Distribution of Spectral Components

Pre-trained model assessment for transfer learning aims to identify the optimal candidate for the downstream tasks from a model hub, without the need of time-consuming fine-tuning. Existing advanced works mainly focus on analyzing the intrinsic characteristics of the entire features extracted by each pre-trained model or how well such features fit the target labels. This paper proposes a novel perspective for pre-trained model assessment through the Distribution of Spectral Components (DISCO). Through singular value decomposition of features extracted from pre-trained models, we investigate different spectral components and observe that they possess distinct transferability, contributing diversely to the fine-tuning performance. Inspired by this, we propose an assessment method based on the distribution of spectral components which measures the proportions of their corresponding singular values. Pre-trained models with features concentrating on more transferable components are regarded as better choices for transfer learning. We further leverage the labels of downstream data to better estimate the transferability of each spectral component and derive the final assessment criterion. Our proposed method is flexible and can be applied to both classification and regression tasks. We conducted comprehensive experiments across three benchmarks and two tasks including image classification and object detection, demonstrating that our method achieves state-of-the-art performance in choosing proper pre-trained models from the model hub for transfer learning.

cs.LG↗

RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systems

With the continued migration of storage to cloud database systems,the impact of slow queries in such systems on services and user experience is increasing. Root-cause diagnosis plays an indispensable role in facilitating slow-query detection and revision. This paper proposes a method capable of both identifying possible root cause types for slow queries and ranking these according to their potential for accelerating slow queries. This enables prioritizing root causes with the highest impact, in turn improving slow-query revision effectiveness. To enable more accurate and detailed diagnoses, we propose the multimodal Ranking for the Root Causes of slow queries (RCRank) framework, which formulates root cause analysis as a multimodal machine learning problem and leverages multimodal information from query statements, execution plans, execution logs, and key performance indicators. To obtain expressive embeddings from its heterogeneous multimodal input, RCRank integrates self-supervised pre-training that enhances cross-modal alignment and task relevance. Next, the framework integrates root-cause-adaptive cross Transformers that enable adaptive fusion of multimodal features with varying characteristics. Finally, the framework offers a unified model that features an impact-aware training objective for identifying and ranking root causes. We report on experiments on real and synthetic datasets, finding that RCRank is capable of consistently outperforming the state-of-the-art methods at root cause identification and ranking according to a range of metrics.

cs.DB↗

Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model

Multi-modal Large Language Models (MLLMs) integrate visual and linguistic reasoning to address complex tasks such as image captioning and visual question answering. While MLLMs demonstrate remarkable versatility, MLLMs appears limited performance on special applications. But tuning MLLMs for downstream tasks encounters two key challenges: Task-Expert Specialization, where distribution shifts between pre-training and target datasets constrain target performance, and Open-World Stabilization, where catastrophic forgetting erases the model general knowledge. In this work, we systematically review recent advancements in MLLM tuning methodologies, classifying them into three paradigms: (I) Selective Tuning, (II) Additive Tuning, and (III) Reparameterization Tuning. Furthermore, we benchmark these tuning strategies across popular MLLM architectures and diverse downstream tasks to establish standardized evaluation analysis and systematic tuning principles. Finally, we highlight several open challenges in this domain and propose future research directions. To facilitate ongoing progress in this rapidly evolving field, we provide a public repository that continuously tracks developments: https://github.com/WenkeHuang/Awesome-MLLM-Tuning.

cs.CL↗

Near-infrared spectroscopic characterization of the Pallas family

The Pallas collisional family of asteroids, named after (2) Pallas, is notable for its high orbital inclination and the distinct blue color of Pallas and a few larger B-type family members. While Pallas itself, as one of the largest asteroids, has been studied in detail, most of its smaller family members still remain unexplored. This study aims to characterize the physical properties of medium- to small-sized Pallas family asteroids to investigate the origin of their unusual blueness. Additionally, we explore the relationship between the Pallas family and the near-Earth object (NEO) (3200) Phaethon. We conducted near-infrared (NIR) spectroscopy with the NASA Infrared Telescope Facility (IRTF) to collect reflectance spectra for 22 asteroids, including one from the IRTF Legacy Archive. Spectroscopic and dynamical analyses were carried out to identify outliers, while additional data from NEOWISE and Gaia were incorporated to examine potential correlations among their physical properties. Meteorite analogs were identified through chi-square matching using samples from the RELAB database. The observed Pallas family asteroids exhibit nearly identical spectral profiles, suggesting a homogeneous composition of ejected material. Small variations in spectral slopes are observed, which may result from different levels of alteration experienced by individual asteroids, with some influence from variations in grain size. Most of the observed spectra of the Pallas asteroids, from 0.8 to 2.2 micron, closely resemble those of the CY and CI meteorites. The blueness of asteroid surfaces is likely due to the presence of magnetite, troilite, or phyllosilicates, which are products of aqueous alteration. The striking spectral similarity between (3200) Phaethon and Pallas family members of comparable sizes suggests a potential common origin.

astro-ph.EP↗

Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoders

Time series anomaly detection plays a vital role in a wide range of applications. Existing methods require training one specific model for each dataset, which exhibits limited generalization capability across different target datasets, hindering anomaly detection performance in various scenarios with scarce training data. Aiming at this problem, we propose constructing a general time series anomaly detection model, which is pre-trained on extensive multi-domain datasets and can subsequently apply to a multitude of downstream scenarios. The significant divergence of time series data across different domains presents two primary challenges in building such a general model: (1) meeting the diverse requirements of appropriate information bottlenecks tailored to different datasets in one unified model, and (2) enabling distinguishment between multiple normal and abnormal patterns, both are crucial for effective anomaly detection in various target scenarios. To tackle these two challenges, we propose a General time series anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoders (DADA), which enables flexible selection of bottlenecks based on different data and explicitly enhances clear differentiation between normal and abnormal series. We conduct extensive experiments on nine target datasets from different domains. After pre-training on multi-domain data, DADA, serving as a zero-shot anomaly detector for these datasets, still achieves competitive or even superior results compared to those models tailored to each specific dataset. The code is made available at https://github.com/decisionintelligence/DADA.

cs.LG↗

Maximum chirality in planar metasurfaces induced by strong coupling of quasi-bound states in the continuum

Achieving intrinsic optical chirality requires breaking all mirror symmetries of an object, and maximum chirality, which allows interaction with only one helicity of light, is particularly promising for applications such as chiral sensing, emission, and lasing. Traditionally, designing maximum chirality in dielectric metasurfaces has relied on precise engineering of vertical symmetry breaking, which presents significant fabrication challenges. Motivated by recent efforts towards enhanced chiral responses in planar structures, we demonstrate that maximum chirality can be achieved in a planar dielectric metasurface through controlled in-plane asymmetries. Specifically, the introduced perturbation induces strong coupling between two accidentally degenerate quasi-bound states in the continuum (QBICs) with orthogonal polarization states, which results in mode splitting into symmetric and antisymmetric modes, each exhibiting opposite circular dichroism (CD) responses. This behavior is quantitatively confirmed using quasinormal mode perturbation theory, by which we also identify a pair of exceptional points (EPs) at the transition between weak and strong coupling regimes. This work expands the existing approaches to maximum chirality in planar structures and aims to inspire future innovations in metasurface design.

physics.optics↗

AURO: Reinforcement Learning for Adaptive User Retention Optimization in Recommender Systems

The field of Reinforcement Learning (RL) has garnered increasing attention for its ability of optimizing user retention in recommender systems. A primary obstacle in this optimization process is the environment non-stationarity stemming from the continual and complex evolution of user behavior patterns over time, such as variations in interaction rates and retention propensities. These changes pose significant challenges to existing RL algorithms for recommendations, leading to issues with dynamics and reward distribution shifts. This paper introduces a novel approach called \textbf{A}daptive \textbf{U}ser \textbf{R}etention \textbf{O}ptimization (AURO) to address this challenge. To navigate the recommendation policy in non-stationary environments, AURO introduces an state abstraction module in the policy network. The module is trained with a new value-based loss function, aligning its output with the estimated performance of the current policy. As the policy performance of RL is sensitive to environment drifts, the loss function enables the state abstraction to be reflective of environment changes and notify the recommendation policy to adapt accordingly. Additionally, the non-stationarity of the environment introduces the problem of implicit cold start, where the recommendation policy continuously interacts with users displaying novel behavior patterns. AURO encourages exploration guarded by performance-based rejection sampling to maintain a stable recommendation quality in the cost-sensitive online environment. Extensive empirical analysis are conducted in a user retention simulator, the MovieLens dataset, and a live short-video recommendation platform, demonstrating AURO's superior performance against all evaluated baseline algorithms.

cs.IR↗

Supersonic flow kinetics: Mesoscale structures, thermodynamic nonequilibrium effects and entropy production mechanisms

Supersonic flow is a typical nonlinear, nonequilibrium, multiscale, and complex phenomenon. This paper applies discrete Boltzmann method/model (DBM) to simulate and analyze these characteristics. A Burnett-level DBM for supersonic flow is constructed based on the Shakhov-BGK model. Higher-order analytical expressions for thermodynamic nonequilibrium effects are derived, providing a constitutive basis for improving traditional macroscopic hydrodynamics modeling. Criteria for evaluating the validity of DBM are established by comparing numerical and analytical solutions of nonequilibrium measures. The multiscale DBM is used to investigate discrete/nonequilibrium characteristics and entropy production mechanisms in shock regular reflection. The findings include: (a) Compared to NS-level DBM, the Burnett-level DBM offers more accurate representations of viscous stress and heat flux, ensures non-negativity of entropy production in accordance with the second law of thermodynamics, and exhibits better numerical stability. (b) Near the interfaces of incident and reflected shock waves, strong nonequilibrium driving forces lead to prominent nonequilibrium effects. By monitoring the timing and location of peak nonequilibrium quantities, the evolution characteristics of incident and reflected shock waves can be accurately and dynamically tracked. (c) In the intermediate state, the bent reflected shock and incident shock interface are wider and exhibit lower nonequilibrium intensities compared to their final state. (d) The Mach number enhances various kinds of nonequilibrium intensities in a power-law manner $D_{mn} \sim \mathtt{Ma}^α$. The power exponent $α$ and kinetic modes of nonequilibrium effects $m$ follows a logarithmic relation $α\sim \ln (m - m_0)$. This research provides new perspectives and kinetic insights into supersonic flow studies.

physics.flu-dyn↗

Hydrodynamic and thermodynamic non-equilibrium characteristics of shock waves: Insights from the discrete Boltzmann method

Shock waves are typical non-equilibrium phenomena in nature and engineering, driven by hydrodynamic non-equilibrium (HNE) and thermodynamic non-equilibrium (TNE) effects. However, the mechanisms underlying these non-equilibrium effects are not fully understood. This study develops the discrete Boltzmann method (DBM) by directly discretizing velocity space, allowing for the adequate capture of higher-order HNE and TNE effects. To reveal these mechanisms, we derive analytical solutions for distribution functions and TNE quantities at various orders using CE analysis, although DBM simulations do not rely on these theoretical derivations. Using argon shock structures as a case study, DBM simulations of interface profiles and thickness at the macroscopic level agree well with experimental data and direct simulation Monte Carlo results. At the mesoscopic level, DBM-derived distribution functions and TNE measures closely match their corresponding analytical solutions. The effect of Mach number on HNE is analyzed by examining the shape and thickness of density, temperature, and velocity interfaces. Key findings include: (i) Mach number induces a two-stage effect on macroscopic quantities, influencing both interface smoothness and thickness, and (ii) as Mach number increases, the region of strong compressibility shifts from the outflow region to the inflow region. As for TNE characteristics, increasing Mach number significantly amplifies TNE intensity and expands the non-equilibrium region. This research provides kinetic insights into the multiscale nature and effects of non-equilibrium characteristics in shock waves, offering theoretical references for constructing kinetic models that describe different types and orders of non-equilibrium effects.

physics.flu-dyn↗

Fine-Tuning Strategies for Continual Online EEG Motor Imagery Decoding: Insights from a Large-Scale Longitudinal Study

This study investigates continual fine-tuning strategies for deep learning in online longitudinal electroencephalography (EEG) motor imagery (MI) decoding within a causal setting involving a large user group and multiple sessions per participant. We are the first to explore such strategies across a large user group, as longitudinal adaptation is typically studied in the single-subject setting with a single adaptation strategy, which limits the ability to generalize findings. First, we examine the impact of different fine-tuning approaches on decoder performance and stability. Building on this, we integrate online test-time adaptation (OTTA) to adapt the model during deployment, complementing the effects of prior fine-tuning. Our findings demonstrate that fine-tuning that successively builds on prior subject-specific information improves both performance and stability, while OTTA effectively adapts the model to evolving data distributions across consecutive sessions, enabling calibration-free operation. These results offer valuable insights and recommendations for future research in longitudinal online MI decoding and highlight the importance of combining domain adaptation strategies for improving BCI performance in real-world applications. Clinical Relevance: Our investigation enables more stable and efficient long-term motor imagery decoding, which is critical for neurorehabilitation and assistive technologies.

cs.LG↗

Unity in Diversity: Multi-expert Knowledge Confrontation and Collaboration for Generalizable Vehicle Re-identification

Generalizable vehicle re-identification (ReID) seeks to develop models that can adapt to unknown target domains without the need for additional fine-tuning or retraining. Previous works have mainly focused on extracting domain-invariant features by aligning data distributions between source domains. However, interfered by the inherent domain-related redundancy in the source images, solely relying on common features is insufficient for accurately capturing the complementary features with lower occurrence probability and smaller energy. To solve this unique problem, we propose a two-stage Multi-expert Knowledge Confrontation and Collaboration (MiKeCoCo) method, which fully leverages the high-level semantics of Contrastive Language-Image Pretraining (CLIP) to obtain a diversified prompt set and achieve complementary feature representations. Specifically, this paper first designs a Spectrum-based Transformation for Redundancy Elimination and Augmentation Module (STREAM) through simple image preprocessing to obtain two types of image inputs for the training process. Since STREAM eliminates domain-related redundancy in source images, it enables the model to pay closer attention to the detailed prompt set that is crucial for distinguishing fine-grained vehicles. This learned prompt set related to the vehicle identity is then utilized to guide the comprehensive representation learning of complementary features for final knowledge fusion and identity recognition. Inspired by the unity principle, MiKeCoCo integrates the diverse evaluation ways of experts to ensure the accuracy and consistency of ReID. Extensive experimental results demonstrate that our method achieves state-of-the-art performance.

cs.CV↗

Task Scheduling in Geo-Distributed Computing: A Survey

Geo-distributed computing, a paradigm that assigns computational tasks to globally distributed nodes, has emerged as a promising approach in cloud computing, edge computing, cloud-edge computing and supercomputer computing (HPC). It enables low-latency services, ensures data locality, and handles large-scale applications. As global computing capacity and task demands increase rapidly, scheduling tasks for efficient execution in geo-distributed computing systems has become an increasingly critical research challenge. It arises from the inherent characteristics of geographic distribution, including heterogeneous network conditions, region-specific resource pricing, and varying computational capabilities across locations. Researchers have developed diverse task scheduling methods tailored to geo-distributed scenarios, aiming to achieve objectives such as performance enhancement, fairness assurance, and fault-tolerance improvement. This survey provides a comprehensive and systematic review of task scheduling techniques across four major distributed computing environments, with an in-depth analysis of these approaches based on their core scheduling objectives. Through our analysis, we identify key research challenges and outline promising directions for advancing task scheduling in geo-distributed computing.

cs.DC↗