arXiv subjects

Meng Zhang

Publications and source records attributed to Meng Zhang.

At least 127 records · Page 7Linked to original sources

arXiv2024

Scalable tensor network algorithm for thermal quantum many-body systems in two dimension

Simulating strongly-correlated quantum many-body systems at finite temperatures is a significant challenge in computational physics. In this work, we present a scalable finite-temperature tensor network algorithm for two-dimensional quantum many-body systems. We employ the (fermionic) projected entangled pair state (PEPS) to represent the vectorization of the quantum thermal state and utilize a stochastic reconfiguration method to cool down the quantum states from infinite temperature. We validate our method by benchmarking it against the 2D antiferromagnetic Heisenberg model, the $J_1$-$J_2$ model, and the Fermi-Hubbard model, comparing physical properties such as internal energy, specific heat, and magnetic susceptibility with results obtained from stochastic series expansion (SSE), exact diagonalization, and determinant quantum Monte Carlo (DQMC).

cond-mat.str-el↗

arXiv2024

Ground-roll Separation From Land Seismic Records Based on Convolutional Neural Network

Ground-roll wave is a common coherent noise in land field seismic data. This Rayleigh-type surface wave usually has low frequency, low apparent velocity, and high amplitude, therefore obscures the reflection events of seismic shot gathers. Commonly used techniques focus on the differences of ground-roll and reflection in transformed domain such as $f-k$ domain, wavelet domain, or curvelet domain. These approaches use a series of fixed atoms or bases to transform the data in time-space domain into transformed domain to separate different waveforms, thus tend to suffer from the complexity for a delicate design of the parameters of the transform domain filter. To deal with these problems, a novel way is proposed to separate ground-roll from reflections using convolutional neural network (CNN) model based method to learn to extract the features of ground-roll and reflections automatically based on training data. In the proposed method, low-pass filtered seismic data which is contaminated by ground-roll wave is used as input of CNN, and then outputs both ground-roll component and low-frequency part of reflection component simultaneously. Discriminative loss is applied together with similarity loss in the training process to enhance the similarity to their train labels as well as the difference between the two outputs. Experiments are conducted on both synthetic and real data, showing that CNN based method can separate ground roll from reflections effectively, and has generalization ability to a certain extent.

cs.CV↗

arXiv2024

Efficient Active Flow Control Strategy for Confined Square Cylinder Wake Using Deep Learning-Based Surrogate Model and Reinforcement Learning

This study presents a deep learning model-based reinforcement learning (DL-MBRL) approach for active control of two-dimensional (2D) wake flow past a square cylinder using antiphase jets. The DL-MBRL framework alternates between interacting with a deep learning surrogate model (DL-SM) and computational fluid dynamics (CFD) simulations to suppress wake vortex shedding, significantly reducing computational costs. The DL-SM, which combines a Transformer and a multiscale enhanced super-resolution generative adversarial network (MS-ESRGAN), effectively models complex flow dynamics, efficiently emulating the CFD environment. Trained on 2D direct numerical simulation (DNS) data, the Transformer and MS-ESRGAN demonstrated excellent agreement with DNS results, validating the DL-SM's accuracy. Error analysis suggests replacing the DL-SM with CFD every five interactions to maintain reliability. While DL-MBRL showed less robust convergence than model-free reinforcement learning (MFRL) during training, it reduced training time by 49.2%, from 41.87 hours to 20.62 hours. Both MFRL and DL-MBRL achieved a 98% reduction in shedding energy and a 95% reduction in the standard deviation of the lift coefficient (C_L). However, MFRL exhibited a nonzero mean lift coefficient due to insufficient exploration, whereas DL-MBRL improved exploration by leveraging the randomness of the DL-SM, resolving the nonzero mean C_L issue. This study demonstrates that DL-MBRL is not only comparably effective but also superior to MFRL in flow stabilization, with significantly reduced training time, highlighting the potential of combining deep reinforcement learning with DL-SM for enhanced active flow control.

physics.flu-dyn↗

arXiv2024

Flow Reconstruction Using Spatially Restricted Domains Based on Enhanced Super-Resolution Generative Adversarial Networks

This study aims to reconstruct the complete flow field from spatially restricted domain data by utilizing an Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) model. The difficulty in flow field reconstruction lies in accurately capturing and reconstructing large amounts of data under nonlinear, multi-scale, and complex flow while ensuring physical consistency and high computational efficiency. The ESRGAN model has a strong information mapping capability, capturing fluctuating features from local flow fields of varying geometries and sizes. The model effectiveness in reconstructing the whole domain flow field is validated by comparing instantaneous velocity fields, flow statistical properties, and probability density distributions. Using laminar bluff body flow from Direct Numerical Simulation (DNS) as a priori case, the model successfully reconstructs the complete flow field from three non-overlapping limited regions, with flow statistical properties perfectly matching the original data. Validation of the power spectrum density (PSD) for the reconstruction results also proves that the model could conform to the temporal behavior of the real complete flow field. Additionally, tests using DNS turbulent channel flow with a friction Reynolds number ($Re_τ= 180$) demonstrate the model ability to reconstruct turbulent fields, though the quality of results depends on the number of flow features in the local regions. Finally, the model is applied to reconstruct turbulence flow fields from Particle Image Velocimetry (PIV) experimental measurements, using limited data from the near-wake region to reconstruct a larger field of view. The turbulence statistics closely match the experimental data, indicating that the model can serve as a reliable data-driven method to overcome PIV field-of-view limitations while saving computational costs.

physics.flu-dyn↗

arXiv2024

Self-Supervised Learning for Effective Denoising of Flow Fields

In this study, we proposed an efficient approach based on a deep learning (DL) denoising autoencoder (DAE) model for denoising noisy flow fields. The DAE operates on a self-learning principle and does not require clean data as training labels. Furthermore, investigations into the denoising mechanism of the DAE revealed that its bottleneck structure with a compact latent space enhances denoising efficacy. Meanwhile, we also developed a deep multiscale DAE for denoising turbulent flow fields. Furthermore, we used conventional noise filters to denoise the flow fields and performed a comparative analysis with the results from the DL method. The effectiveness of the proposed DL models was evaluated using direct numerical simulation data of laminar flow around a square cylinder and turbulent channel flow data at various Reynolds numbers. For every case, synthetic noise was augmented in the data. A separate experiment used particle-image velocimetry data of laminar flow around a square cylinder containing real noise to test DAE denoising performance. Instantaneous contours and flow statistical results were used to verify the alignment between the denoised data and ground truth. The findings confirmed that the proposed method could effectively denoise noisy flow data, including turbulent flow scenarios. Furthermore, the proposed method exhibited excellent generalization, efficiently denoising noise with various types and intensities.

physics.flu-dyn↗

arXiv2024

Garment Animation NeRF with Color Editing

Generating high-fidelity garment animations through traditional workflows, from modeling to rendering, is both tedious and expensive. These workflows often require repetitive steps in response to updates in character motion, rendering viewpoint changes, or appearance edits. Although recent neural rendering offers an efficient solution for computationally intensive processes, it struggles with rendering complex garment animations containing fine wrinkle details and realistic garment-and-body occlusions, while maintaining structural consistency across frames and dense view rendering. In this paper, we propose a novel approach to directly synthesize garment animations from body motion sequences without the need for an explicit garment proxy. Our approach infers garment dynamic features from body motion, providing a preliminary overview of garment structure. Simultaneously, we capture detailed features from synthesized reference images of the garment's front and back, generated by a pre-trained image model. These features are then used to construct a neural radiance field that renders the garment animation video. Additionally, our technique enables garment recoloring by decomposing its visual elements. We demonstrate the generalizability of our method across unseen body motions and camera views, ensuring detailed structural consistency. Furthermore, we showcase its applicability to color editing on both real and synthetic garment data. Compared to existing neural rendering techniques, our method exhibits qualitative and quantitative improvements in garment dynamics and wrinkle detail modeling. Code is available at \url{https://github.com/wrk226/GarmentAnimationNeRF}.

cs.CV↗

arXiv2024

Operando probing of nanocracking in CuO-derived Cu during CO$_2$ electroreduction

Identifying and controlling active sites in electrocatalysis remains a grand challenge due to restructuring of catalysts in the complex chemical environments during operation. Inactive precatalysts can transform into active catalysts under reaction conditions, such as oxide-derived Cu (OD-Cu) for CO$_2$ electroreduction displaying improved production of multicarbon (C$_{2+}$) chemicals. Revealing the mechanism of active site origin in OD-Cu catalysts requires in situ/operando characterizations of structure, morphology, and valence state evolution with high spatial and temporal resolution. Applying newly developed electrochemical liquid cell transmission electron microscopy combined with X-ray absorption spectroscopy, our multimodal operando techniques unveil the formation pathways of OD-Cu active sites from CuO bicrystal nanowire precatalysts. Rapid reduction of CuO directly to Cu within 60 seconds generates a nanocrack network throughout the nanowire, via formation of "boundary nanocracks" along the twin boundary and "transverse nanocracks" propagating from the surface to the center of the nanowire. The nanocrack network further reconstructs, leading to a highly porous structure rich in Cu nanograins, with a boosted specific surface area and density of active sites for C$_{2+}$ products. These findings suggest a means to optimize active OD-Cu nanostructures through nanocracking by tailoring grain boundaries in CuO precatalysts. More generally, our advanced operando approach opens new opportunities for mechanistic insights to enable improved control of catalyst structure and performance.

cond-mat.mtrl-sci↗

arXiv2024

Beyond Boundaries: efficient Projected Entangled Pair States methods for periodic quantum systems

Projected Entangled Pair States (PEPS) are recognized as a potent tool for exploring two-dimensional quantum many-body systems. However, a significant challenge emerges when applying conventional PEPS methodologies to systems with periodic boundary conditions (PBC), attributed to the prohibitive computational scaling with the bond dimension. This has notably restricted the study of systems with complex boundary conditions. To address this challenge, we have developed a strategy that involves the superposition of PEPS with open boundary conditions (OBC) to treat systems with PBC. This approach significantly reduces the computational complexity of such systems while maintaining their translational invariance and the PBC. We benchmark this method against the Heisenberg model and the $J_1$-$J_2$ model, demonstrating its capability to yield highly accurate results at low computational costs, even for large system sizes. The techniques are adaptable to other boundary conditions, including cylindrical and twisted boundary conditions, and therefore significantly expands the application scope of the PEPS approach, shining new light on numerous applications.

cond-mat.str-el↗

arXiv2024

TorchGT: A Holistic System for Large-scale Graph Transformer Training

Graph Transformer is a new architecture that surpasses GNNs in graph learning. While there emerge inspiring algorithm advancements, their practical adoption is still limited, particularly on real-world graphs involving up to millions of nodes. We observe existing graph transformers fail on large-scale graphs mainly due to heavy computation, limited scalability and inferior model quality. Motivated by these observations, we propose TorchGT, the first efficient, scalable, and accurate graph transformer training system. TorchGT optimizes training at different levels. At algorithm level, by harnessing the graph sparsity, TorchGT introduces a Dual-interleaved Attention which is computation-efficient and accuracy-maintained. At runtime level, TorchGT scales training across workers with a communication-light Cluster-aware Graph Parallelism. At kernel level, an Elastic Computation Reformation further optimizes the computation by reducing memory access latency in a dynamic way. Extensive experiments demonstrate that TorchGT boosts training by up to 62.7x and supports graph sequence lengths of up to 1M.

cs.DC↗

arXiv2024

SCATTER: Algorithm-Circuit Co-Sparse Photonic Accelerator with Thermal-Tolerant, Power-Efficient In-situ Light Redistribution

Photonic computing has emerged as a promising solution for accelerating computation-intensive artificial intelligence (AI) workloads. However, limited reconfigurability, high electrical-optical conversion cost, and thermal sensitivity limit the deployment of current optical analog computing engines to support power-restricted, performance-sensitive AI workloads at scale. Sparsity provides a great opportunity for hardware-efficient AI accelerators. However, current dense photonic accelerators fail to fully exploit the power-saving potential of algorithmic sparsity. It requires sparsity-aware hardware specialization with a fundamental re-design of photonic tensor core topology and cross-layer device-circuit-architecture-algorithm co-optimization aware of hardware non-ideality and power bottleneck. To trim down the redundant power consumption while maximizing robustness to thermal variations, we propose SCATTER, a novel algorithm-circuit co-sparse photonic accelerator featuring dynamically reconfigurable signal path via thermal-tolerant, power-efficient in-situ light redistribution and power gating. A power-optimized, crosstalk-aware dynamic sparse training framework is introduced to explore row-column structured sparsity and ensure marginal accuracy loss and maximum power efficiency. The extensive evaluation shows that our cross-stacked optimized accelerator SCATTER achieves a 511X area reduction and 12.4X power saving with superior crosstalk tolerance that enables unprecedented circuit layout compactness and on-chip power efficiency.

cs.AR↗

arXiv2024

Silicon Photonics Foundry Fabricated, Slow-Light Enhanced, Low Power Thermal Phase Shifter

In this research, we developed a low-power silicon photonics foundry-fabricated slow-light thermal phase shifter (SLTPS) where the slow-light (SL) effect is achieved using an integrated Bragg grating (BG) waveguide. Heating the grating induces a red shift in the transmission spectrum, leading to an increased group index $n_g$ during operation, which facilitates a further reduction in the voltage needed for a $π$ phase shift, i.e. $V_π$. Additionally, we investigated a compact Mach-Zehnder Interferometer (MZI) that incorporates the SLTPS in both arms with a phase shifter length of 50 $μ$m. A detailed theoretical analysis was conducted to address the non-idealities of the SL-MZI due to uneven optical power splitting and unbalanced loss in the two MZI arms. The $V_π$ and power consumption for a $π$ phase shift $(P_π)$ of the SL-MZI were quantified for operation in the slow light regime, demonstrating a $V_π$ of 1.1 V and a $P_π$ of 3.63 mW at an operational wavelength near the photonic band edge. The figure of merit (FOM) $P_π \times τ$ is commonly used to assess the performance of thermal optical switches. The SL-MZI in this work has achieved a low $P_π \times τ$ of 5.1 mW $μ$s. Insertion loss of the SL-MZI ranges from 1.3 dB to 4.4 dB depending on the operation wavelength, indicating a trade-off with the $V_π$ reduction.

physics.optics↗

arXiv2024

Characterization of Large Language Model Development in the Datacenter

Large Language Models (LLMs) have presented impressive performance across several transformative tasks. However, it is non-trivial to efficiently utilize large-scale cluster resources to develop LLMs, often riddled with numerous challenges such as frequent hardware failures, intricate parallelization strategies, and imbalanced resource utilization. In this paper, we present an in-depth characterization study of a six-month LLM development workload trace collected from our GPU datacenter Acme. Specifically, we investigate discrepancies between LLMs and prior task-specific Deep Learning (DL) workloads, explore resource utilization patterns, and identify the impact of various job failures. Our analysis summarizes hurdles we encountered and uncovers potential opportunities to optimize systems tailored for LLMs. Furthermore, we introduce our system efforts: (1) fault-tolerant pretraining, which enhances fault tolerance through LLM-involved failure diagnosis and automatic recovery. (2) decoupled scheduling for evaluation, which achieves timely performance feedback via trial decomposition and scheduling optimization.

cs.DC↗

arXiv2024

LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes

Large-scale semantic mapping is crucial for outdoor autonomous agents to fulfill high-level tasks such as planning and navigation. This paper proposes a novel method for large-scale 3D semantic reconstruction through implicit representations from posed LiDAR measurements alone. We first leverage an octree-based and hierarchical structure to store implicit features, then these implicit features are decoded to semantic information and signed distance value through shallow Multilayer Perceptrons (MLPs). We adopt off-the-shelf algorithms to predict the semantic labels and instance IDs of point clouds. We then jointly optimize the feature embeddings and MLPs parameters with a self-supervision paradigm for point cloud geometry and a pseudo-supervision paradigm for semantic and panoptic labels. Subsequently, categories and geometric structures for novel points are regressed, and marching cubes are exploited to subdivide and visualize the scenes in the inferring stage. For scenarios with memory constraints, a map stitching strategy is also developed to merge sub-maps into a complete map. Experiments on two real-world datasets, SemanticKITTI and SemanticPOSS, demonstrate the superior segmentation efficiency and mapping effectiveness of our framework compared to current state-of-the-art 3D LiDAR mapping methods.

cs.CV↗

arXiv2024

On Disturbance Propagation in Vehicular Platoons with Different Communication Ranges

In the control of vehicular platoons, the disturbances acting on one vehicle can propagate and affect other vehicles. If the disturbances do not amplify along the vehicular string, then it is called string stable. However, it is usually difficult to achieve string stability with a distributed control setting, especially when a constant spacing policy is considered. This note considers the string unstable cases and studies disturbance propagation in a nonlinear vehicular platoon consisting of $n+1$ vehicles where the (virtual) leading vehicle provides the reference for a constant spacing policy. Apart from the communications between consecutive vehicles, we also assume that each vehicle can receive information from $r$ neighbors ahead, that is, the vehicular platoon has communication range $r$. For the maximal overshoot of the inter-vehicular spacing errors, we explicitly show that the effect of disturbances, including the external disturbances acting on each vehicle and the acceleration of the leading vehicle, is scaled by $O(\sqrt{ \left \lceil \frac{n}{r} \right \rceil})$ for a fixed $n$. This implies that disturbance propagation can be reduced by increasing communication range. Numerical simulation is provided to illustrate the main results.

math.DS↗

arXiv2024

Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning

Load frequency control (LFC) is widely employed in power systems to stabilize frequency fluctuation and guarantee power quality. However, most existing LFC methods rely on accurate power system modeling and usually ignore the nonlinear characteristics of the system, limiting controllers' performance. To solve these problems, this paper proposes a model-free LFC method for nonlinear power systems based on deep deterministic policy gradient (DDPG) framework. The proposed method establishes an emulator network to emulate power system dynamics. After defining the action-value function, the emulator network is applied for control actions evaluation instead of the critic network. Then the actor network controller is effectively optimized by estimating the policy gradient based on zeroth-order optimization (ZOO) and backpropagation algorithm. Simulation results and corresponding comparisons demonstrate the designed controller can generate appropriate control actions and has strong adaptability for nonlinear power systems.

eess.SY↗

arXiv2024

A Miniaturized Device for Ultrafast On-demand Drug Release based on a Gigahertz Ultrasonic Resonator

On-demand controlled drug delivery is essential for the treatment of a wide range of chronic diseases. As the drug is released at the time when required, its efficacy is boosted and the side effects are minimized. However, so far, drug delivery devices often rely on the passive diffusion process for a sustained release, which is slow and uncontrollable. Here, we present a miniaturized microfluidic device for wirelessly controlled ultrafast active drug delivery, driven by an oscillating solid-liquid interface. The oscillation generates acoustic streaming in the drug reservoir, which opens an elastic valve to deliver the drug. High-speed microscopy reveals the fast response of the valve on the order of 1 ms, which is more than three orders of magnitude faster than the start-of-the-art. The amount of the released drug exhibits a linear relationship with the working time and the electric power applied to the ultrasonic resonator. The trigger of the release is wirelessly controlled via a magnetic field, and the system shows stable output in a continuous experiment for two weeks. The integrated system shows great promise as a long-term controlled drug delivery implant for chronic diseases.

cs.RO↗

arXiv2024

Velocity acoustic oscillations on Cosmic Dawn 21 cm power spectrum as a probe of small-scale density fluctuations

We investigate the feasibility of using the velocity acoustic oscillations (VAO) features on the Cosmic Dawn 21 cm power spectrum to probe small-scale density fluctuations. In the standard cold dark matter (CDM) model, Pop III stars form in minihalos and affect the 21 cm signal through Ly$α$ and X-ray radiation. Such a process is modulated by the relative motion between dark matter and baryons, generating the VAO wiggles on the 21 cm power spectrum. In the fuzzy or warm dark matter models for which the number of minihalos is reduced, the VAO wiggles are weaker or even fully invisible. We investigate the wiggle features in the CDM with different astrophysical models and in different dark matter models. We find: 1) In the CDM model the relative streaming velocities can generate the VAO wiggles for broad ranges of parameters $f_*$, $ζ_X$ and $f_{\rm esc,LW}ζ_{\rm LW}$, though for different parameters the wiggles would appear at different redshifts and have different amplitudes. 2) For the axion model with $m_{\rm a} \lesssim10^{-19}$ eV, the VAO wiggles are negligible. In the mixed model, the VAO signal is sensitive to the axion fraction. For example, the wiggles almost disappear when $f_{\rm a} \gtrsim 10\%$ for $m_{\rm a}=10^{-21}$ eV. Therefore, the VAO signal can be an effective indicator for small-scale density fluctuations and a useful probe of the nature of dark matter. The SKA-low with $\sim$2000 hour observation time has the ability to detect the VAO signal and constraint dark matter models.

astro-ph.CO↗

arXiv2024

TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulator

Electronic-photonic computing systems offer immense potential in energy-efficient artificial intelligence (AI) acceleration tasks due to the superior computing speed and efficiency of optics, especially for real-time, low-energy deep neural network (DNN) inference tasks on resource-restricted edge platforms. However, current optical neural accelerators based on foundry-available devices and conventional system architecture still encounter a performance gap compared to highly customized electronic counterparts. To bridge the performance gap due to lack of domain specialization, we present a time-multiplexed dynamic photonic tensor accelerator, dubbed TeMPO, with cross-layer device/circuit/architecture customization. At the device level, we present foundry-compatible, customized photonic devices, including a slow-light electro-optic modulator with experimental demonstration, optical splitters, and phase shifters that significantly reduce the footprint and power in input encoding and dot-product calculation. At the circuit level, partial products are hierarchically accumulated via parallel photocurrent aggregation, lightweight capacitive temporal integration, and sequential digital summation, considerably relieving the analog-to-digital conversion bottleneck. We also employ a multi-tile, multi-core architecture to maximize hardware sharing for higher efficiency. Across diverse edge AI workloads, TeMPO delivers digital-comparable task accuracy with superior quantization/noise tolerance. We achieve a 368.6 TOPS peak performance, 22.3 TOPS/W energy efficiency, and 1.2 TOPS/mm$^2$ compute density, pushing the Pareto frontier in edge AI hardware. This work signifies the power of cross-layer co-design and domain-specific customization, paving the way for future electronic-photonic accelerators with even greater performance and efficiency.

cs.ET↗