arXiv subjects

Gang Wang

Publications and source records attributed to Gang Wang.

At least 199 records · Page 11Linked to original sources

arXiv2024

Mini-jet Clustering Algorithm Using Transverse-momentum Seeds in High-energy Nuclear Collisions

We propose an algorithm to detect mini-jet clusters in high-energy nuclear collisions, by selecting a high-transverse-momentum ($p_T$) particle as a seed and assigning a clustering radius ($R$) in the pseudorapidity and azimuthal-angle space. Our PYTHIA simulations for $p$+$p$ collisions show that a scheme with a seeding $p_T$ of around 0.5 GeV/$c$ and $R$ of approximately 0.6 satisfactorily identifies mini-jet clusters. The correlation between clusters obtained in PYTHIA calculations using the algorithm exhibits the proper behavior of hard-scattering-like processes, suggesting its usefulness in isolating mini-jet-like clusters from non-hard-scattering soft processes when applied to actual nuclear-collision data, thereby allowing a closer examination of both the mini-jet and the soft mechanisms.

physics.data-an↗

arXiv2024

Knowledge Distillation via the Target-aware Transformer

Knowledge distillation becomes a de facto standard to improve the performance of small neural networks. Most of the previous works propose to regress the representational features from the teacher to the student in a one-to-one spatial matching fashion. However, people tend to overlook the fact that, due to the architecture differences, the semantic information on the same spatial location usually vary. This greatly undermines the underlying assumption of the one-to-one distillation approach. To this end, we propose a novel one-to-all spatial matching knowledge distillation approach. Specifically, we allow each pixel of the teacher feature to be distilled to all spatial locations of the student features given its similarity, which is generated from a target-aware transformer. Our approach surpasses the state-of-the-art methods by a significant margin on various computer vision benchmarks, such as ImageNet, Pascal VOC and COCOStuff10k. Code is available at https://github.com/sihaoevery/TaT.

cs.CV↗

arXiv2024

"Are Adversarial Phishing Webpages a Threat in Reality?" Understanding the Users' Perception of Adversarial Webpages

Machine learning based phishing website detectors (ML-PWD) are a critical part of today's anti-phishing solutions in operation. Unfortunately, ML-PWD are prone to adversarial evasions, evidenced by both academic studies and analyses of real-world adversarial phishing webpages. However, existing works mostly focused on assessing adversarial phishing webpages against ML-PWD, while neglecting a crucial aspect: investigating whether they can deceive the actual target of phishing -- the end users. In this paper, we fill this gap by conducting two user studies (n=470) to examine how human users perceive adversarial phishing webpages, spanning both synthetically crafted ones (which we create by evading a state-of-the-art ML-PWD) as well as real adversarial webpages (taken from the wild Web) that bypassed a production-grade ML-PWD. Our findings confirm that adversarial phishing is a threat to both users and ML-PWD, since most adversarial phishing webpages have comparable effectiveness on users w.r.t. unperturbed ones. However, not all adversarial perturbations are equally effective. For example, those with added typos are significantly more noticeable to users, who tend to overlook perturbations of higher visual magnitude (such as replacing the background). We also show that users' self-reported frequency of visiting a brand's website has a statistically negative correlation with their phishing detection accuracy, which is likely caused by overconfidence. We release our resources.

cs.CR↗

arXiv2024

A New Reduction Method from Multivariate Polynomials to Univariate Polynomials

Polynomial multiplication is a fundamental problem in symbolic computation. There are efficient methods for the multiplication of two univariate polynomials. However, there is rarely efficiently nontrivial method for the multiplication of two multivariate polynomials. Therefore, we consider a new multiplication mechanism that involves a) reversibly reducing multivariate polynomials into univariate polynomials, b) calculating the product of the derived univariate polynomials by the Toom-Cook or FFT algorithm, and c) correctly recovering the product of multivariate polynomials from the product of two univariate polynomials. This work focuses on step a), expecting the degrees of the derived univariate polynomials to be as small as possible. We propose iterative Kronecker substitution, where smaller substitution exponents are selected instead of standard Kronecker substitution. We also apply the Chinese remainder theorem to polynomial reduction and find its advantages in some cases. Afterwards, we provide a hybrid reduction combining the advantages of both reduction methods. Moreover, we compare these reduction methods in terms of lower and upper bounds of the degree of the product of two derived univariate polynomials, and their computational complexities. With randomly generated multivariate polynomials, experiments show that the degree of the product of two univariate polynomials derived from the hybrid reduction can be reduced even to approximately 3% that resulting from the standard Kronecker substitution, implying an efficient subsequent multiplication of two univariate polynomials.

cs.CC↗

arXiv2024

DEFA: Efficient Deformable Attention Acceleration via Pruning-Assisted Grid-Sampling and Multi-Scale Parallel Processing

Multi-scale deformable attention (MSDeformAttn) has emerged as a key mechanism in various vision tasks, demonstrating explicit superiority attributed to multi-scale grid-sampling. However, this newly introduced operator incurs irregular data access and enormous memory requirement, leading to severe PE underutilization. Meanwhile, existing approaches for attention acceleration cannot be directly applied to MSDeformAttn due to lack of support for this distinct procedure. Therefore, we propose a dedicated algorithm-architecture co-design dubbed DEFA, the first-of-its-kind method for MSDeformAttn acceleration. At the algorithm level, DEFA adopts frequency-weighted pruning and probability-aware pruning for feature maps and sampling points respectively, alleviating the memory footprint by over 80%. At the architecture level, it explores the multi-scale parallelism to boost the throughput significantly and further reduces the memory access via fine-grained layer fusion and feature map reusing. Extensively evaluated on representative benchmarks, DEFA achieves 10.1-31.9x speedup and 20.3-37.7x energy efficiency boost compared to powerful GPUs. It also rivals the related accelerators by 2.2-3.7x energy efficiency improvement while providing pioneering support for MSDeformAttn.

cs.AR↗

arXiv2024

RIS-Enabled Joint Near-Field 3D Localization and Synchronization in SISO Multipath Environments

Reconfigurable Intelligent Surfaces (RIS) show great promise in the realm of 6th generation (6G) wireless systems, particularly in the areas of localization and communication. Their cost-effectiveness and energy efficiency enable the integration of numerous passive and reflective elements, enabling near-field propagation. In this paper, we tackle the challenges of RIS-aided 3D localization and synchronization in multipath environments, focusing on the near-field of mmWave systems. Specifically, our approach involves formulating a maximum likelihood (ML) estimation problem for the channel parameters. To initiate this process, we leverage a combination of canonical polyadic decomposition (CPD) and orthogonal matching pursuit (OMP) to obtain coarse estimates of the time of arrival (ToA) and angle of departure (AoD) under the far-field approximation. Subsequently, distances are estimated using $l_{1}$-regularization based on a near-field model. Additionally, we introduce a refinement phase employing the spatial alternating generalized expectation maximization (SAGE) algorithm. Finally, a weighted least squares approach is applied to convert channel parameters into position and clock offset estimates. To extend the estimation algorithm to ultra-large (UL) RIS-assisted localization scenarios, it is further enhanced to reduce errors associated with far-field approximations, especially in the presence of significant near-field effects, achieved by narrowing the RIS aperture. Moreover, the Cramér-Rao Bound (CRB) is derived and the RIS phase shifts are optimized to improve the positioning accuracy. Numerical results affirm the efficacy of the proposed estimation algorithm.

eess.SP↗

arXiv2024

Shear-enhanced Liquid Crystal Spinning of Conjugated Polymer Fibers

Conjugated polymer fibers can be used to manufacture various soft fibrous optoelectronic devices, significantly advancing wearable devices and smart textiles. Recently, conjugated polymer-based fibrous electronic devices have been widely used in energy conversion, electrochemical sensing, and human-machine interaction. However, the insufficient mechanical properties of conjugated polymer fibers, the difficulty in solution processing semiconductors with rigid main chains, and the challenges in large-scale continuous production have limited their further development in the wearable field. We regulated the pi - pi stacking interactions in conjugated polymer molecules below their critical liquid crystal concentration by applying fluid shear stress. We implemented secondary orientation, leading to the continuous fabrication of anisotropic semiconductor fibers. This strategy enables conjugated polymers with rigid backbones to synergistically enhance the mechanical and semiconductor properties of fibers through liquid crystal spinning. Furthermore, conjugated polymer fibers, exhibiting excellent electrochemical performance and high mechanical strength (600 MPa) that essentially meet the requirements for industrialized preparation, maintain stability under extreme temperatures, radiation, and chemical reagents. Lastly, we have demonstrated logic circuits using semiconductor fiber organic electrochemical transistors, showcasing its application potential in the field of wearable fabric-style logic processing. These findings confirm the importance of the liquid crystalline state and solution control in optimizing the performance of conjugated polymer fibers, thus paving the way for developing a new generation of soft fiber semiconductor devices.

cond-mat.soft↗

arXiv2024

SATDI: Simulation and Analysis for Time-Delay Interferometry

Time-delay interferometry (TDI) is essential for space-based gravitational wave (GW) missions to effectively suppress laser frequency noise and achieve targeting sensitivity. The principle of the TDI is to synthesize multiple laser link measurements between spacecraft and create virtual equal-arm interferometry. This process blends instrumental noises and tunes the response function to GW, yielding data characterized by TDI combinations. Extracting signals requires modeling GW signals under TDI operations in the frequency domain. In this work, we introduce a versatile framework, SATDI, which integrates simulation and analysis for TDI. The simulation aims to implement TDI to instrumental noises and GW signals, investigate influential factors in noise suppressions, and explore GW characterizations across different TDI configurations. The analysis component focuses on developing robust algorithms for modeling TDI responses to extract GWs and accurately determine source parameters. LISA is selected as the representative space mission to demonstrate the effectiveness of our framework. We simulate and analyze data containing GW signals from massive black hole binary coalescence, examining data from both first-generation and second-generation TDI Michelson configurations. The results not only validate the framework but also illustrate the influence of different factors on parameter estimation.

gr-qc↗

arXiv2024

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning

Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data. In practice, FL often faces statistical, system, and model heterogeneities, which inspires the field of Model-Heterogeneous Personalized Federated Learning (MHPFL). With the increased interest in adopting large language models (LLMs) in FL, the existing MHPFL methods cannot achieve acceptable computational and communication costs, while maintaining satisfactory model performance. To bridge this gap, we propose a novel and efficient model-heterogeneous personalized Federated learning framework based on LoRA tuning (pFedLoRA). Inspired by the popular LoRA method for fine-tuning pre-trained LLMs with a low-rank model (a.k.a., an adapter), we design a homogeneous small adapter to facilitate federated client's heterogeneous local model training with our proposed iterative training for global-local knowledge exchange. The homogeneous small local adapters are aggregated on the FL server to generate a global adapter. We theoretically prove the convergence of pFedLoRA. Extensive experiments on two benchmark datasets demonstrate that pFedLoRA outperforms six state-of-the-art baselines, beating the best method by 1.35% in test accuracy, 11.81 times computation overhead reduction and 7.41 times communication cost saving.

cs.LG↗

arXiv2024

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Federated learning (FL) has been widely adopted for collaborative training on decentralized data. However, it faces the challenges of data, system, and model heterogeneity. This has inspired the emergence of model-heterogeneous personalized federated learning (MHPFL). Nevertheless, the problem of ensuring data and model privacy, while achieving good model performance and keeping communication and computation costs low remains open in MHPFL. To address this problem, we propose a model-heterogeneous personalized Federated learning with Mixture of Experts (pFedMoE) method. It assigns a shared homogeneous small feature extractor and a local gating network for each client's local heterogeneous large model. Firstly, during local training, the local heterogeneous model's feature extractor acts as a local expert for personalized feature (representation) extraction, while the shared homogeneous small feature extractor serves as a global expert for generalized feature extraction. The local gating network produces personalized weights for extracted representations from both experts on each data sample. The three models form a local heterogeneous MoE. The weighted mixed representation fuses generalized and personalized features and is processed by the local heterogeneous large model's header with personalized prediction information. The MoE and prediction header are updated simultaneously. Secondly, the trained local homogeneous small feature extractors are sent to the server for cross-client information fusion via aggregation. Overall, pFedMoE enhances local model personalization at a fine-grained data level, while supporting model heterogeneity.

cs.LG↗

arXiv2024

Perturbation-Tolerant Structural Controllability for Linear Systems

This paper proposes a notion termed perturbation-tolerant structural controllability (PTSC) to study the generic property of controllability preservation/resilience of structured linear systems under structured perturbations. A structured system is said to be PTSC with respect to a perturbation structure if for almost all controllable realizations of this system, there are no complex-valued perturbations obeying the zero/nonzero pattern prescribed by the perturbation structure that can make the perturbed systems uncontrollable. We prove a generic property in this notion, that for almost all controllable realizations of a structured system, either there exist such structured perturbations rendering the systems uncontrollable, or there are no such perturbations. We present a decomposition-based necessary and sufficient condition for the PTSC of single-input linear systems, whose verification has polynomial time complexity. We then discuss some intuitive graph-theoretic conditions for PTSC. As an application, our results can serve as some feasibility conditions for the conventional structured controllability radius problems from a generic viewpoint.

math.OC↗

arXiv2024

Anisotropic magnetism and band evolution induced by ferromagnetic phase transition in titanium-based kagome ferromagnet SmTi3Bi4

Kagome magnets with diverse topological quantum responses are crucial for next-generation topological engineering. The anisotropic magnetism and band evolution induced by ferromagnetic phase transition (FMPT) is reported in a newly discovered titanium-based kagome ferromagnet S mTi3 Bi4, which features a distorted Ti kagome lattice and S m atomic zig-zag chains. Temperature-dependent resistivity, heat capacity, and magnetic susceptibility reveal a ferromagnetic ordering temperature Tc of 23.2 K. A large magnetic anisotropy, observed by applying the magnetic field along three crystallographic axes, identifies the b axis as the easy axis. Angle-resolved photoemission spectroscopy with first-principles calculations unveils the characteristic kagome motif, including the Dirac point at the Fermi level and multiple van Hove singularities. Notably, a band splitting and gap closing attributed to FMPT is observed, originating from the exchange coupling between S m 4 f local moments and itinerant electrons of the kagome Ti atoms, as well as the time-reversal symmetry breaking induced by the long-range ferromagnetic order. Considering the large in-plane magnetization and the evolution of electronic structure under the influence of ferromagnetic ordering, such materials promise to be a new platform for exploring the intricate electronic properties and magnetic phases based on the kagome lattice.

cond-mat.mtrl-sci↗

arXiv2024

Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective

Computational experiments have emerged as a valuable method for studying complex systems, involving the algorithmization of counterfactuals. However, accurately representing real social systems in Agent-based Modeling (ABM) is challenging due to the diverse and intricate characteristics of humans, including bounded rationality and heterogeneity. To address this limitation, the integration of Large Language Models (LLMs) has been proposed, enabling agents to possess anthropomorphic abilities such as complex reasoning and autonomous learning. These agents, known as LLM-based Agent, offer the potential to enhance the anthropomorphism lacking in ABM. Nonetheless, the absence of explicit explainability in LLMs significantly hinders their application in the social sciences. Conversely, computational experiments excel in providing causal analysis of individual behaviors and complex phenomena. Thus, combining computational experiments with LLM-based Agent holds substantial research potential. This paper aims to present a comprehensive exploration of this fusion. Primarily, it outlines the historical development of agent structures and their evolution into artificial societies, emphasizing their importance in computational experiments. Then it elucidates the advantages that computational experiments and LLM-based Agents offer each other, considering the perspectives of LLM-based Agent for computational experiments and vice versa. Finally, this paper addresses the challenges and future trends in this research domain, offering guidance for subsequent related studies.

cs.AI↗

arXiv2024

Macroscopic electro-optical modulation of solution-processed molybdenum disulfide

Molybdenum disulfide (MoS2) has drawn great interest for tunable photonics and optoelectronics advancement. Its solution processing, though scalable, results in randomly networked ensembles of discrete nanosheets with compromised properties for tunable device fabrication. Here, we show via density-functional theory calculations that the electronic structure of the individual solution-processed nanosheets can be modulated by external electric fields collectively. Particularly, the nanosheets can form Stark ladders, leading to variations in the underlying optical transition processes and thus, tunable macroscopic optical properties of the ensembles. We experimentally confirm the macroscopic electro-optical modulation employing solution-processed thin-films of MoS2 and ferroelectric P(VDF-TrFE), and prove that the localized polarization fields of P(VDF-TrFE) can modulate the optical properties of MoS2, specifically, the optical absorption and photoluminescence on a macroscopic scale. Given the scalability of solution processing, our results underpin the potential of electro-optical modulation of solution-processed MoS2 for scalable tunable photonics and optoelectronics. As an illustrative example, we successfully demonstrate solution-processed electro-absorption modulators.

cond-mat.mtrl-sci↗

arXiv2024

Learning Hybrid Policies for MPC with Application to Drone Flight in Unknown Dynamic Environments

In recent years, drones have found increased applications in a wide array of real-world tasks. Model predictive control (MPC) has emerged as a practical method for drone flight control, owing to its robustness against modeling errors/uncertainties and external disturbances. However, MPC's sensitivity to manually tuned parameters can lead to rapid performance degradation when faced with unknown environmental dynamics. This paper addresses the challenge of controlling a drone as it traverses a swinging gate characterized by unknown dynamics. This paper introduces a parameterized MPC approach named hyMPC that leverages high-level decision variables to adapt to uncertain environmental conditions. To derive these decision variables, a novel policy search framework aimed at training a high-level Gaussian policy is presented. Subsequently, we harness the power of neural network policies, trained on data gathered through the repeated execution of the Gaussian policy, to provide real-time decision variables. The effectiveness of hyMPC is validated through numerical simulations, achieving a 100\% success rate in 20 drone flight tests traversing a swinging gate, demonstrating its capability to achieve safe and precise flight with limited prior knowledge of environmental dynamics.

cs.RO↗

arXiv2024

Impact of Limited Statistics on the Measured Hyper-Order Cumulants of Net-Proton Distributions in Heavy-Ion Collisions

Hyper-order cumulants $C_5/C_1$ and $C_6/C_2$ of net-baryon distributions are anticipated to offer crucial insights into the phase transition from quark-gluon plasma to hadronic matter in heavy-ion collisions. However, the accuracy of $C_5$ and $C_6$ is highly contingent on the fine shape of the distribution's tail, the detectable range of which could be essentially truncated by low statistics. In this paper, we use the fast Skellam-based simulations, as well as the Ultrarelativistic Quantum Molecular Dynamics model, to assess the impact of limited statistics on the measurements of $C_5/C_1$ and $C_6/C_2$ of net-proton distributions at lower RHIC energies. Both ratios decrease from the unity baseline as we reduce statistics, and could even turn negative without a pertinent physics mechanism. By incorporating statistics akin to experimental data, we can replicate the net-proton $C_5/C_1$ and $C_6/C_2$ values comparable to the corresponding measurements for Au+Au collisions at $\sqrt{s_{NN}} =$ 7.7, 11.5 and 14.5 GeV. Our findings underscore a caveat to the interpretation of the observed beam energy dependence of hyper-order cumulants.

nucl-th↗

arXiv2024

Asymmetric mode-pairing quantum key distribution

Mode-pairing quantum key distribution (MP-QKD) can surpass the repeaterless rate-transmittance bound (Pirandola-Laurenza-Ottaviani-Banchi bound) without requiring global phase locking, exhibiting remarkable flexibility. However, MP-QKD necessitates equal communication distances in two channels, which is a challenging requirement in practical applications. To address this limitation, we extend the original MP-QKD to asymmetric cases. Our decoy-state estimation confirms that asymmetric channel transmittances and asymmetric intensities do not compromise the security of the protocol. We focus on the pulse-intensity relationship, a key factor for optimizing the performance of asymmetric MP-QKD. Unlike previous asymmetric protocols, the intensities of different bases in asymmetric MP-QKD cannot be decoupled. We introduce an optimal-pulse-intensity method, adaptable to various scenarios, to enhance key rates by calculating ideal pulse intensities. Simulation results in various representative scenarios indicate that our method effectively reduces the impact of asymmetric channel distances on MP-QKD performance, enhancing its practical applicability.

quant-ph↗

arXiv2023

DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution

Recent research on deep convolutional neural networks (CNNs) has provided a significant performance boost on efficient super-resolution (SR) tasks by trading off the performance and applicability. However, most existing methods focus on subtracting feature processing consumption to reduce the parameters and calculations without refining the immediate features, which leads to inadequate information in the restoration. In this paper, we propose a lightweight network termed DDistill-SR, which significantly improves the SR quality by capturing and reusing more helpful information in a static-dynamic feature distillation manner. Specifically, we propose a plug-in reparameterized dynamic unit (RDU) to promote the performance and inference cost trade-off. During the training phase, the RDU learns to linearly combine multiple reparameterizable blocks by analyzing varied input statistics to enhance layer-level representation. In the inference phase, the RDU is equally converted to simple dynamic convolutions that explicitly capture robust dynamic and static feature maps. Then, the information distillation block is constructed by several RDUs to enforce hierarchical refinement and selective fusion of spatial context information. Furthermore, we propose a dynamic distillation fusion (DDF) module to enable dynamic signals aggregation and communication between hierarchical modules to further improve performance. Empirical results show that our DDistill-SR outperforms the baselines and achieves state-of-the-art results on most super-resolution domains with much fewer parameters and less computational overhead. We have released the code of DDistill-SR at https://github.com/icandle/DDistill-SR.

eess.IV↗