arXiv subjects

Qiang Wu

Publications and source records attributed to Qiang Wu.

At least 91 records · Page 5Linked to original sources

arXiv2023

Shadows of Loop Quantum Black Holes: Semi-analytical Simulations of Loop Quantum Gravity Effects on Sagittarius A* and M 87*

In this study, we delve into the observational implications of rotating Loop Quantum Black Holes (LQBHs) within an astrophysical framework. We employ semi-analytical General Relativistic Radiative Transfer (GRRT) computations to study the emission from the accretion flow around LQBHs. Our findings indicate that the increase of Loop Quantum Gravity (LQG) effects results in an enlargement of the rings from LQBHs, thereby causing a more circular polarization pattern in the shadow images. We make comparisons with the Event Horizon Telescope (EHT) observations of Sgr\,A$^*$ and M\,87$^*$, which enable us to determine an upper limit for the polymetric function $P$ in LQG. The upper limit for Sgr\,A$^*$ is $0.2$, while for M\,87$^*$ it is $0.07$. Both black holes exhibit a preference for a relatively high spin ($a\gtrsim0.5$ for Sgr\,A$^*$ and $0.5\lesssim a \lesssim 0.7$ for M\,87$^*$). The constraints for Sgr\,A$^*$ are based on black hole spin and ring diameter, whereas for M\,87$^*$, the constraints are further tightened by the polarimetric pattern. In essence, our simulations provide observational constraints on the effect of LQG in supermassive black holes (SMBH), providing the most consistent comparison with observation.

gr-qc↗

arXiv2023

Constraints on Hairy Kerr black hole with quasi-periodic oscillations

The Hairy Kerr black hole is a novel black hole solution that depicts a rotating space-time encompassed by an axisymmetric fluid. It has significant observational importance and is an excellent candidate for an astrophysical black hole. Our study investigates the impact of the hairy charge on the quasi-periodic oscillations (QPOs) of X-ray binaries in the Hairy Kerr black hole (HKBH) space-time. The relativistic precession model is employed to compute the three principal frequencies of the accretion disk encircling the HKBH. We compare our outcomes with the observations of five X-ray binaries and employ a Markov chain Monte Carlo (MCMC) simulation for restricting the hairy charge parameters. There is no substantial evidence for the existence of hairy charge in the HKBH space-time. Therefore, we are placing observational constraints on the deformation parameters with $0<α<0.07697$ and hairy charge values ranging from $0.27182<l_0/M<2.0$.

astro-ph.HE↗

arXiv2023

PB-LLM: Partially Binarized Large Language Models

This paper explores network binarization, a radical form of quantization, compressing model weights to a single bit, specifically for Large Language Models (LLMs) compression. Due to previous binarization methods collapsing LLMs, we propose a novel approach, Partially-Binarized LLM (PB-LLM), which can achieve extreme low-bit quantization while maintaining the linguistic reasoning capacity of quantized LLMs. Specifically, our exploration first uncovers the ineffectiveness of naive applications of existing binarization algorithms and highlights the imperative role of salient weights in achieving low-bit quantization. Thus, PB-LLM filters a small ratio of salient weights during binarization, allocating them to higher-bit storage, i.e., partially-binarization. PB-LLM is extended to recover the capacities of quantized LMMs, by analyzing from the perspective of post-training quantization (PTQ) and quantization-aware training (QAT). Under PTQ, combining the concepts from GPTQ, we reconstruct the binarized weight matrix guided by the Hessian matrix and successfully recover the reasoning capacity of PB-LLM in low-bit. Under QAT, we freeze the salient weights during training, explore the derivation of optimal scaling factors crucial for minimizing the quantization error, and propose a scaling mechanism based on this derived scaling strategy for residual binarized weights. Those explorations and the developed methodologies significantly contribute to rejuvenating the performance of low-bit quantized LLMs and present substantial advancements in the field of network binarization for LLMs.The code is available at https://github.com/hahnyuan/BinaryLLM.

cs.LG↗

arXiv2023

Cooperative Network Learning for Large-Scale and Decentralized Graphs

Graph research, the systematic study of interconnected data points represented as graphs, plays a vital role in capturing intricate relationships within networked systems. However, in the real world, as graphs scale up, concerns about data security among different data-owning agencies arise, hindering information sharing and, ultimately, the utilization of graph data. Therefore, establishing a mutual trust mechanism among graph agencies is crucial for unlocking the full potential of graphs. Here, we introduce a Cooperative Network Learning (CNL) framework to ensure secure graph computing for various graph tasks. Essentially, this CNL framework unifies the local and global perspectives of GNN computing with distributed data for an agency by virtually connecting all participating agencies as a global graph without a fixed central coordinator. Inter-agency computing is protected by various technologies inherent in our framework, including homomorphic encryption and secure transmission. Moreover, each agency has a fair right to design or employ various graph learning models from its local or global perspective. Thus, CNL can collaboratively train GNN models based on decentralized graphs inferred from local and global graphs. Experiments on contagion dynamics prediction and traditional graph tasks (i.e., node classification and link prediction) demonstrate that our CNL architecture outperforms state-of-the-art GNNs developed at individual sites, revealing that CNL can provide a reliable, fair, secure, privacy-preserving, and global perspective to build effective and personalized models for network applications. We hope this framework will address privacy concerns in graph-related research and integrate decentralized graph data structures to benefit the network research community in cooperation and innovation.

cs.LG↗

arXiv2023

Accretion disk around Reissner-Nordström black hole coupled with a nonlinear electrodynamics field

The phenomenon by which matter accumulates in the vicinity of a huge celestial object is known as accretion. The gravitational energy is excreted as a consequence of infalling matter onto compact objects. The accretion procedure around celestial bodies like neutron stars, white dwarfs, and black holes has considerable importance because of its ability to transform gravitational energy into radiation. This study investigates the particle's geodesic motion and accretion around the spherically symmetric Reissner-Nordström black hole coupled with a nonlinear electrodynamics field utilizing isothermal fluid. The formation of the disc-like structure in the accretion process arises from the geodesic motion exhibited by particles near the black hole. The circular orbits, radiant flux energy, radioactive efficiency, and radiant temperature, can be determined. Our study focuses on the examination of particles exhibiting stable circular orbits within the equatorial plane. We analyze the perturbations experienced by particles throughout employing restoring forces and the oscillatory behavior of the particles around a compact object. We conduct an analysis of the fluid's critical flow and maximum accretion rate. Our results show how the black hole parameter $ζ$ and charge $q$ affect the circular geodesic of particles and the maximum accretion rate of the Reissner-Nordström black hole coupled with nonlinear electrodynamics.

gr-qc↗

arXiv2023

On the parameters of the spherically symmetric parametrized Rezzolla-Zhidenko spacetime through solar system tests, orbit of S2 star about Sgr A$^\star$, and quasiperiodic oscillations

In this paper, we find the higher order expansion parameters $α$ and $λ$ of spherically symmetric parametrized Rezzolla--Zhidenko (PRZ) spacetime by using its functions of the radial coordinate. We subject the parameters of this spacetime to classical tests including weak gravitational field effects in Solar System, observations of the S2 star located in the star cluster close to the Sgr A$^{\star}$ and of the frequencies of selected microquasars. Based on this spherically symmetric spacetime we perform the analytic calculations for Solar System effects like perihelion shift, light deflection, and gravitational time delay so as to determine limits on the parameters by using observational data. We restrict our attention to the limits on the two higher order expansion parameters $α$ and $λ$ that survive at the horizon or near the horizon of spherically symmetric metrics. The properties of these two small parameters expansion in PRZ parametrization are discussed. We further apply the Monte Carlo Markov Chain (MCMC) simulations to analyze and obtain the limits on the expansion parameters by using observations of phenomena of the S2 star. Finally, we consider the epicyclic motions and derive analytic expressions of the epicyclic frequencies. Applying these expressions to the quasiperiodic oscillations (QPOs) of selected microquasars allows us to set further limits on the parameters of the PRZ spacetime. Our results demonstrate that the higher order expansion parameters can be given in the range $α\, ,λ=(-0.09\, , 0.09)$ and of order $\sim 10^{-2}$ as a consequence of three various tests and observations.

gr-qc↗

arXiv2023

Robust Super-Resolution Imaging Based on a Ring Core Fiber with Orbital Angular Momentum

Single fiber imaging technology offers unique insights for research and inspection in difficult to reach and narrow spaces. In particular, ultra-compact multimode fiber (MMF) imaging, has received increasing interest over the past decade. However, MMF imaging will be seriously distorted when subjected to dynamic perturbations due to time-varying mode coupling, and the imaging of space objects via Gaussian beam will be relatively degraded at the edge due to insufficient contrast. Here, a robust super-resolution imaging method based on a ring core fiber (RCF) with orbital angular momentum (OAM) has been proposed and experimentally demonstrated. The OAM modes propagating in the RCF form a series of weakly-coupled mode groups, making our imaging system robust to external perturbations. In addition, a spiral phase plate is used as a vortex filter to produce OAM for edge enhancement, thus improving the image resolution. Furthermore, a few-shot U-Transformer neural network is proposed to enhance the resilience of the developed RCF-OAM imaging system against environmental perturbations. Finally, the developed RCF-OAM imaging system achieves biological image transmission, demonstrating the practicality of our scheme. This pioneering RCF OAM imaging system may have broad applications, potentially revolutionising fields such as biological imaging and industrial non-destructive testing.

physics.optics↗

arXiv2023

Masked Cross-image Encoding for Few-shot Segmentation

Few-shot segmentation (FSS) is a dense prediction task that aims to infer the pixel-wise labels of unseen classes using only a limited number of annotated images. The key challenge in FSS is to classify the labels of query pixels using class prototypes learned from the few labeled support exemplars. Prior approaches to FSS have typically focused on learning class-wise descriptors independently from support images, thereby ignoring the rich contextual information and mutual dependencies among support-query features. To address this limitation, we propose a joint learning method termed Masked Cross-Image Encoding (MCE), which is designed to capture common visual properties that describe object details and to learn bidirectional inter-image dependencies that enhance feature interaction. MCE is more than a visual representation enrichment module; it also considers cross-image mutual dependencies and implicit guidance. Experiments on FSS benchmarks PASCAL-$5^i$ and COCO-$20^i$ demonstrate the advanced meta-learning ability of the proposed method.

cs.CV↗

arXiv2023

Thouless-Anderson-Palmer equations for the Multi-species Sherrington-Kirkpatrick model

We prove the Thouless-Anderson-Palmer (TAP) equations for the local magnetization in the multi-species Sherrington-Kirkpatrick (MSK) spin glass model. One of the key ingredients is based on concentration results established in~\cite{arXiv:2012.13381}. The equations hold at high temperature for general MSK model without positive semi-definite assumption on the variance profile matrix $\mathbfΔ^2$.

math.PR↗

arXiv2023

Imbalanced Large Graph Learning Framework for FPGA Logic Elements Packing Prediction

Packing is a required step in a typical FPGA CAD flow. It has high impacts to the performance of FPGA placement and routing. Early prediction of packing results can guide design optimization and expedite design closure. In this work, we propose an imbalanced large graph learning framework, ImLG, for prediction of whether logic elements will be packed after placement. Specifically, we propose dedicated feature extraction and feature aggregation methods to enhance the node representation learning of circuit graphs. With imbalanced distribution of packed and unpacked logic elements, we further propose techniques such as graph oversampling and mini-batch training for this imbalanced learning task in large circuit graphs. Experimental results demonstrate that our framework can improve the F1 score by 42.82% compared to the most recent Gaussian-based prediction method. Physical design results show that the proposed method can assist the placer in improving routed wirelength by 0.93% and SLICE occupation by 0.89%.

cs.LG↗

arXiv2023

Constraints on the rotating self-dual black hole with quasi-periodic oscillations

An impressive feature of loop quantum gravity (LQG) is that it can elegantly resolve both the big bang and black hole singularities. By using the Newman-Janis algorithm, a regular and effective rotating self-dual black hole(SDBH) metric could be constructed, which alters the Kerr geometry with a polymeric function $P$ from the quantum effects of LQG geometry. In this paper, we investigate its impact on the frequency characteristics of the X-ray quasi-periodic oscillations(QPOs) from 5 X-ray binaries and contrast it with the existing results of the orbital, periastron precession and nodal precession frequencies within the relativistic precession model. We apply a Monte Carlo Markov Chain (MCMC) simulation to examine the possible LQG effects on the X-ray QPOs. We found that the best constraint result for the rotating self-dual geometry from LQG came from the QPOs of X-ray binary GRO J1655-40, which establish an upper bound on the polymeric function $P$ less than $6.17\times 10^{-3}$ at 95\% confidence level. This bound leads to a restriction on the polymeric parameter $δ$ of LQG to be 0.67.

gr-qc↗

arXiv2023

Multiobjective Hydropower Reservoir Operation Optimization with Transformer-Based Deep Reinforcement Learning

Due to shortage of water resources and increasing water demands, the joint operation of multireservoir systems for balancing power generation, ecological protection, and the residential water supply has become a critical issue in hydropower management. However, the numerous constraints and nonlinearity of multiple reservoirs make solving this problem time-consuming. To address this challenge, a deep reinforcement learning approach that incorporates a transformer framework is proposed. The multihead attention mechanism of the encoder effectively extracts information from reservoirs and residential areas, and the multireservoir attention network of the decoder generates suitable operational decisions. The proposed method is applied to Lake Mead and Lake Powell in the Colorado River Basin. The experimental results demonstrate that the transformer-based deep reinforcement learning approach can produce appropriate operational outcomes. Compared to a state-of-the-art method, the operation strategies produced by the proposed approach generate 10.11% more electricity, reduce the amended annual proportional flow deviation by 39.69%, and increase water supply revenue by 4.10%. Consequently, the proposed approach offers an effective method for the multiobjective operation of multihydropower reservoir systems.

cs.LG↗

arXiv2023

Influential Simplices Mining via Simplicial Convolutional Network

Simplicial complexes have recently been in the limelight of higher-order network analysis, where a minority of simplices play crucial roles in structures and functions due to network heterogeneity. We find a significant inconsistency between identifying influential nodes and simplices. Therefore, it remains elusive how to characterize simplices' influence and identify influential simplices, despite the relative maturity of research on influential nodes (0-simplices) identification. Meanwhile, graph neural networks (GNNs) are potent tools that can exploit network topology and node features simultaneously, but they struggle to tackle higher-order tasks. In this paper, we propose a higher-order graph learning model, named influential simplices mining neural network (ISMnet), to identify vital h-simplices in simplicial complexes. It can tackle higher-order tasks by leveraging novel higher-order presentations: hierarchical bipartite graphs and higher-order hierarchical (HoH) Laplacians, where targeted simplices are grouped into a hub set and can interact with other simplices. Furthermore, ISMnet employs learnable graph convolutional operators in each HoH Laplacian domain to capture interactions among simplices, and it can identify influential simplices of arbitrary order by changing the hub set. Empirical results demonstrate that ISMnet significantly outperforms existing methods in ranking 0-simplices (nodes) and 2-simplices. In general, this novel framework excels in identifying influential simplices and promises to serve as a potent tool in higher-order network analysis.

cs.SI↗

arXiv2023

Lightweight Vision Transformer with Cross Feature Attention

Recent advances in vision transformers (ViTs) have achieved great performance in visual recognition tasks. Convolutional neural networks (CNNs) exploit spatial inductive bias to learn visual representations, but these networks are spatially local. ViTs can learn global representations with their self-attention mechanism, but they are usually heavy-weight and unsuitable for mobile devices. In this paper, we propose cross feature attention (XFA) to bring down computation cost for transformers, and combine efficient mobile CNNs to form a novel efficient light-weight CNN-ViT hybrid model, XFormer, which can serve as a general-purpose backbone to learn both global and local representation. Experimental results show that XFormer outperforms numerous CNN and ViT-based models across different tasks and datasets. On ImageNet1K dataset, XFormer achieves top-1 accuracy of 78.5% with 5.5 million parameters, which is 2.2% and 6.3% more accurate than EfficientNet-B0 (CNN-based) and DeiT (ViT-based) for similar number of parameters. Our model also performs well when transferring to object detection and semantic segmentation tasks. On MS COCO dataset, XFormer exceeds MobileNetV2 by 10.5 AP (22.7 -> 33.2 AP) in YOLOv3 framework with only 6.3M parameters and 3.8G FLOPs. On Cityscapes dataset, with only a simple all-MLP decoder, XFormer achieves mIoU of 78.5 and FPS of 15.3, surpassing state-of-the-art lightweight segmentation networks.

cs.CV↗

arXiv2023

RPTQ: Reorder-based Post-training Quantization for Large Language Models

Large-scale language models (LLMs) have demonstrated impressive performance, but their deployment presents challenges due to their significant memory usage. This issue can be alleviated through quantization. In this paper, we identify that the challenge in quantizing activations in LLMs arises from varying ranges across channels, rather than solely the presence of outliers. To address this challenge, we introduce a quantization method called RPTQ, which utilizes a reorder-based approach. By rearranging the channels and quantizing them in clusters, RPTQ effectively mitigates the impact of range differences between channels. To minimize the overhead of the reorder operation, we fuse it into the layer norm operation and weights in linear layers. In our experiments, RPTQ achieved a significant breakthrough by utilizing 3-bit activation in LLMs for the first time, resulting in a substantial reduction in memory usage. For instance, quantizing OPT-175b can lead to a memory consumption reduction of up to 80%.

cs.CL↗

arXiv2023

Observational tests of quantum extension of Schwarzschild spacetime in loop quantum gravity with stars in the galactic center

In this paper, we use the publicly available observational data of 17 stellar stars orbiting Sgr A* to test the quantum extension of Schwarzschild spacetime in loop quantum gravity (LQG). For our purpose, we transform the geodesical evolution of a massive particle in the quantum-extended Schwarzschild black hole to the perturbed Kepler problem and calculate the effects of LQG on the pericentre advance of the stellar stars. With these effects, one is able to compare them with the publicly available astrometric and spectroscopic data of stellar stars in the galactic center. We perform Monte Carlo Markov Chain (MCMC) simulations to probe the possible LQG effects on the orbit of S-stars. No significant evidence of the quantum-extended Schwarzschild black hole from LQG is found. Among the posterior analyses of 17 S-stars, the result of S2 gives the strongest bound on the LQG parameter $A_λ$, which places an upper bound at 95\% confidence level on $A_λ$ to be $A_λ< 0.302$.

gr-qc↗

arXiv2023

DRAC: Diabetic Retinopathy Analysis Challenge with Ultra-Wide Optical Coherence Tomography Angiography Images

Computer-assisted automatic analysis of diabetic retinopathy (DR) is of great importance in reducing the risks of vision loss and even blindness. Ultra-wide optical coherence tomography angiography (UW-OCTA) is a non-invasive and safe imaging modality in DR diagnosis system, but there is a lack of publicly available benchmarks for model development and evaluation. To promote further research and scientific benchmarking for diabetic retinopathy analysis using UW-OCTA images, we organized a challenge named "DRAC - Diabetic Retinopathy Analysis Challenge" in conjunction with the 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022). The challenge consists of three tasks: segmentation of DR lesions, image quality assessment and DR grading. The scientific community responded positively to the challenge, with 11, 12, and 13 teams from geographically diverse institutes submitting different solutions in these three tasks, respectively. This paper presents a summary and analysis of the top-performing solutions and results for each task of the challenge. The obtained results from top algorithms indicate the importance of data augmentation, model architecture and ensemble of networks in improving the performance of deep learning models. These findings have the potential to enable new developments in diabetic retinopathy analysis. The challenge remains open for post-challenge registrations and submissions for benchmarking future methodology developments.

eess.IV↗

arXiv2023

Benchmarking the Reliability of Post-training Quantization: a Particular Focus on Worst-case Performance

Post-training quantization (PTQ) is a popular method for compressing deep neural networks (DNNs) without modifying their original architecture or training procedures. Despite its effectiveness and convenience, the reliability of PTQ methods in the presence of some extrem cases such as distribution shift and data noise remains largely unexplored. This paper first investigates this problem on various commonly-used PTQ methods. We aim to answer several research questions related to the influence of calibration set distribution variations, calibration paradigm selection, and data augmentation or sampling strategies on PTQ reliability. A systematic evaluation process is conducted across a wide range of tasks and commonly-used PTQ paradigms. The results show that most existing PTQ methods are not reliable enough in term of the worst-case group performance, highlighting the need for more robust methods. Our findings provide insights for developing PTQ methods that can effectively handle distribution shift scenarios and enable the deployment of quantized DNNs in real-world applications.

cs.LG↗