arXiv subjects

Hao Zhang

Publications and source records attributed to Hao Zhang.

At least 739 records · Page 41Linked to original sources

arXiv2024

Activity Detection for Massive Connectivity in Cell-free Networks with Unknown Large-scale Fading, Channel Statistics, Noise Variance, and Activity Probability: A Bayesian Approach

Activity detection is an important task in the next generation grant-free multiple access. While there are a number of existing algorithms designed for this purpose, they mostly require precise information about the network, such as large-scale fading coefficients, small-scale fading channel statistics, noise variance at the access points, and user activity probability. Acquiring these information would take a significant overhead and their estimated values might not be accurate. This problem is even more severe in cell-free networks as there are many of these parameters to be acquired. Therefore, this paper sets out to investigate the activity detection problem without the above-mentioned information. In order to handle so many unknown parameters, this paper employs the Bayesian approach, where the unknown variables are endowed with prior distributions which effectively act as regularizations. Together with the likelihood function, a maximum a posteriori (MAP) estimator and a variational inference algorithm are derived. Extensive simulations demonstrate that the proposed methods, even without the knowledge of these system parameters, perform better than existing state-of-the-art methods, such as covariance-based and approximate message passing methods.

cs.LG↗

arXiv2024

Overview of Sensing Attacks on Autonomous Vehicle Technologies and Impact on Traffic Flow

While perception systems in Connected and Autonomous Vehicles (CAVs), which encompass both communication technologies and advanced sensors, promise to significantly reduce human driving errors, they also expose CAVs to various cyberattacks. These include both communication and sensing attacks, which potentially jeopardize not only individual vehicles but also overall traffic safety and efficiency. While much research has focused on communication attacks, sensing attacks, which are equally critical, have garnered less attention. To address this gap, this study offers a comprehensive review of potential sensing attacks and their impact on target vehicles, focusing on commonly deployed sensors in CAVs such as cameras, LiDAR, Radar, ultrasonic sensors, and GPS. Based on this review, we discuss the feasibility of integrating hardware-in-the-loop experiments with microscopic traffic simulations. We also design baseline scenarios to analyze the macro-level impact of sensing attacks on traffic flow. This study aims to bridge the research gap between individual vehicle sensing attacks and broader macroscopic impacts, thereby laying the foundation for future systemic understanding and mitigation.

eess.SY↗

arXiv2024

Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks

We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM). This integration enables the detection and segmentation of any regions based on arbitrary text inputs and opens a door to connecting various vision models. As shown in Fig.1, a wide range of vision tasks can be achieved by using the versatile Grounded SAM pipeline. For example, an automatic annotation pipeline based solely on input images can be realized by incorporating models such as BLIP and Recognize Anything. Additionally, incorporating Stable-Diffusion allows for controllable image editing, while the integration of OSX facilitates promptable 3D human motion analysis. Grounded SAM also shows superior performance on open-vocabulary benchmarks, achieving 48.7 mean AP on SegInW (Segmentation in the wild) zero-shot benchmark with the combination of Grounding DINO-Base and SAM-Huge models.

cs.CV↗

arXiv2024

Best constants in the vector-valued Littlewood-Paley-Stein theory

Let $L$ be a sectorial operator of type $α$ ($0 \leq α< π/2$) on $L^2(\mathbb{R}^d)$ with the kernels of $\{e^{-tL}\}_{t>0}$ satisfying certain size and regularity conditions. Define $$ S_{q,L}(f)(x) = \left(\int_0^{\infty}\int_{|y-x| < t} \|tL{e^{-tL}} (f)(y) \|_X^q \,\frac{{\rm d} y{\rm d} t}{t^{d+1}} \right)^{\frac{1}{q}},$$ $$G_{q,{L}}(f)=\left( \int_0^{\infty} \left\|t{L}{e^{-t{L}}} (f)(y) \right\|_X^q \,\frac{{\rm d} t}{t}\right)^{\frac{1}{q}}.$$ We show that for $\underline{\mathrm{any}}$ Banach space $X$, $1 \leq p < \infty$ and $1 < q < \infty$ and $f\in C_c(\mathbb R^d)\otimes X$, there hold \begin{align*} p^{-\frac{1}{q}}\| S_{q,{\sqrtΔ}}(f) \|_p \lesssim_{d, γ, β} \| S_{q,L}(f) \|_p \lesssim_{d, γ, β} p^{\frac{1}{q}}\| S_{q,{\sqrtΔ}}(f) \|_p, \end{align*} \begin{align*} p^{-\frac{1}{q}}\| S_{q,L}(f) \|_p \lesssim_{d, γ, β} \| G_{q,L}(f) \|_p \lesssim_{d, γ, β} p^{\frac{1}{q}}\| S_{q,L}(f) \|_p, \end{align*} where $Δ$ is the standard Laplacian; moreover all the orders appeared above are {\it optimal} as $p\rightarrow1$. This, combined with the existing results in [29, 33], allows us to resolve partially Problem 1.8, Problem A.1 and Conjecture A.4 regarding the optimal Lusin type constant and the characterization of martingale type in a recent remarkable work due to Xu [48]. Several difficulties originate from the arbitrariness of $X$, which excludes the use of vector-valued Calderón-Zygmund theory. To surmount the obstacles, we introduce the novel vector-valued Hardy and BMO spaces associated with sectorial operators; in addition to Mei's duality techniques and Wilson's intrinsic square functions developed in this setting, the key new input is the vector-valued tent space theory and its unexpected amalgamation with these `old' techniques.

math.FA↗

arXiv2024

Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding

Table-based reasoning with large language models (LLMs) is a promising direction to tackle many table understanding tasks, such as table-based question answering and fact verification. Compared with generic reasoning, table-based reasoning requires the extraction of underlying semantics from both free-form questions and semi-structured tabular data. Chain-of-Thought and its similar approaches incorporate the reasoning chain in the form of textual context, but it is still an open question how to effectively leverage tabular data in the reasoning chain. We propose the Chain-of-Table framework, where tabular data is explicitly used in the reasoning chain as a proxy for intermediate thoughts. Specifically, we guide LLMs using in-context learning to iteratively generate operations and update the table to represent a tabular reasoning chain. LLMs can therefore dynamically plan the next operation based on the results of the previous ones. This continuous evolution of the table forms a chain, showing the reasoning process for a given tabular problem. The chain carries structured information of the intermediate results, enabling more accurate and reliable predictions. Chain-of-Table achieves new state-of-the-art performance on WikiTQ, FeTaQA, and TabFact benchmarks across multiple LLM choices.

cs.CL↗

arXiv2024

Focaler-IoU: More Focused Intersection over Union Loss

Bounding box regression plays a crucial role in the field of object detection, and the positioning accuracy of object detection largely depends on the loss function of bounding box regression. Existing researchs improve regression performance by utilizing the geometric relationship between bounding boxes, while ignoring the impact of difficult and easy sample distribution on bounding box regression. In this article, we analyzed the impact of difficult and easy sample distribution on regression results, and then proposed Focaler-IoU, which can improve detector performance in different detection tasks by focusing on different regression samples. Finally, comparative experiments were conducted using existing advanced detectors and regression methods for different detection tasks, and the detection performance was further improved by using the method proposed in this paper.Code is available at \url{https://github.com/malagoutou/Focaler-IoU}.

cs.CV↗

arXiv2024

Crystal Transformer Based Universal Atomic Embedding for Accurate and Transferable Prediction of Materials Properties

In this work, we propose a novel approach to generate universal atomic embeddings, significantly enhancing the representational and accuracy aspects of atomic embeddings, which ultimately improves the accuracy of property prediction. Moreover, we demonstrate the excellent transferability of universal atomic embeddings across different databases and various property tasks. Our approach centers on developing the CrystalTransformer model. Unlike traditional methods, this model does not possess a fundamental graph network architecture but utilizes the Transformer architecture to extract latent atomic features. This allows the CrystalTransformer to mitigate the inherent topological information bias of graph neural networks while maximally preserving the atomic chemical information, making it more accurate in encoding complex atomic features and thereby offering a deeper understanding of the atoms in materials. In our research, we highlight the advantages of CrystalTransformer in generating universal atomic embeddings through comparisons with current mainstream graph neural network models. Furthermore, we validate the effectiveness of universal atomic embeddings in enhancing the accuracy of model predictions for properties and demonstrate their transferability across different databases and property tasks through various experiments. As another key aspect of our study, we discover the strong physical interpretability implied in universal atomic embeddings through clustering and correlation analysis, indicating the immense potential of our universal atomic embeddings as atomic fingerprints.

cond-mat.mtrl-sci↗

arXiv2024

Learning Implicit Representation for Reconstructing Articulated Objects

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do not generalize well to articulated objects in the wild. We treat an articulated object as an unknown, semi-rigid skeletal structure surrounded by nonrigid material (e.g., skin). Our method simultaneously estimates the visible (explicit) representation (3D shapes, colors, camera parameters) and the implicit skeletal representation, from motion cues in the object video without 3D supervision. Our implicit representation consists of four parts. (1) Skeleton, which specifies how semi-rigid parts are connected. (2) \textcolor{black}{Skinning Weights}, which associates each surface vertex with semi-rigid parts with probability. (3) Rigidity Coefficients, specifying the articulation of the local surface. (4) Time-Varying Transformations, which specify the skeletal motion and surface deformation parameters. We introduce an algorithm that uses physical constraints as regularization terms and iteratively estimates both implicit and explicit representations. Our method is category-agnostic, thus eliminating the need for category-specific skeletons, we show that our method outperforms state-of-the-art across standard video datasets.

cs.CV↗

arXiv2024

Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs

AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the chemical spatial structure from 1D sequences. In this work, we pre-train a transformer model on chemical language and fine-tune it toward drug design objectives, and investigate the correspondence between high-frequency SMILES substrings and molecular fragments. The results indicate that language models can understand chemical structures from the perspective of molecular fragments, and the structural knowledge learned through fine-tuning is reflected in the high-frequency SMILES substrings generated by the model.

cs.LG↗

arXiv2024

Real-time imaging of standing-wave patterns in microresonators

Real-time characterization of microresonator dynamics is important for many applications. In particular it is critical for near-field sensing and understanding light-matter interactions. Here, we report camera-facilitated imaging and analysis of standing wave patterns in optical ring resonators. The standing wave pattern is generated through bi-directional pumping of a microresonator and the scattered light from the microresonator is collected by a short-wave infrared (SWIR) camera. The recorded scattering patterns are wavelength dependent, and the scattered intensity exhibits a linear relation with the circulating power within the microresonator. By modulating the relative phase between the two pump waves, we can control the generated standing waves movements and characterize the resonator with the SWIR camera. The visualized standing wave enables subwavelength distance measurements of scattering targets with nanometer-level accuracy. This work opens new avenues for applications in on-chip near-field (bio-)sensing, real time characterization of photonic integrated circuits and backscattering control in telecom systems.

physics.optics↗

arXiv2024

Crafter: Facial Feature Crafting against Inversion-based Identity Theft on Deep Models

With the increased capabilities at the edge (e.g., mobile device) and more stringent privacy requirement, it becomes a recent trend for deep learning-enabled applications to pre-process sensitive raw data at the edge and transmit the features to the backend cloud for further processing. A typical application is to run machine learning (ML) services on facial images collected from different individuals. To prevent identity theft, conventional methods commonly rely on an adversarial game-based approach to shed the identity information from the feature. However, such methods can not defend against adaptive attacks, in which an attacker takes a countermove against a known defence strategy. We propose Crafter, a feature crafting mechanism deployed at the edge, to protect the identity information from adaptive model inversion attacks while ensuring the ML tasks are properly carried out in the cloud. The key defence strategy is to mislead the attacker to a non-private prior from which the attacker gains little about the private identity. In this case, the crafted features act like poison training samples for attackers with adaptive model updates. Experimental results indicate that Crafter successfully defends both basic and possible adaptive attacks, which can not be achieved by state-of-the-art adversarial game-based methods.

cs.CR↗

arXiv2024

Shape-IoU: More Accurate Metric considering Bounding Box Shape and Scale

As an important component of the detector localization branch, bounding box regression loss plays a significant role in object detection tasks. The existing bounding box regression methods usually consider the geometric relationship between the GT box and the predicted box, and calculate the loss by using the relative position and shape of the bounding boxes, while ignoring the influence of inherent properties such as the shape and scale of the bounding boxes on bounding box regression. In order to make up for the shortcomings of existing research, this article proposes a bounding box regression method that focuses on the shape and scale of the bounding box itself. Firstly, we analyzed the regression characteristics of the bounding boxes and found that the shape and scale factors of the bounding boxes themselves will have an impact on the regression results. Based on the above conclusions, we propose the Shape IoU method, which can calculate the loss by focusing on the shape and scale of the bounding box itself, thereby making the bounding box regression more accurate. Finally, we validated our method through a large number of comparative experiments, which showed that our method can effectively improve detection performance and outperform existing methods, achieving state-of-the-art performance in different detection tasks.Code is available at https://github.com/malagoutou/Shape-IoU

cs.CV↗

arXiv2024

SnapCap: Efficient Snapshot Compressive Video Captioning

Video Captioning (VC) is a challenging multi-modal task since it requires describing the scene in language by understanding various and complex videos. For machines, the traditional VC follows the "imaging-compression-decoding-and-then-captioning" pipeline, where compression is pivot for storage and transmission. However, in such a pipeline, some potential shortcomings are inevitable, i.e., information redundancy resulting in low efficiency and information loss during the sampling process for captioning. To address these problems, in this paper, we propose a novel VC pipeline to generate captions directly from the compressed measurement, which can be captured by a snapshot compressive sensing camera and we dub our model SnapCap. To be more specific, benefiting from the signal simulation, we have access to obtain abundant measurement-video-annotation data pairs for our model. Besides, to better extract language-related visual representations from the compressed measurement, we propose to distill the knowledge from videos via a pre-trained CLIP with plentiful language-vision associations to guide the learning of our SnapCap. To demonstrate the effectiveness of SnapCap, we conduct experiments on two widely-used VC datasets. Both the qualitative and quantitative results verify the superiority of our pipeline over conventional VC pipelines. In particular, compared to the "caption-after-reconstruction" methods, our SnapCap can run at least 3$\times$ faster, and achieve better caption results.

cs.CV↗

arXiv2024

MPN: Leveraging Multilingual Patch Neuron for Cross-lingual Model Editing

Large language models are known for encoding a vast amount of factual knowledge, but they often becomes outdated due to the ever-changing nature of external information. A promising solution to this challenge is the utilization of model editing methods to update the knowledge in an efficient manner. However, the majority of existing model editing techniques are limited to monolingual frameworks, thus failing to address the crucial issue of cross-lingual knowledge synchronization for multilingual models. To tackle this problem, we propose a simple yet effective method that trains multilingual patch neuron to store cross-lingual knowledge. It can be easily adapted to existing approaches to enhance their cross-lingual editing capabilities. To evaluate our method, we conduct experiments using both the XNLI dataset and a self-constructed XFEVER dataset. Experimental results demonstrate that our proposed method achieves improved performance in cross-lingual editing tasks without requiring excessive modifications to the original methodology, thereby showcasing its user-friendly characteristics. Codes will be released soon.

cs.CL↗

arXiv2024

FED-NeRF: Achieve High 3D Consistency and Temporal Coherence for Face Video Editing on Dynamic NeRF

The success of the GAN-NeRF structure has enabled face editing on NeRF to maintain 3D view consistency. However, achieving simultaneously multi-view consistency and temporal coherence while editing video sequences remains a formidable challenge. This paper proposes a novel face video editing architecture built upon the dynamic face GAN-NeRF structure, which effectively utilizes video sequences to restore the latent code and 3D face geometry. By editing the latent code, multi-view consistent editing on the face can be ensured, as validated by multiview stereo reconstruction on the resulting edited images in our dynamic NeRF. As the estimation of face geometries occurs on a frame-by-frame basis, this may introduce a jittering issue. We propose a stabilizer that maintains temporal coherence by preserving smooth changes of face expressions in consecutive frames. Quantitative and qualitative analyses reveal that our method, as the pioneering 4D face video editor, achieves state-of-the-art performance in comparison to existing 2D or 3D-based approaches independently addressing identity and motion. Codes will be released.

cs.CV↗

arXiv2024

Unlocking the Potential of Large Language Models for Explainable Recommendations

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making when using online services. However, existing explainable recommendation systems focus on using small-size language models. It remains uncertain what impact replacing the explanation generator with the recently emerging large language models (LLMs) would have. Can we expect unprecedented results? In this study, we propose LLMXRec, a simple yet effective two-stage explainable recommendation framework aimed at further boosting the explanation quality by employing LLMs. Unlike most existing LLM-based recommendation works, a key characteristic of LLMXRec is its emphasis on the close collaboration between previous recommender models and LLM-based explanation generators. Specifically, by adopting several key fine-tuning techniques, including parameter-efficient instructing tuning and personalized prompt techniques, controllable and fluent explanations can be well generated to achieve the goal of explanation recommendation. Most notably, we provide three different perspectives to evaluate the effectiveness of the explanations. Finally, we conduct extensive experiments over several benchmark recommender models and publicly available datasets. The experimental results not only yield positive results in terms of effectiveness and efficiency but also uncover some previously unknown outcomes. To facilitate further explorations in this area, the full code and detailed original results are open-sourced at https://github.com/GodFire66666/LLM_rec_explanation/.

cs.IR↗

arXiv2024

RF E-field enhanced sensing based on Rydberg-atom-based superheterodyne receiver

We present enhanced sensing of radio frequency (RF) electric fields (E-fields) by the combined polarizability of Rydberg atoms and the optimized local oscillator (LO) fields of supergheterodyne receiving. Our modified theoretical model reveals the dependencies of sensitivity of E-field amplitude measurement on the polarizability of Rydberg states and the strength of the LO RF field. The enhanced sensitivity of megahertz(MHz) E-field are demonstrated at an optimal LO field for three different Rydberg states $\rm 43D_{5/2}$, $\rm 60S_{1/2}$, and $\rm 90S_{1/2}$. The sensitivity of 63 MHz for the $\rm 90S_{1/2}$ state reaches 0.96 $μ\rm V/cm/\sqrt{Hz}$ that is about an order of magnitude higher than those already published. This result closely approaches the theoretical sensitivity limit of RF dipole antennas, and indicates the potential for breaking the limit in measuring sub-MHz E-fields. This atomic sensor based on Rydberg Stark effect with heterodyne technique is expected to boost an alternative solution to electric dipole antennas.

physics.atom-ph↗

arXiv2024

Quantum sensing of microwave electric fields based on Rydberg atoms

Microwave electric field sensing is of importance for a wide range of applications in areas of remote sensing, radar astronomy and communications. Over the past decade, Rydberg atoms, owing to their exaggerated response to microwave electric fields, plentiful optional energy levels and integratable preparation methods, have been used in ultra-sensitive, wide broadband, traceable, stealthy microwave electric field sensing. This review first introduces the basic concept of quantum sensing, properties of Rydberg atoms and principles of quantum sensing of microwave electric fields with Rydberg atoms. Then an overview of this very active research direction is gradually expanded, covering progresses of sensitivity and bandwidth in Rydberg atoms based icrowavesensing,uperheterodyne quantum sensing with microwave-dressed Rydberg atoms, quantum-enhanced sensing of microwave electric field, recent advanced quantum measurement systems and approaches to further improve the performance of microwave electric field sensing. Finally, a brief outlook on future development directions is discussed.

physics.atom-ph↗