Searcharxiv⌕ Search

arXiv subjects

Jun Zhang

Publications and source records attributed to Jun Zhang.

At least 811 records · Page 45Linked to original sources

How Powerful is Graph Convolution for Recommendation?

Graph convolutional networks (GCNs) have recently enabled a popular class of algorithms for collaborative filtering (CF). Nevertheless, the theoretical underpinnings of their empirical successes remain elusive. In this paper, we endeavor to obtain a better understanding of GCN-based CF methods via the lens of graph signal processing. By identifying the critical role of smoothness, a key concept in graph signal processing, we develop a unified graph convolution-based framework for CF. We prove that many existing CF methods are special cases of this framework, including the neighborhood-based methods, low-rank matrix factorization, linear auto-encoders, and LightGCN, corresponding to different low-pass filters. Based on our framework, we then present a simple and computationally efficient CF baseline, which we shall refer to as Graph Filter based Collaborative Filtering (GF-CF). Given an implicit feedback matrix, GF-CF can be obtained in a closed form instead of expensive training with back-propagation. Experiments will show that GF-CF achieves competitive or better performance against deep learning-based methods on three well-known datasets, notably with a $70\%$ performance gain over LightGCN on the Amazon-book dataset.

cs.IR↗

Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Query

Text-based image retrieval has seen considerable progress in recent years. However, the performance of existing methods suffers in real life since the user is likely to provide an incomplete description of an image, which often leads to results filled with false positives that fit the incomplete description. In this work, we introduce the partial-query problem and extensively analyze its influence on text-based image retrieval. Previous interactive methods tackle the problem by passively receiving users' feedback to supplement the incomplete query iteratively, which is time-consuming and requires heavy user effort. Instead, we propose a novel retrieval framework that conducts the interactive process in an Ask-and-Confirm fashion, where AI actively searches for discriminative details missing in the current query, and users only need to confirm AI's proposal. Specifically, we propose an object-based interaction to make the interactive retrieval more user-friendly and present a reinforcement-learning-based policy to search for discriminative objects. Furthermore, since fully-supervised training is often infeasible due to the difficulty of obtaining human-machine dialog data, we present a weakly-supervised training strategy that needs no human-annotated dialogs other than a text-image dataset. Experiments show that our framework significantly improves the performance of text-based image retrieval. Code is avaiable at https://github.com/CuthbertCai/Ask-Confirm.

cs.CV↗

Modification of the hybridization gap by twisted stacking of quintuple layers in a three dimensional topological insulator thin film

Twisting the stacking of layered materials leads to rich new physics. A three dimensional (3D) topological insulator film host two dimensional gapless Dirac electrons on top and bottom surfaces, which, when the film is below some critical thickness, will hybridize and open a gap in the surface state structure. The hybridization gap can be tuned by various parameters such as film thickness, inversion symmetry, etc. according to the literature. The 3D strong topological insulator Bi(Sb)Se(Te) family have layered structures composed of quintuple layers (QL) stacked together by van der Waals interaction. Here we successfully grow twistedly-stacked Sb2Te3 QLs and investigate the effect of twist angels on the hybridization gaps below the thickness limit. We find that the hybridization gap can be tuned for films of three QLs, which might lead to quantum spin Hall states. Signatures of gap-closing are found in 3-QL films. The successful in-situ application of this approach opening a new route to search for exotic physics in topological insulators.

cond-mat.mes-hall↗

Visualizing the in-gap states in domain boundaries of ultra-thin topological insulator films

Ultra-thin topological insulators provide a platform of realizing many exotic phenomena such a Quantum spin Hall effect, Quantum anomalous Hall effect, etc. These effects or states are characterized by quantized transport behavior of edge states. Experimentally, although these states have been realized in various systems, the temperature for the edge states to be the dominating channel in transport is extremely low, contrary to the fact that the bulk gap is usually in the order of a few tens of milli-electron volts. There must be other in-gap conduction channels that won't freeze out till a much low temperature. Here we grow ultra-thin topological insulator Bi2Te3 and Sb2Te3 films by molecular beam epitaxy and investigate the structures of domain boundaries in these films. By scanning tunneling microscopy and spectroscopy we find that the domain boundaries with large rotation angles have pronounced in-gap bound states, through which one dimensional conduction channels are suggested to form as visualized by spatially resolved spectroscopy. Our work indicates the critical role played by domain boundaries in degrading the transport properties.

cond-mat.mes-hall↗

Neural Calibration for Scalable Beamforming in FDD Massive MIMO with Implicit Channel Estimation

Channel estimation and beamforming play critical roles in frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems. However, these two modules have been treated as two stand-alone components, which makes it difficult to achieve a global system optimality. In this paper, we propose a deep learning-based approach that directly optimizes the beamformers at the base station according to the received uplink pilots, thereby, bypassing the explicit channel estimation. Different from the existing fully data-driven approach where all the modules are replaced by deep neural networks (DNNs), a neural calibration method is proposed to improve the scalability of the end-to-end design. In particular, the backbone of conventional time-efficient algorithms, i.e., the least-squares (LS) channel estimator and the zero-forcing (ZF) beamformer, is preserved and DNNs are leveraged to calibrate their inputs for better performance. The permutation equivariance property of the formulated resource allocation problem is then identified to design a low-complexity neural network architecture. Simulation results will show the superiority of the proposed neural calibration method over benchmark schemes in terms of both the spectral efficiency and scalability in large-scale wireless networks.

eess.SP↗

Magnetic Flux and Magnetic Non-potentiality of Active Regions in Eruptive and Confined Solar Flares

With the aim of understanding how the magnetic properties of active regions (ARs) control the eruptive character of solar flares, we analyze 719 flares of Geostationary Operational Environmental Satellite (GOES) class $\geq$C5.0 during 2010$-$2019. We carry out the first statistical study that investigates the flare-coronal mass ejections (CMEs) association rate as function of the flare intensity and the AR characteristics that produces the flare, in terms of its total unsigned magnetic flux ($Φ$$_{AR}$). Our results show that the slope of the flare-CME association rate with flare intensity reveals a steep monotonic decrease with $Φ$$_{AR}$. This means that flares of the same GOES class but originating from an AR of larger $Φ$$_{AR}$, are much more likely confined. Based on an AR flux as high as 1.0$\times$$10^{24}$ Mx for solar-type stars, we estimate that the CME association rate in X100-class ``superflares" is no more than 50\%. For a sample of 132 flares $\geq$M2.0 class, we measure three non-potential parameters including the length of steep gradient polarity inversion line (L$_{SGPIL}$), the total photospheric free magnetic energy (E$_{free}$) and the area with large shear angle (A$_Ψ$). We find that confined flares tend to have larger values of L$_{SGPIL}$, E$_{free}$ and A$_Ψ$ compared to eruptive flares. Each non-potential parameter shows a moderate positive correlation with $Φ$$_{AR}$. Our results imply that $Φ$$_{AR}$ is a decisive quantity describing the eruptive character of a flare, as it provides a global parameter relating to the strength of the background field confinement.

astro-ph.SR↗

Primary-Auxiliary Model Scheduling Based Estimation of the Vertical Wheel Force in a Full Vehicle System

In this work, we study estimation problems in nonlinear mechanical systems subject to non-stationary and unknown excitation, which are common and critical problems in design and health management of mechanical systems. A primary-auxiliary model scheduling procedure based on time-domain transmissibilities is proposed and performed under switching linear dynamics: In addition to constructing a primary transmissibility family from the pseudo-inputs to the output during the offline stage, an auxiliary transmissibility family is constructed by further decomposing the pseudo-input vector into two parts. The auxiliary family enables to determine the unknown working condition at which the system is currently running at, and then an appropriate transmissibility from the primary transmissibility family for estimating the unknown output can be selected during the online estimation stage. As a result, the proposed approach offers a generalizable and explainable solution to the signal estimation problems in nonlinear mechanical systems in the context of switching linear dynamics with unknown inputs. A real-world application to the estimation of the vertical wheel force in a full vehicle system are, respectively, conducted to demonstrate the effectiveness of the proposed method. During the vehicle design phase, the vertical wheel force is the most important one among Wheel Center Loads (WCLs), and it is often measured directly with expensive, intrusive, and hard-to-install measurement devices during full vehicle testing campaigns. Meanwhile, the estimation problem of the vertical wheel force has not been solved well and is still of great interest. The experimental results show good performances of the proposed method in the sense of estimation accuracy for estimating the vertical wheel force.

eess.SY↗

Chekanov's dichotomy in contact topology

In this paper we study submanifolds of contact manifolds. The main submanifolds we are interested in are contact coisotropic submanifolds. Based on a correspondence between symplectic and contact coisotropic submanifolds, we can show contact coisotropic submanifolds admit a $C^0$-rigidity, similar to Humilière-Leclercq-Seyfaddini's coisotropic rigidity on symplectic manifolds. Moreover, based on Shelukhin's norm defined on the contactomorphism group, we define a Chekanov type pseudo-metric on the orbit space of a fixed submanifold of a contact manifold. Moreover, we can show a dichotomy of (non-)degeneracy of this pseudo-metric when the dimension of this fixed submanifold is equal to the one for a Legendrian submanifold. This can be viewed as a contact topology analogue to Chekanov's dichotomy of (non-)degeneracy of Chekanov-Hofer's metric on the orbit space of a Lagrangian submanifold.

math.SG↗

Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted Internet-of-Things (IoT) system in a sophisticated three-dimensional (3D) environment, where the UAV's trajectory is optimized to efficiently collect data from multiple IoT ground nodes. Unlike existing approaches focusing only on a simplified two-dimensional scenario and the availability of perfect channel state information (CSI), this paper considers a practical 3D urban environment with imperfect CSI, where the UAV's trajectory is designed to minimize data collection completion time subject to practical throughput and flight movement constraints. Specifically, inspired from the state-of-the-art deep reinforcement learning approaches, we leverage the twin-delayed deep deterministic policy gradient (TD3) to design the UAV's trajectory and present a TD3-based trajectory design for completion time minimization (TD3-TDCTM) algorithm. In particular, we set an additional information, i.e., the merged pheromone, to represent the state information of UAV and environment as a reference of reward which facilitates the algorithm design. By taking the service statuses of IoT nodes, the UAV's position, and the merged pheromone as input, the proposed algorithm can continuously and adaptively learn how to adjust the UAV's movement strategy. By interacting with the external environment in the corresponding Markov decision process, the proposed algorithm can achieve a near-optimal navigation strategy. Our simulation results show the superiority of the proposed TD3-TDCTM algorithm over three conventional non-learning based baseline methods.

cs.IT↗

Joint Activity Detection and Data Decoding in Massive Random Access via a Turbo Receiver

In this paper, we propose a turbo receiver for joint activity detection and data decoding in grant-free massive random access, which iterates between a detector and a belief propagation (BP)-based channel decoder. Specifically, responsible for user activity detection, channel estimation, and soft data symbol detection, the detector is developed based on a bilinear inference problem that exploits the common sparsity pattern in the received pilot and data signals. The bilinear generalized approximate message passing (BiG-AMP) algorithm is adopted to solve the problem using probabilities of the transmitted data symbols estimated by the channel decoder as prior knowledge. In addition, extrinsic information is derived from the detector to improve the channel decoding accuracy of the decoder. Simulation results show significant improvements achieved by the proposed turbo receiver compared with conventional designs.

eess.SP↗

IDRLnet: A Physics-Informed Neural Network Library

Physics Informed Neural Network (PINN) is a scientific computing framework used to solve both forward and inverse problems modeled by Partial Differential Equations (PDEs). This paper introduces IDRLnet, a Python toolbox for modeling and solving problems through PINN systematically. IDRLnet constructs the framework for a wide range of PINN algorithms and applications. It provides a structured way to incorporate geometric objects, data sources, artificial neural networks, loss metrics, and optimizers within Python. Furthermore, it provides functionality to solve noisy inverse problems, variational minimization, and integral differential equations. New PINN variants can be integrated into the framework easily. Source code, tutorials, and documentation are available at \url{https://github.com/idrl-lab/idrlnet}.

cs.LG↗

Massive Access in Media Modulation Based Massive Machine-Type Communications

The massive machine-type communications (mMTC) paradigm based on media modulation in conjunction with massive MIMO base stations (BSs) is emerging as a viable solution to support the massive connectivity for the future Internet-of-Things, in which the inherent massive access at the BSs poses significant challenges for device activity and data detection (DADD). This paper considers the DADD problem for both uncoded and coded media modulation based mMTC with a slotted access frame structure, where the device activity remains unchanged within one frame. Specifically, due to the slotted access frame structure and the adopted media modulated symbols, the access signals exhibit a doubly structured sparsity in both the time domain and the modulation domain. Inspired by this, a doubly structured approximate message passing (DS-AMP) algorithm is proposed for reliable DADD in the uncoded case. Also, we derive the state evolution of the DS-AMP algorithm to theoretically characterize its performance. As for the coded case, we develop a bit-interleaved coded media modulation scheme and propose an iterative DS-AMP (IDS-AMP) algorithm based on successive inference cancellation (SIC), where the signal components associated with the detected active devices are successively subtracted to improve the data decoding performance. In addition, the channel estimation problem for media modulation based mMTC is discussed and an efficient data-aided channel state information (CSI) update strategy is developed to reduce the training overhead in block fading channels. Finally, simulation results and computational complexity analysis verify the superiority of the proposed algorithms in both uncoded and coded cases. Also, our results verify the validity of the proposed data-aided CSI update strategy.

cs.IT↗

Does Concentration Drive the Scatter in the Stellar-to-Halo Mass Relation of Galaxy Clusters?

Concentration is one of the key dark matter halo properties that could drive the scatter in the stellar-to-halo mass relation of massive clusters. We derive robust photometric stellar masses for a sample of brightest central galaxies (BCGs) in SDSS redMaPPer clusters at $0.17<z<0.3$, and split the clusters into two equal-halo mass subsamples by their BCG stellar mass $M_*$. The weak lensing profiles $ΔΣ$ of the two cluster subsamples exhibit different slopes on scales below 1 M$pc/h$. To interpret such discrepancy, we perform a comprehensive Bayesian modelling of the two $ΔΣ$ profiles by including different levels of miscentring effects between the two subsamples as informed by X-ray observations. We find that the two subsamples have the same average halo mass of $1.74 \times 10^{14} M_{\odot}/h$, but the concentration of the low-$M_*$ clusters is $5.87_{-0.60}^{+0.77}$, ${\sim}1.5σ$ smaller than that of their high-$M_*$ counterparts~($6.95_{-0.66}^{+0.78}$). Furthermore, both cluster weak lensing and cluster-galaxy cross-correlations indicate that the large-scale bias of the low-$M_*$, low-concentration clusters are ${\sim}10\%$ higher than that of the high-$M_*$, high-concentration systems, hence possible evidence of the cluster assembly bias effect. Our results reveal a remarkable physical connection between the stellar mass within 20{-}30 k$pc/h$, the dark matter mass within ${\sim}$ 200 k$pc/h$, and the cosmic overdensity on scales above 10 M$pc/h$, enabling a key observational test of theories of co-evolution between massive clusters and their central galaxies.

astro-ph.CO↗

The Audio Auditor: User-Level Membership Inference in Internet of Things Voice Services

With the rapid development of deep learning techniques, the popularity of voice services implemented on various Internet of Things (IoT) devices is ever increasing. In this paper, we examine user-level membership inference in the problem space of voice services, by designing an audio auditor to verify whether a specific user had unwillingly contributed audio used to train an automatic speech recognition (ASR) model under strict black-box access. With user representation of the input audio data and their corresponding translated text, our trained auditor is effective in user-level audit. We also observe that the auditor trained on specific data can be generalized well regardless of the ASR model architecture. We validate the auditor on ASR models trained with LSTM, RNNs, and GRU algorithms on two state-of-the-art pipelines, the hybrid ASR system and the end-to-end ASR system. Finally, we conduct a real-world trial of our auditor on iPhone Siri, achieving an overall accuracy exceeding 80\%. We hope the methodology developed in this paper and findings can inform privacy advocates to overhaul IoT privacy.

cs.CR↗

An Edge Computing Paradigm for Massive IoT Connectivity over High-Altitude Platform Networks

With the advent of the Internet-of-Things (IoT) era, the ever-increasing number of devices and emerging applications have triggered the need for ubiquitous connectivity and more efficient computing paradigms. These stringent demands have posed significant challenges to the current wireless networks and their computing architectures. In this article, we propose a high-altitude platform (HAP) network-enabled edge computing paradigm to tackle the key issues of massive IoT connectivity. Specifically, we first provide a comprehensive overview of the recent advances in non-terrestrial network-based edge computing architectures. Then, the limitations of the existing solutions are further summarized from the perspectives of the network architecture, random access procedure, and multiple access techniques. To overcome the limitations, we propose a HAP-enabled aerial cell-free massive multiple-input multiple-output network to realize the edge computing paradigm, where multiple HAPs cooperate via the edge servers to serve IoT devices. For the case of a massive number of devices, we further adopt a grant-free massive access scheme to guarantee low-latency and high-efficiency massive IoT connectivity to the network. Besides, a case study is provided to demonstrate the effectiveness of the proposed solution. Finally, to shed light on the future research directions of HAP network-enabled edge computing paradigms, the key challenges and open issues are discussed.

cs.IT↗

Lévy Walks and Path Chaos in the Dispersal of Elongated Structures Moving across Cellular Vortical Flows

In cellular vortical flows, namely arrays of counter-rotating vortices, short but flexible filaments can show simple random walks through their stretch-coil interactions with flow stagnation points. Here, we study the dynamics of semi-rigid filaments long enough to broadly sample the vortical field. Using simulation, we find a surprising variety of long-time transport behavior -- random walks, ballistic transport, and trapping -- depending upon the filament's relative length and effective flexibility. Moreover, we find that filaments execute Lévy walks whose diffusion exponents generally decrease with increasing filament length, until transitioning to Brownian walks. Lyapunov exponents likewise increase with length. Even completely rigid filaments, whose dynamics is finite-dimensional, show a surprising variety of transport states and chaos. Fast filament dispersal is related to an underlying geometry of ``conveyor belts''. Evidence for these various transport states are found in experiments using arrays of counter-rotating rollers, immersed in a fluid and transporting a flexible ribbon.

cond-mat.soft↗

Square Peg in a Circular Hole: Choosing the Right Ansatz for Isolated Black Holes in Generic Gravitational Theories

The metric of a spacetime can be greatly simplified if the spacetime is circular. We prove that in generic effective theories of gravity, the spacetime of a stationary, axisymmetric and asymptotically flat solution must be circular if the solution can be obtained perturbatively from a solution in the general relativity limit. This result applies to a broad class of gravitational theories that include arbitrary scalars and vectors in their light sector, so long as their nonstandard kinetic terms and nonmininal couplings to gravity are treated perturbatively.

gr-qc↗

Feedback Pyramid Attention Networks for Single Image Super-Resolution

Recently, convolutional neural network (CNN) based image super-resolution (SR) methods have achieved significant performance improvement. However, most CNN-based methods mainly focus on feed-forward architecture design and neglect to explore the feedback mechanism, which usually exists in the human visual system. In this paper, we propose feedback pyramid attention networks (FPAN) to fully exploit the mutual dependencies of features. Specifically, a novel feedback connection structure is developed to enhance low-level feature expression with high-level information. In our method, the output of each layer in the first stage is also used as the input of the corresponding layer in the next state to re-update the previous low-level filters. Moreover, we introduce a pyramid non-local structure to model global contextual information in different scales and improve the discriminative representation of the network. Extensive experimental results on various datasets demonstrate the superiority of our FPAN in comparison with the state-of-the-art SR methods.

eess.IV↗