Searcharxiv⌕ Search

arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 451 records · Page 25Linked to original sources
arXiv2023

TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style Transfer

Artistic style transfer aims to create new artistic images by rendering a given photograph with the target artistic style. Existing methods learn styles simply based on global statistics or local patches, lacking careful consideration of the drawing process in practice. Consequently, the stylization results either fail to capture abundant and diversified local style patterns, or contain undesired semantic information of the style image and deviate from the global style distribution. To address this issue, we imitate the drawing process of humans and propose a Two-Stage Statistics-Aware Transformation (TSSAT) module, which first builds the global style foundation by aligning the global statistics of content and style features and then further enriches local style details by swapping the local statistics (instead of local features) in a patch-wise manner, significantly improving the stylization effects. Moreover, to further enhance both content and style representations, we introduce two novel losses: an attention-based content loss and a patch-based style loss, where the former enables better content preservation by enforcing the semantic relation in the content image to be retained during stylization, and the latter focuses on increasing the local style similarity between the style and stylized images. Extensive qualitative and quantitative experiments verify the effectiveness of our method.

cs.CV↗
arXiv2023

Create Your World: Lifelong Text-to-Image Diffusion

Text-to-image generative models can produce diverse high-quality images of concepts with a text prompt, which have demonstrated excellent ability in image generation, image translation, etc. We in this work study the problem of synthesizing instantiations of a use's own concepts in a never-ending manner, i.e., create your world, where the new concepts from user are quickly learned with a few examples. To achieve this goal, we propose a Lifelong text-to-image Diffusion Model (L2DM), which intends to overcome knowledge "catastrophic forgetting" for the past encountered concepts, and semantic "catastrophic neglecting" for one or more concepts in the text prompt. In respect of knowledge "catastrophic forgetting", our L2DM framework devises a task-aware memory enhancement module and a elastic-concept distillation module, which could respectively safeguard the knowledge of both prior concepts and each past personalized concept. When generating images with a user text prompt, the solution to semantic "catastrophic neglecting" is that a concept attention artist module can alleviate the semantic neglecting from concept aspect, and an orthogonal attention module can reduce the semantic binding from attribute aspect. To the end, our model can generate more faithful image across a range of continual text prompts in terms of both qualitative and quantitative metrics, when comparing with the related state-of-the-art models. The code will be released at https://wenqiliang.github.io/.

cs.CV↗
arXiv2023

DMKD: Improving Feature-based Knowledge Distillation for Object Detection Via Dual Masking Augmentation

Recent mainstream masked distillation methods function by reconstructing selectively masked areas of a student network from the feature map of its teacher counterpart. In these methods, the masked regions need to be properly selected, such that reconstructed features encode sufficient discrimination and representation capability like the teacher feature. However, previous masked distillation methods only focus on spatial masking, making the resulting masked areas biased towards spatial importance without encoding informative channel clues. In this study, we devise a Dual Masked Knowledge Distillation (DMKD) framework which can capture both spatially important and channel-wise informative clues for comprehensive masked feature reconstruction. More specifically, we employ dual attention mechanism for guiding the respective masking branches, leading to reconstructed feature encoding dual significance. Furthermore, fusing the reconstructed features is achieved by self-adjustable weighting strategy for effective feature distillation. Our experiments on object detection task demonstrate that the student networks achieve performance gains of 4.1% and 4.3% with the help of our method when RetinaNet and Cascade Mask R-CNN are respectively used as the teacher networks, while outperforming the other state-of-the-art distillation methods.

cs.CV↗
arXiv2023

Learnable Differencing Center for Nighttime Depth Perception

Depth completion is the task of recovering dense depth maps from sparse ones, usually with the help of color images. Existing image-guided methods perform well on daytime depth perception self-driving benchmarks, but struggle in nighttime scenarios with poor visibility and complex illumination. To address these challenges, we propose a simple yet effective framework called LDCNet. Our key idea is to use Recurrent Inter-Convolution Differencing (RICD) and Illumination-Affinitive Intra-Convolution Differencing (IAICD) to enhance the nighttime color images and reduce the negative effects of the varying illumination, respectively. RICD explicitly estimates global illumination by differencing two convolutions with different kernels, treating the small-kernel-convolution feature as the center of the large-kernel-convolution feature in a new perspective. IAICD softly alleviates local relative light intensity by differencing a single convolution, where the center is dynamically aggregated based on neighboring pixels and the estimated illumination map in RICD. On both nighttime depth completion and depth estimation tasks, extensive experiments demonstrate the effectiveness of our LDCNet, reaching the state of the art.

cs.CV↗
arXiv2023

Magic momenta and three dimensional Landau levels from a three dimensional graphite moiré superlattice

Twisted bilayer graphene (TBG) and other quasi-two-dimensional moiré superlattices have attracted significant attention due to the emergence of various correlated and topological states associated with the flat bands in these systems. In this work, we theoretically explore the physical properties of a new type of \textit{three dimensional graphite moiré superlattice}, the bulk alternating twisted graphite (ATG) system with homogeneous twist angle, which is grown by in situ chemical vapor decomposition method. Compared to TBG, the bulk ATG system is bestowed with an additional wavevector degrees of freedom due to the extra dimensionality. As a result, we find that when the twist angle of bulk ATG is smaller than twice of the magic angle of TBG, there always exist ``magic momenta" at which the in-plane Fermi velocities of the moiré bands vanish. Moreover, topologically distinct flat bands of TBG at different magic angles can even co-exist at different out-of-plane wavevectors in a single bulk ATG system. Most saliently, when the twist angle is relatively large, exactly dispersionless three dimensional zeroth Landau level would emerge in the bulk ATG, which may give rise to robust three dimensional quantum Hall effects over a large range of twist angles.

cond-mat.mes-hall↗
arXiv2023

A multinode quantum network over a metropolitan area

Towards realizing the future quantum internet, a pivotal milestone entails the transition from two-node proof-of-principle experiments conducted in laboratories to comprehensive, multi-node setups on large scales. Here, we report on the debut implementation of a multi-node entanglement-based quantum network over a metropolitan area. We equipped three quantum nodes with atomic quantum memories and their telecom interfaces, and combined them into a scalable phase-stabilized architecture through a server node. We demonstrated heralded entanglement generation between two quantum nodes situated 12.5 km apart, and the storage of entanglement exceeding the round-trip communication time. We also showed the concurrent entanglement generation on three links. Our work provides a metropolitan-scale testbed for the evaluation and exploration of multi-node quantum network protocols and starts a new stage of quantum internet research.

quant-ph↗
arXiv2023

On the Performance of RIS-Aided Spatial Scattering Modulation for mmWave Transmission

In this paper, we investigate a state-of-the-art reconfigurable intelligent surface (RIS)-assisted spatial scattering modulation (SSM) scheme for millimeter-wave (mmWave) systems, where a more practical scenario that the RIS is near the transmitter while the receiver is far from RIS is considered. To this end, the line-of-sight (LoS) and non-LoS links are utilized in the transmitter-RIS and RIS-receiver channels, respectively. By employing the maximum likelihood detector at the receiver, the conditional pairwise error probability (CPEP) expression for the RIS-SSM scheme is derived under the two scenarios that the received beam demodulation is correct or not. Furthermore, the union upper bound of average bit error probability (ABEP) is obtained based on the CPEP expression. Finally, the derivation results are exhaustively validated by the Monte Carlo simulations.

cs.IT↗
arXiv2023

Fragment and Integrate Network (FIN): A Novel Spatial-Temporal Modeling Based on Long Sequential Behavior for Online Food Ordering Click-Through Rate Prediction

Spatial-temporal information has been proven to be of great significance for click-through rate prediction tasks in online Location-Based Services (LBS), especially in mainstream food ordering platforms such as DoorDash, Uber Eats, Meituan, and Ele.me. Modeling user spatial-temporal preferences with sequential behavior data has become a hot topic in recommendation systems and online advertising. However, most of existing methods either lack the representation of rich spatial-temporal information or only handle user behaviors with limited length, e.g. 100. In this paper, we tackle these problems by designing a new spatial-temporal modeling paradigm named Fragment and Integrate Network (FIN). FIN consists of two networks: (i) Fragment Network (FN) extracts Multiple Sub-Sequences (MSS) from lifelong sequential behavior data, and captures the specific spatial-temporal representation by modeling each MSS respectively. Here both a simplified attention and a complicated attention are adopted to balance the performance gain and resource consumption. (ii) Integrate Network (IN) builds a new integrated sequence by utilizing spatial-temporal interaction on MSS and captures the comprehensive spatial-temporal representation by modeling the integrated sequence with a complicated attention. Both public datasets and production datasets have demonstrated the accuracy and scalability of FIN. Since 2022, FIN has been fully deployed in the recommendation advertising system of Ele.me, one of the most popular online food ordering platforms in China, obtaining 5.7% improvement on Click-Through Rate (CTR) and 7.3% increase on Revenue Per Mille (RPM).

cs.IR↗
arXiv2023

Electron heat flux and propagating fronts in plasma thermal quench via ambipolar transport

The thermal collapse of a nearly collisionless plasma interacting with a cooling spot, in which the electron parallel heat flux plays an essential role, is investigated both theoretically and numerically. We show that such thermal collapse, which is known as thermal quench in tokamaks, comes about in the form of propagating fronts, originating from the cooling spot, along the magnetic field lines. The slow fronts, propagating with local ion sound speed, limit the aggressive cooling of plasma, which is accompanied by a plasma cooling flow toward the cooling spot. The extraordinary physics underlying such a cooling flow is that the fundamental constraint of ambipolar transport along the field line limits the spatial gradient of electron thermal conduction flux to the much weaker convective scaling, as opposed to the free-streaming scaling, so that a large electron temperature and hence pressure gradient can be sustained. The last ion front for a radiative cooling spot is a shock front where cold but flowing ions meet the hot ions.

physics.plasm-ph↗
arXiv2023

A One-dimensional HEVC video steganalysis method using the Optimality of Predicted Motion Vectors

Among steganalysis techniques, detection against motion vector (MV) domain-based video steganography in High Efficiency Video Coding (HEVC) standard remains a hot and challenging issue. For the purpose of improving the detection performance, this paper proposes a steganalysis feature based on the optimality of predicted MVs with a dimension of one. Firstly, we point out that the motion vector prediction (MVP) of the prediction unit (PU) encoded using the Advanced Motion Vector Prediction (AMVP) technique satisfies the local optimality in the cover video. Secondly, we analyze that in HEVC video, message embedding either using MVP index or motion vector differences (MVD) may destroy the above optimality of MVP. And then, we define the optimal rate of MVP in HEVC video as a steganalysis feature. Finally, we conduct steganalysis detection experiments on two general datasets for three popular steganography methods and compare the performance with four state-of-the-art steganalysis methods. The experimental results show that the proposed optimal rate of MVP for all cover videos is 100\%, while the optimal rate of MVP for all stego videos is less than 100\%. Therefore, the proposed steganography scheme can accurately distinguish between cover videos and stego videos, and it is efficiently applied to practical scenarios with no model training and low computational complexity.

cs.CR↗
arXiv2023

O2CTA: Introducing Annotations from OCT to CCTA in Coronary Plaque Analysis

Targeted diagnosis and treatment plans for patients with coronary artery disease vary according to atherosclerotic plaque component. Coronary CT angiography (CCTA) is widely used for artery imaging and determining the stenosis degree. However, the limited spatial resolution and susceptibility to artifacts fail CCTA in obtaining lumen morphological characteristics and plaque composition. It can be settled by invasive optical coherence tomography (OCT) without much trouble for physicians, but bringing higher costs and potential risks to patients. Therefore, it is clinically critical to introduce annotations of plaque tissue and lumen characteristics from OCT to paired CCTA scans, denoted as \textbf{the O2CTA problem} in this paper. We propose a method to handle the O2CTA problem. CCTA scans are first reconstructed into multi-planar reformatted (MPR) images, which agree with OCT images in term of semantic contents. The artery segment in OCT, which is manually labelled, is then spatially aligned with the entire artery in MPR images via the proposed alignment strategy. Finally, a classification model involving a 3D CNN and a Transformer, is learned to extract local features and capture dependence along arteries. Experiments on 55 paired OCT and CCTA we curate demonstrate that it is feasible to classify the CCTA based on the OCT labels, with an accuracy of 86.2%, while the manual readings of OCT and CCTA vary significantly, with a Kappa coefficient of 0.113. We will make our source codes, models, data, and results publicly available to benefit the research community.

eess.IV↗
arXiv2023

Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning

Motivated by the advancing computational capacity of distributed end-user equipments (UEs), as well as the increasing concerns about sharing private data, there has been considerable recent interest in machine learning (ML) and artificial intelligence (AI) that can be processed on on distributed UEs. Specifically, in this paradigm, parts of an ML process are outsourced to multiple distributed UEs, and then the processed ML information is aggregated on a certain level at a central server, which turns a centralized ML process into a distributed one, and brings about significant benefits. However, this new distributed ML paradigm raises new risks of privacy and security issues. In this paper, we provide a survey of the emerging security and privacy risks of distributed ML from a unique perspective of information exchange levels, which are defined according to the key steps of an ML process, i.e.: i) the level of preprocessed data, ii) the level of learning models, iii) the level of extracted knowledge and, iv) the level of intermediate results. We explore and analyze the potential of threats for each information exchange level based on an overview of the current state-of-the-art attack mechanisms, and then discuss the possible defense methods against such threats. Finally, we complete the survey by providing an outlook on the challenges and possible directions for future research in this critical area.

cs.DC↗
arXiv2023

Dynamic Dual-Graph Fusion Convolutional Network For Alzheimer's Disease Diagnosis

In this paper, a dynamic dual-graph fusion convolutional network is proposed to improve Alzheimer's disease (AD) diagnosis performance. The following are the paper's main contributions: (a) propose a novel dynamic GCN architecture, which is an end-to-end pipeline for diagnosis of the AD task; (b) the proposed architecture can dynamically adjust the graph structure for GCN to produce better diagnosis outcomes by learning the optimal underlying latent graph; (c) incorporate feature graph learning and dynamic graph learning, giving those useful features of subjects more weight while decreasing the weights of other noise features. Experiments indicate that our model provides flexibility and stability while achieving excellent classification results in AD diagnosis.

eess.IV↗
arXiv2023

Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity

With the rapid proliferation of smart mobile devices, federated learning (FL) has been widely considered for application in wireless networks for distributed model training. However, data heterogeneity, e.g., non-independently identically distributions and different sizes of training data among clients, poses major challenges to wireless FL. Limited communication resources complicate the implementation of fair scheduling which is required for training on heterogeneous data, and further deteriorate the overall performance. To address this issue, this paper focuses on performance analysis and optimization for wireless FL, considering data heterogeneity, combined with wireless resource allocation. Specifically, we first develop a closed-form expression for an upper bound on the FL loss function, with a particular emphasis on data heterogeneity described by a dataset size vector and a data divergence vector. Then we formulate the loss function minimization problem, under constraints on long-term energy consumption and latency, and jointly optimize client scheduling, resource allocation, and the number of local training epochs (CRE). Next, via the Lyapunov drift technique, we transform the CRE optimization problem into a series of tractable problems. Extensive experiments on real-world datasets demonstrate that the proposed algorithm outperforms other benchmarks in terms of the learning accuracy and energy consumption.

cs.LG↗
arXiv2023

In Search of Infall Motion in Molecular Clumps. IV. Mapping of the Global Infall Sources

We have used the IRAM 30-m telescope to map some targets with HCO$^+$ (1-0) and H$^{13}$CO$^+$ (1-0) lines in order to search for gas infall evidence in the clumps. In this paper, we report the mapping results for 13 targets. All of these targets show HCO$^+$ emissions, while H$^{13}$CO$^+$ emissions are observed in ten of them. The HCO$^+$ integrated intensity maps of ten targets show clear clumpy structures, and nine targets show clumpy structures in the H$^{13}$CO$^+$ maps. Using the RADEX radiative transfer code, we estimate the column density of H$^{13}$CO$^+$, and determine the abundance ratio [H$^{13}$CO$^+$]/[H$_2$] to be approximately 10$^{-12}$ to 10$^{-10}$. Based on the asymmetry of the HCO$^+$ line profiles, we identify 11 targets show blue profiles, while six clumps have global infall evidence. We use the RATRAN and two-layer models to fit the HCO$^+$ line profiles of these infall sources, and analyze their spatial distribution of the infall velocity. The average infall velocities estimated by these two models are 0.24 -- 1.85 km s$^{-1}$ and 0.28 -- 1.45 km s$^{-1}$, respectively. The mass infall rate ranges from approximately 10$^{-5}$ to 10$^{-2}$ M$_{\odot}$ yr$^{-1}$, which suggests that intermediate- or high-mass stars may be forming in the target regions.

astro-ph.GA↗
arXiv2023

The Infrared Extinction Law in the Ophiuchus Molecular Cloud based on UKIDSS and Spitzer

Investigating the extinction properties in dense molecular clouds is of significant importance for understanding the behavior of interstellar dust and its impact on observations. In this study, we comprehensively examined the extinction law in the Ophiuchus cloud across a wavelength range from 0.8$\,μ\rm m$ to 8$\,μ\rm m$. To achieve this, we analyzed NIR and MIR data obtained from the UKIDSS GCS and the Spitzer c2d survey, respectively. By fitting a series of color-color diagrams, we determined color-excess ratios $E_{J-λ}/E_{J-K}$ for seven passbands. These ratios were then directly converted to derive the relative extinction law $A_λ/A_K$. Our findings demonstrate that the Ophiuchus cloud exhibits a characteristic of flat MIR extinction, consistent with previous studies. Additionally, our results reveal variations in the extinction law with extinction depth, indicating a flatter trend from the NIR to MIR bands as extinction increases. Notably, our analysis reveals no significant difference in the MIR extinction law among the four dark clouds: L1712, L1689, L1709, and L1688. However, distinct variations were observed in the extinction law for regions outside the dark clouds, specifically L1688N and L1688W. These regions displayed lower color-excess ratios $E_{J-λ}/E_{J-K}$ in the Spitzer/IRAC bands. This observation lends support to the dust growth occurring in the dense regions of the Ophiuchus cloud.

astro-ph.GA↗
arXiv2023

Aspect based sentimental analysis for travellers' reviews

Airport service quality evaluation is commonly found on social media, including Google Maps. This valuable for airport management in order to enhance the quality of services provided. However; prior studies either provide general review for topics discussed by travellers or provide sentimental value to tag the entire review without specifically mentioning the airport service that is behind such value. Accordingly, this work proposes using aspect based sentimental analysis in order to provide more detailed analysis for travellers reviews. This works applied aspect based sentimental analysis on data collected from Google Map about Dubai and Doha airports. The results provide tangible reasons to use aspect based sentimental analysis in order to understand more the travellers and spot airport services that are in need for improvement.

cs.CL↗
arXiv2023

Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for TDD MultiUser MIMO Systems

In this letter, we investigate the discrete phase shift design of the intelligent reflecting surface (IRS) in a time division duplexing (TDD) multi-user multiple input multiple output (MIMO) system.We modify the design of deep reinforcement learning (DRL) scheme so that we can maximizing the average downlink data transmission rate free from the sub-channel channel state information (CSI). Based on the characteristics of the model, we modify the proximal policy optimization (PPO) algorithm and integrate gated recurrent unit (GRU) to tackle the non-convex optimization problem. Simulation results show that the performance of the proposed PPO-GRU surpasses the benchmarks in terms of performance, convergence speed, and training stability.

cs.IT↗