arXiv subjects

Jian Wang

Publications and source records attributed to Jian Wang.

At least 505 records · Page 28Linked to original sources

arXiv2024

LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection

In this paper, we present a light-weight detection transformer, LW-DETR, which outperforms YOLOs for real-time object detection. The architecture is a simple stack of a ViT encoder, a projector, and a shallow DETR decoder. Our approach leverages recent advanced techniques, such as training-effective techniques, e.g., improved loss and pretraining, and interleaved window and global attentions for reducing the ViT encoder complexity. We improve the ViT encoder by aggregating multi-level feature maps, and the intermediate and final feature maps in the ViT encoder, forming richer feature maps, and introduce window-major feature map organization for improving the efficiency of interleaved attention computation. Experimental results demonstrate that the proposed approach is superior over existing real-time detectors, e.g., YOLO and its variants, on COCO and other benchmark datasets. Code and models are available at (https://github.com/Atten4Vis/LW-DETR).

cs.CV↗

arXiv2024

High-Temperature Anomalous Metal States in Iron-Based Interface Superconductors

The nature of the anomalous metal state has been a major puzzle in condensed matter physics for more than three decades. Here, we report systematic investigation and modulation of the anomalous metal states in high-temperature interface superconductor FeSe films on SrTiO3 substrate. Remarkably, under zero magnetic field, the anomalous metal state persists up to 20 K in pristine FeSe films, an exceptionally high temperature standing out from previous observations. In stark contrast, for the FeSe films with nano-hole arrays, the characteristic temperature of the anomalous metal state is considerably reduced. We demonstrate that the observed anomalous metal states originate from the quantum tunneling of vortices adjusted by the Ohmic dissipation. Our work offers a perspective for understanding the origin and modulation of the anomalous metal states in two-dimensional bosonic systems.

cond-mat.supr-con↗

arXiv2024

Intersecting families with large shadow degree

A $k$-uniform family $\mathcal{F}$ is called intersecting if $F\cap F'\neq \emptyset$ for all $F,F'\in \mathcal{F}$. The shadow family $\partial \mathcal{F}$ is the family of $(k-1)$-element sets that are contained in some members of $\mathcal{F}$. The shadow degree (or minimum positive co-degree) of $\mathcal{F}$ is defined as the maximum integer $r$ such that every $E\in \partial \mathcal{F}$ is contained in at least $r$ members of $\mathcal{F}$. In 2021, Balogh, Lemons and Palmer determined the maximum size of an intersecting $k$-uniform family with shadow degree at least $r$ for $n\geq n_0(k,r)$, where $n_0(k,r)$ is doubly exponential in $k$ for $4\leq r\leq k$. In the present paper, we present a short proof of this result for $n\geq 2(r+1)^rk \frac{\binom{2k-1}{k}}{\binom{2r-1}{r}}$ and $4\leq r\leq k$.

math.CO↗

arXiv2024

Multi-state Chiral Switching Through Adiabaticity Control in Encircling Exceptional Points

Dynamic encircling of exceptional points has attracted significant interest in recent years, as it can facilitate chiral transmission selectivity due to a nontrivial eigenstate evolution. Recently, multi-state systems have been explored, associated with more complex topologies supporting a larger number of exceptional points, but chiral switching among multiple eigenstates has remained elusive in experiments. Here, we overcome this challenge by dividing the eigenstate space into multiple subspaces by controlling the adiabaticity. The eigenstates in different subspaces can evolve without crosstalk, and chiral switching occurs as the eigenstates within each subspace are subject to a non-adiabatic transition while they encircle exceptional points. We experimentally demonstrate this phenomenon by reporting chiral switching for two groups of optical modes at telecom wavelengths in a four-state optical system, and theoretically demonstrate that our approach can be extended to higher-order systems. Our findings pave new avenues for studying chiral dynamics based on exceptional-point physics in multi-state systems, and offer opportunities to develop multiplexed photonic devices.

physics.optics↗

arXiv2024

Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role disparities between two speakers and the multi-round interactive process that dialogues ought to be. Such a manner often leads to unsatisfactory chat consistency for the built agent. In this work, we emphasize the interactive, communicative nature of dialogue and argue that it is more feasible to model the speaker roles of agent and user separately, enabling the agent to adhere to its role consistently. With this in mind, we propose an efficient Multi-round Interactive Dialogue Tuning (Midi-Tuning) framework. It models the agent and user individually with two adapters built upon large language models. The adapters make use of respective utterances round by round in alternating order and they are tuned via a round-level memory caching mechanism. Extensive experiments demonstrate that, our framework performs superior to traditional fine-tuning and harbors the tremendous potential for improving dialogue consistency.

cs.CL↗

arXiv2024

MIPI 2024 Challenge on Nighttime Flare Removal: Methods and Results

The increasing demand for computational photography and imaging on mobile platforms has led to the widespread development and integration of advanced image sensors with novel algorithms in camera systems. However, the scarcity of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). Building on the achievements of the previous MIPI Workshops held at ECCV 2022 and CVPR 2023, we introduce our third MIPI challenge including three tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Nighttime Flare Removal track on MIPI 2024. In total, 170 participants were successfully registered, and 14 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Nighttime Flare Removal. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2024/.

cs.CV↗

arXiv2024

No Two Devils Alike: Unveiling Distinct Mechanisms of Fine-tuning Attacks

The existing safety alignment of Large Language Models (LLMs) is found fragile and could be easily attacked through different strategies, such as through fine-tuning on a few harmful examples or manipulating the prefix of the generation results. However, the attack mechanisms of these strategies are still underexplored. In this paper, we ask the following question: \textit{while these approaches can all significantly compromise safety, do their attack mechanisms exhibit strong similarities?} To answer this question, we break down the safeguarding process of an LLM when encountered with harmful instructions into three stages: (1) recognizing harmful instructions, (2) generating an initial refusing tone, and (3) completing the refusal response. Accordingly, we investigate whether and how different attack strategies could influence each stage of this safeguarding process. We utilize techniques such as logit lens and activation patching to identify model components that drive specific behavior, and we apply cross-model probing to examine representation shifts after an attack. In particular, we analyze the two most representative types of attack approaches: Explicit Harmful Attack (EHA) and Identity-Shifting Attack (ISA). Surprisingly, we find that their attack mechanisms diverge dramatically. Unlike ISA, EHA tends to aggressively target the harmful recognition stage. While both EHA and ISA disrupt the latter two stages, the extent and mechanisms of their attacks differ significantly. Our findings underscore the importance of understanding LLMs' internal safeguarding process and suggest that diverse defense mechanisms are required to effectively cope with various types of attacks.

cs.CL↗

arXiv2024

Generalized all-optical complex exponential operator

Euler's formula, an extraordinary mathematical formula, establishes a vital link between complex-valued operations and trigonometric functions, finding widespread application in various fields. With the end of Moore's Law, electronic computing methods are encountering developmental bottlenecks. With its enviable potential, optical computing has successfully achieved high-speed operation of designed complex numbers. However, the challenge of processing and manipulating arbitrary complex numbers persists. This study introduces a generalized complex exponential operator (GCEO), utilizing a diffractive optical neural network (DONN) for the computation of the complex exponential through Euler's formula. Experiments validate a series of complex exponential calculations using the GCEO. The GCEO has demonstrated generalizability and can compute inputs of any precision within an appropriate error margin. The proposed operator highlights the immense potential of DONN in optical computation and is poised to significantly contribute to the development of computational methods for optoelectronic integration.

physics.optics↗

arXiv2024

Equivariant Twisted Bismut Laplacian with Torsion and KKW type theorems

This paper aims to provide an explicit computation of the noncommutative residue density associated with equivariant twisted Bismut Laplacian with torsion on compact manifolds with (or without) boundary. We prove the equivariant twisted Kastler-Kalau-Walze type theorems with torsion on compact manifolds with boundary.

math.DG↗

arXiv2024

Spatial asymptotic behaviors of fractional stochastic heat equations driven by additive Lévy white noise

We establish explicit integral tests for spatial asymptotic behaviors of fractional stochastic heat equations driven by additive Lévy white noise. Our results indicate that fractional stochastic heat equations enjoy the so-called additive physical intermittent property in all dimensions when the driven Lévy white noise is sufficiently light-tailed. The proofs are based on heat kernel estimates for the fractional Laplacian and exact tail behaviors for Poissonian functionals associated with the driven Lévy white noise.

math.PR↗

arXiv2024

Quantifying the photocurrent fluctuation in quantum materials by shot noise

The DC photocurrent can detect the topology and geometry of quantum materials without inversion symmetry. Herein, we propose that the DC shot noise (DSN), as the fluctuation of photocurrent operator, can also be a diagnostic of quantum materials. Particularly, we develop the quantum theory for DSNs in gapped systems and identify the shift and injection DSNs by dividing the second-order photocurrent operator into off-diagonal and diagonal contributions, respectively. Remarkably, we find that the DSNs can not be forbidden by inversion symmetry, while the constraint from time-reversal symmetry depends on the polarization of light. Furthermore, we show that the DSNs also encode the geometrical information of Bloch electrons, such as the Berry curvature and the quantum metric. Finally, guided by symmetry, we apply our theory to evaluate the DSNs in monolayer GeS and bilayer MoS$_2$ with and without inversion symmetry and find that the DSNs can be larger in centrosymmetric phase.

cond-mat.mtrl-sci↗

arXiv2024

Gapless superconducting state and mirage gap in altermagnets

The interplay between spin-orbit interaction (SOI) and magnetism produces interesting phenomena in superconductors. When a two-dimensional (2D) system with strong SOI is coupled to an $s$-wave superconductor, an in-plane magnetic field can drive the system into a gapless superconducting state and induce a mirage gap at finite energies for an Ising superconductor. In this work, we demonstrate that when an $s$-wave superconductor is proximitized to an altermagnet, the intrinsic anisotropic spin splitting of the altermagnet can result in a gapless superconducting state and a pair of mirage gaps at finite energy. The gapless superconductivity exhibits spin-polarized segmented Fermi surfaces, with coexisting spin-singlet and spin-triplet pairings that have a $d$-wave character. Importantly, the gapless superconducting and mirage gap features are quantified through quantum transport. Our results suggest that altermagnet is an ideal platform for studying gapless superconducting states and mirage gap physics.

cond-mat.supr-con↗

arXiv2024

3D Human Pose Perception from Egocentric Stereo Videos

While head-mounted devices are becoming more compact, they provide egocentric views with significant self-occlusions of the device user. Hence, existing methods often fail to accurately estimate complex 3D poses from egocentric views. In this work, we propose a new transformer-based framework to improve egocentric stereo 3D human pose estimation, which leverages the scene information and temporal context of egocentric stereo videos. Specifically, we utilize 1) depth features from our 3D scene reconstruction module with uniformly sampled windows of egocentric stereo frames, and 2) human joint queries enhanced by temporal features of the video inputs. Our method is able to accurately estimate human poses even in challenging scenarios, such as crouching and sitting. Furthermore, we introduce two new benchmark datasets, i.e., UnrealEgo2 and UnrealEgo-RW (RealWorld). The proposed datasets offer a much larger number of egocentric stereo views with a wider variety of human motions than the existing datasets, allowing comprehensive evaluation of existing and upcoming methods. Our extensive experiments show that the proposed approach significantly outperforms previous methods. We will release UnrealEgo2, UnrealEgo-RW, and trained models on our project page.

cs.CV↗

arXiv2024

Charge-4e and charge-6e flux quantization and higher charge superconductivity in kagome superconductor ring devices

The flux quantization is a key indication of electron pairing in superconductors. For example, the well-known h/2e flux quantization is considered strong evidence for the existence of the charge-2e, two-electron Cooper pairs. Here we report evidence for multi-charge flux quantization in mesoscopic ring devices fabricated using the transition-metal kagome superconductor CsV3Sb5. We perform systematic magneto-transport measurements and observe unprecedented quantization of magnetic flux in units of h/4e and h/6e in magnetoresistance oscillations. Specifically, at low temperatures, magnetoresistance oscillations with period h/2e are detected, as expected from the flux quantization for charge-2e superconductivity. We find that the h/2e oscillations are suppressed and replaced by resistance oscillations with h/4e periodicity when temperature is increased. Increasing the temperature further suppresses the h/4e oscillations and robust resistance oscillations with h/6e periodicity emerge as evidence for charge-6e flux quantization. Our observations provide the first experimental evidence for the existence of multi-charge flux quanta and emergent quantum matter exhibiting higher-charge superconductivity in the strongly fluctuating region above the charge-2e Cooper pair condensate, revealing new insights into the intertwined and vestigial electronic order in kagome superconductors.

cond-mat.supr-con↗

arXiv2024

Enhancing DETRs Variants through Improved Content Query and Similar Query Aggregation

The design of the query is crucial for the performance of DETR and its variants. Each query consists of two components: a content part and a positional one. Traditionally, the content query is initialized with a zero or learnable embedding, lacking essential content information and resulting in sub-optimal performance. In this paper, we introduce a novel plug-and-play module, Self-Adaptive Content Query (SACQ), to address this limitation. The SACQ module utilizes features from the transformer encoder to generate content queries via self-attention pooling. This allows candidate queries to adapt to the input image, resulting in a more comprehensive content prior and better focus on target objects. However, this improved concentration poses a challenge for the training process that utilizes the Hungarian matching, which selects only a single candidate and suppresses other similar ones. To overcome this, we propose a query aggregation strategy to cooperate with SACQ. It merges similar predicted candidates from different queries, easing the optimization. Our extensive experiments on the COCO dataset demonstrate the effectiveness of our proposed approaches across six different DETR's variants with multiple configurations, achieving an average improvement of over 1.0 AP.

cs.CV↗

arXiv2024

Bound state in the continuum and polarization-insensitive electric mirror in low-contrast metasurface

High-contrast refractive indexes are pivotal in dielectric metasurfaces for inducing various exotic phenomena, such as the bound state in the continuum (BIC) and electric mirror (EM). However, the limitations of high-index materials are adverse to the practical applications, thus low-contrast metasurfaces with comparable performance are highly desired. Here we present a low-contrast dielectric metasurface comprising radially anisotropic cylinders, which are SiO2 cylinders doped with a small amount of WS2. The cylinder exhibits unidirectional forward superscattering originating from the overlapping of the electric and magnetic dipole resonances. When normal illumination by a near-infrared plane wave, the metasurface consisting of the superscattering constituents manifests a polarization-insensitive EM. Conversely, when subjected to an in-plane incoming wave, the metasurface generates a symmetry-protected BIC characterized by an ultrahigh Q factor and nearly negligible out-of-plane energy radiation. Our work highlights the doping approach as an efficient strategy for designing low-contrast functional metasurfaces and sheds new light on the potential applications in photonic integrated circuits and on-chip optical communication.

physics.optics↗

arXiv2024

Evolution of Magnetism in Magnetic Topological Semimetal NdSb$_x$Te$_{2-x+δ}$

Magnetic topological semimetals LnSbTe (Ln = Lanthanide) have attracted intensive attention because of the presence of interplay between magnetism, topological, and electron correlations depending on the choices of magnetic Ln elements. Recently, varying Sb-Te composition has been found to effectively control the electronic and magnetic states in LnSbxTe$_{2-x}$. With this motivation, we report the evolution of magnetic properties with Sb-Te substitution in NdSb$_x$Te$_{2-x+δ}$. Our work reveals the interesting non-monotonic change in magnetic ordering temperature with varying composition stoichiometry. In addition, reducing the Sb content x drives the reorientation of moments from in-plane (ab-plane) to out-of-plane (c-axis) direction that results in the distinct magnetic structures for two end compounds NdTe$_2$ ($x = 0$) and NdSbTe ($x = 1$). Furthermore, the moment orientation in NdSb$_x$Te$_{2-x+δ}$ is also found to be strongly tunable upon application of weak magnetic field, leading to rich magnetic phases depending on the composition stoichiometry, temperature, and magnetic field. Such strong tuning of magnetism in this material establishes it as a promising platform for investigating tunable topological states and correlated topological physics.

cond-mat.mtrl-sci↗

arXiv2024

Learning to Recover Spectral Reflectance from RGB Images

This paper tackles spectral reflectance recovery (SRR) from RGB images. Since capturing ground-truth spectral reflectance and camera spectral sensitivity are challenging and costly, most existing approaches are trained on synthetic images and utilize the same parameters for all unseen testing images, which are suboptimal especially when the trained models are tested on real images because they never exploit the internal information of the testing images. To address this issue, we adopt a self-supervised meta-auxiliary learning (MAXL) strategy that fine-tunes the well-trained network parameters with each testing image to combine external with internal information. To the best of our knowledge, this is the first work that successfully adapts the MAXL strategy to this problem. Instead of relying on naive end-to-end training, we also propose a novel architecture that integrates the physical relationship between the spectral reflectance and the corresponding RGB images into the network based on our mathematical analysis. Besides, since the spectral reflectance of a scene is independent to its illumination while the corresponding RGB images are not, we recover the spectral reflectance of a scene from its RGB images captured under multiple illuminations to further reduce the unknown. Qualitative and quantitative evaluations demonstrate the effectiveness of our proposed network and of the MAXL. Our code and data are available at https://github.com/Dong-Huo/SRR-MAXL.

cs.CV↗