arXiv subjects

Zhiwei Wang

Publications and source records attributed to Zhiwei Wang.

At least 109 records · Page 6Linked to original sources

arXiv2025

Field induced density wave in a kagome superconductor

On the kagome lattice, electrons benefit from the simultaneous presence of band topology, flat electronic bands, and van Hove singularities, forming competing or cooperating orders. Understanding the interrelation between these distinct order parameters remains a significant challenge, leaving much of the associated physics unexplored. In the kagome superconductor KV3Sb5, which exhibits a charge density wave (CDW) state below T = 78 K, we uncover an unpredicted field-induced phase transition below 6 K. The observed transition is marked by a hysteretic anomaly in the resistivity, nonlinear electrical transport, and a change in the symmetry of the electronic response as probed via the angular dependence of the magnetoresistivity. These observations surprisingly suggest the emergence of an unanticipated broken symmetry state coexisting with the original CDW. To understand this experimental observation, we developed a theoretical minimal model for the normal state inside the high-temperature parent CDW phase where an incommensurate CDW order emerges as an instability sub-leading to superconductivity. The incommensurate CDW emerges when superconducting fluctuations become fully suppressed by large magnetic fields. Our results suggest that, in kagome superconductors, quantum states can either coexist or are nearly degenerate in energy, indicating that these are rich platforms to expose new correlated phenomena.

cond-mat.str-el↗

arXiv2025

Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers

Transformers have demonstrated impressive capabilities across various tasks, yet their performance on compositional problems remains a subject of debate. In this study, we investigate the internal mechanisms underlying Transformers' behavior in compositional tasks. We find that complexity control strategies significantly influence whether the model learns primitive-level rules that generalize out-of-distribution (reasoning-based solutions) or relies solely on memorized mappings (memory-based solutions). By applying masking strategies to the model's information circuits and employing multiple complexity metrics, we reveal distinct internal working mechanisms associated with different solution types. Further analysis reveals that reasoning-based solutions exhibit a lower complexity bias, which aligns with the well-studied neuron condensation phenomenon. This lower complexity bias is hypothesized to be the key factor enabling these solutions to learn reasoning rules. We validate these conclusions across multiple real-world datasets, including image generation and natural language processing tasks, confirming the broad applicability of our findings.

cs.CL↗

arXiv2025

Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing

Transformers have shown impressive capabilities across various tasks, but their performance on compositional problems remains a topic of debate. In this work, we investigate the mechanisms of how transformers behave on unseen compositional tasks. We discover that the parameter initialization scale plays a critical role in determining whether the model learns inferential (reasoning-based) solutions, which capture the underlying compositional primitives, or symmetric (memory-based) solutions, which simply memorize mappings without understanding the compositional structure. By analyzing the information flow and vector representations within the model, we reveal the distinct mechanisms underlying these solution types. We further find that inferential (reasoning-based) solutions exhibit low complexity bias, which we hypothesize is a key factor enabling them to learn individual mappings for single anchors. We validate our conclusions on various real-world datasets. Our findings provide valuable insights into the role of initialization scale in tuning the reasoning and memorizing ability and we propose the initialization rate $γ$ to be a convenient tunable hyper-parameter in common deep learning frameworks, where $1/d_{\mathrm{in}}^γ$ is the standard deviation of parameters of the layer with $d_{\mathrm{in}}$ input neurons.

cs.LG↗

arXiv2024

First-frame Supervised Video Polyp Segmentation via Propagative and Semantic Dual-teacher Network

Automatic video polyp segmentation plays a critical role in gastrointestinal cancer screening, but the cost of frameby-frame annotations is prohibitively high. While sparse-frame supervised methods have reduced this burden proportionately, the cost remains overwhelming for long-duration videos and large-scale datasets. In this paper, we, for the first time, reduce the annotation cost to just a single frame per polyp video, regardless of the video's length. To this end, we introduce a new task, First-Frame Supervised Video Polyp Segmentation (FSVPS), and propose a novel Propagative and Semantic Dual-Teacher Network (PSDNet). Specifically, PSDNet adopts a teacher-student framework but employs two distinct types of teachers: the propagative teacher and the semantic teacher. The propagative teacher is a universal object tracker that propagates the first-frame annotation to subsequent frames as pseudo labels. However, tracking errors may accumulate over time, gradually degrading the pseudo labels and misguiding the student model. To address this, we introduce the semantic teacher, an exponential moving average of the student model, which produces more stable and time-invariant pseudo labels. PSDNet merges the pseudo labels from both teachers using a carefully-designed back-propagation strategy. This strategy assesses the quality of the pseudo labels by tracking them backward to the first frame. High-quality pseudo labels are more likely to spatially align with the firstframe annotation after this backward tracking, ensuring more accurate teacher-to-student knowledge transfer and improved segmentation performance. Benchmarking on SUN-SEG, the largest VPS dataset, demonstrates the competitive performance of PSDNet compared to fully-supervised approaches, and its superiority over sparse-frame supervised state-of-the-arts with a minimum improvement of 4.5% in Dice score.

cs.CV↗

arXiv2024

MonoPCC: Photometric-invariant Cycle Constraint for Monocular Depth Estimation of Endoscopic Images

Photometric constraint is indispensable for self-supervised monocular depth estimation. It involves warping a source image onto a target view using estimated depth&pose, and then minimizing the difference between the warped and target images. However, the endoscopic built-in light causes significant brightness fluctuations, and thus makes the photometric constraint unreliable. Previous efforts only mitigate this relying on extra models to calibrate image brightness. In this paper, we propose MonoPCC to address the brightness inconsistency radically by reshaping the photometric constraint into a cycle form. Instead of only warping the source image, MonoPCC constructs a closed loop consisting of two opposite forward-backward warping paths: from target to source and then back to target. Thus, the target image finally receives an image cycle-warped from itself, which naturally makes the constraint invariant to brightness changes. Moreover, MonoPCC transplants the source image's phase-frequency into the intermediate warped image to avoid structure lost, and also stabilizes the training via an exponential moving average (EMA) strategy to avoid frequent changes in the forward warping. The comprehensive and extensive experimental results on four endoscopic datasets demonstrate that our proposed MonoPCC shows a great robustness to the brightness inconsistency, and exceeds other state-of-the-arts by reducing the absolute relative error by at least 7.27%, 9.38%, 9.90% and 3.17%, respectively.

cs.CV↗

arXiv2024

Weak convergence of complex Monge-Ampère operators on compact Hermitian manifolds

Let $(X,ω)$ be a compact Hermitian manifold and let $\{β\}\in H^{1,1}(X,\mathbb R)$ be a real $(1,1)$-class with a smooth representative $β$, such that $\int_Xβ^n>0$. Assume that there is a bounded $β$-plurisubharmonic function $ρ$ on $X$. First, we provide a criterion for the weak convergence of non-pluripolar complex Monge-Ampère measures associated to a sequence of $β$-plurisubharmonic functions. Second, this criterion is utilized to solve a degenerate complex Monge-Ampère equation with an $L^1$-density. Finally, an $L^\infty$-estimate of the solution to the complex Monge-Ampère equation for a finite positive Radon measure is given.

math.CV↗

arXiv2024

Fermiology with nodal structures in nonsymmorphic superconductor LaNiGa$_2$: A de Haas-van Alphen study

Topological metals possess various types of symmetry-protected degenerate band crossings. When a topological metal becomes superconducting, the low-energy electronic excitations stemming from the band crossings located close to the Fermi level may contribute to highly unusual pairing symmetry and superconducting states. In this work, we study the electronic band structure of the time-reversal symmetry breaking superconductor LaNiGa$_2$ by means of quantum oscillation measurements. A comprehensive investigation combining angle-resolved high-field de Haas-van Alphen (dHvA) spectroscopy and first-principles calculations reveals the fermiology of LaNiGa$_2$ and verifies its nonsymmorphic $Cmcm$ lattice symmetry, which promises nodal band crossings pinned at the Fermi level with fourfold degeneracies. Moreover, such nodal structures, proposed to play a crucial role giving rise to the interorbital triplet pairing, are indeed captured by our dHvA analysis. Our results identify LaNiGa$_2$ as a prototypical topological crystalline superconductor and highlight the putative contribution of low-energy nodal quasiparticles to unconventional superconducting pairing.

cond-mat.supr-con↗

arXiv2024

MonoBox: Tightness-free Box-supervised Polyp Segmentation using Monotonicity Constraint

We propose MonoBox, an innovative box-supervised segmentation method constrained by monotonicity to liberate its training from the user-unfriendly box-tightness assumption. In contrast to conventional box-supervised segmentation, where the box edges must precisely touch the target boundaries, MonoBox leverages imprecisely-annotated boxes to achieve robust pixel-wise segmentation. The 'linchpin' is that, within the noisy zones around box edges, MonoBox discards the traditional misguiding multiple-instance learning loss, and instead optimizes a carefully-designed objective, termed monotonicity constraint. Along directions transitioning from the foreground to background, this new constraint steers responses to adhere to a trend of monotonically decreasing values. Consequently, the originally unreliable learning within the noisy zones is transformed into a correct and effective monotonicity optimization. Moreover, an adaptive label correction is introduced, enabling MonoBox to enhance the tightness of box annotations using predicted masks from the previous epoch and dynamically shrink the noisy zones as training progresses. We verify MonoBox in the box-supervised segmentation task of polyps, where satisfying box-tightness is challenging due to the vague boundaries between the polyp and normal tissues. Experiments on both public synthetic and in-house real noisy datasets demonstrate that MonoBox exceeds other anti-noise state-of-the-arts by improving Dice by at least 5.5% and 3.3%, respectively. Codes are at https://github.com/Huster-Hq/MonoBox.

cs.CV↗

arXiv2024

Superconductivity at Pd/Bi$_2$Se$_3$ Interfaces Due to Self-Formed PdBiSe Interlayers

Understanding the physical and chemical processes at the interface of metals and topological insulators is crucial for developing the next generation of topological quantum devices. Here we report the discovery of robust superconductivity in Pd/Bi$_2$Se$_3$ bilayers fabricated by sputtering Pd on the surface of Bi$_2$Se$_3$. Through transmission electron microscopy measurements, we identify that the observed interfacial superconductivity originates from the diffusion of Pd into Bi$_2$Se$_3$. In the diffusion region, Pd chemically reacts with Bi$_2$Se$_3$ and forms a layer of PdBiSe, a known su-perconductor with a bulk transition temperature of 1.5 K. Our work provides a method for in-troducing superconductivity into Bi$_2$Se$_3$, laying the foundation for developing sophisticated Bi$_2$Se$_3$-based topological devices.

cond-mat.supr-con↗

arXiv2024

Unconventional gapping behavior in a kagome superconductor

Determining the types of superconducting order in quantum materials is a challenge, especially when multiple degrees of freedom, such as bands or orbitals, contribute to the fermiology and when superconductivity competes, intertwines, or coexists with other symmetry-breaking orders. Here, we study the Kagome-lattice superconductor CsV3Sb5, in which multiband superconductivity coexists with a charge order that substantially reduces the compound's space group symmetries. Through a combination of thermodynamic as well as electrical and thermal transport measurements, we uncover two superconducting regimes with distinct transport and thermodynamic characteristics, while finding no evidence for a phase transition separating them. Thermodynamic measurements reveal substantial quasiparticle weight in a high-temperature regime. At lower temperatures, this weight is removed via the formation of a second gap. The two regimes are sharply distinguished by a pronounced enhancement of the upper critical field at low temperatures and by a switch in the anisotropy of the longitudinal thermal conductivity as a function of in-plane magnetic field orientation. We argue that the band with a gap opening at lower temperatures continues to host low-energy quasiparticles, possibly due to a nodal structure of the gap. Taken together, our results present evidence for band-selective superconductivity with remarkable decoupling of the (two) superconducting gaps. The commonly employed multiband scenario, whereby superconductivity emerges in a primary band and is then induced in other bands appears to fail in this unconventional kagome superconductor. Instead, band-selective superconducting pairing is a paradigm that seems to unify seemingly contradicting results in this intensely studied family of materials and beyond.

cond-mat.str-el↗

arXiv2024

Shear-resistant topology in quasi one-dimensional van der Waals material Bi$_4$Br$_4$

Bi$_4$Br$_4$ is a prototypical quasi one-dimensional (1D) material in which covalently bonded bismuth bromide chains are arranged in parallel, side-by-side and layer-by-layer, with van der Waals (vdW) gaps in between. So far, two different structures have been reported for this compound, $α$-Bi$_4$Br$_4$ and $β$-Bi$_4$Br$_4$ , in both of which neighboring chains are shifted by $\mathbf{b}/2$, i.e., half a unit cell vector in the plane, but which differ in their vertical stacking. While the different layer arrangements are known to result in distinct electronic properties, the effect of possible in-plane shifts between the atomic chains remains an open question. Here, using scanning tunneling microscopy and spectroscopy (STM/STS), we report a new Bi$_4$Br$_4$(001) structure, with a shift of $\mathbf{b}/3$ between neighboring chains in the plane and AB layer stacking. We determine shear strain to be the origin of this new structure, which can readily result in shifts of neighboring atomic chains because of the weak inter-chain bonding. For the observed $b/3$ structure, the (residual) atomic chain shift corresponds to an in-plane shear strain of $γ\approx7.5\%$. STS reveals a bulk insulating gap and metallic edge states at surface steps, indicating that the new structure is also a higher-order topological insulator, just like $α$-Bi$_4$Br$_4$, in agreement with density functional theory (DFT) calculations.

cond-mat.mes-hall↗

arXiv2024

Robust Thompson Sampling Algorithms Against Reward Poisoning Attacks

Thompson sampling is one of the most popular learning algorithms for online sequential decision-making problems and has rich real-world applications. However, current Thompson sampling algorithms are limited by the assumption that the rewards received are uncorrupted, which may not be true in real-world applications where adversarial reward poisoning exists. To make Thompson sampling more reliable, we want to make it robust against adversarial reward poisoning. The main challenge is that one can no longer compute the actual posteriors for the true reward, as the agent can only observe the rewards after corruption. In this work, we solve this problem by computing pseudo-posteriors that are less likely to be manipulated by the attack. We propose robust algorithms based on Thompson sampling for the popular stochastic and contextual linear bandit settings in both cases where the agent is aware or unaware of the budget of the attacker. We theoretically show that our algorithms guarantee near-optimal regret under any attack strategy.

cs.LG↗

arXiv2024

Chameleon: An Efficient FHE Scheme Switching Acceleration on GPUs

Fully homomorphic encryption (FHE) enables direct computation on encrypted data, making it a crucial technology for privacy protection. However, FHE suffers from significant performance bottlenecks. In this context, GPU acceleration offers a promising solution to bridge the performance gap. Existing efforts primarily focus on single-class FHE schemes, which fail to meet the diverse requirements of data types and functions, prompting the development of hybrid multi-class FHE schemes. However, studies have yet to thoroughly investigate specific GPU optimizations for hybrid FHE schemes. In this paper, we present an efficient GPU-based FHE scheme switching acceleration named Chameleon. First, we propose a scalable NTT acceleration design that adapts to larger CKKS polynomials and smaller TFHE polynomials. Specifically, Chameleon tackles synchronization issues by fusing stages to reduce synchronization, employing polynomial coefficient shuffling to minimize synchronization scale, and utilizing an SM-aware combination strategy to identify the optimal switching point. Second, Chameleon is the first to comprehensively analyze and optimize critical switching operations. It introduces CMux-level parallelization to accelerate LUT evaluation and a homomorphic rotation-free matrix-vector multiplication to improve repacking efficiency. Finally, Chameleon outperforms the state-of-the-art GPU implementations by 1.23x in CKKS HMUL and 1.15x in bootstrapping. It also achieves up to 4.87x and 1.51x speedups for TFHE gate bootstrapping compared to CPU and GPU versions, respectively, and delivers a 67.3x average speedup for scheme switching over CPU-based implementation.

cs.CR↗

arXiv2024

Enhanced Coupling of Superconductivity and Evolution of Gap Structure in CsV3Sb5 through Ta Doping

In this study, we present a detailed investigation of kagome superconductors CsV3Sb5 single crystal and its Ta-doped variant, Cs(V0.86Ta0.14)3Sb5, through specific heat measurements. Our results show a clear suppression of the charge density wave (CDW) and notable increase in the superconducting transition temperature (Tc) from 2.8 K to 4.6 K upon Ta doping. The electronic specific heat of the pristine CsV3Sb5 sample can be fitted with a model comprising an s-wave gap and a highly anisotropic extended s-wave gap, where the ratio 2Δ/k_B T_c is smaller than the weak coupling limit of 3.5. For the doped sample Cs(V0.86Ta0.14)3Sb5, it exhibits two isotropic s-wave gaps, yielding the larger gap of 2Δ/k_B T_c=5.04, which indicates a significant enhancement in superconducting coupling. This evolution is attributed to the increased density of states (DOS) near the Fermi level released through the suppression of the CDW gap. Our results demonstrate enhanced superconducting coupling and variation of gap structure in CsV3Sb5 due to Ta doping.

cond-mat.supr-con↗

arXiv2024

DACAT: Dual-stream Adaptive Clip-aware Time Modeling for Robust Online Surgical Phase Recognition

Surgical phase recognition has become a crucial requirement in laparoscopic surgery, enabling various clinical applications like surgical risk forecasting. Current methods typically identify the surgical phase using individual frame-wise embeddings as the fundamental unit for time modeling. However, this approach is overly sensitive to current observations, often resulting in discontinuous and erroneous predictions within a complete surgical phase. In this paper, we propose DACAT, a novel dual-stream model that adaptively learns clip-aware context information to enhance the temporal relationship. In one stream, DACAT pretrains a frame encoder, caching all historical frame-wise features. In the other stream, DACAT fine-tunes a new frame encoder to extract the frame-wise feature at the current moment. Additionally, a max clip-response read-out (Max-R) module is introduced to bridge the two streams by using the current frame-wise feature to adaptively fetch the most relevant past clip from the feature cache. The clip-aware context feature is then encoded via cross-attention between the current frame and its fetched adaptive clip, and further utilized to enhance the time modeling for accurate online surgical phase recognition. The benchmark results on three public datasets, i.e., Cholec80, M2CAI16, and AutoLaparo, demonstrate the superiority of our proposed DACAT over existing state-of-the-art methods, with improvements in Jaccard scores of at least 4.5%, 4.6%, and 2.7%, respectively. Our code and models have been released at https://github.com/kk42yy/DACAT.

cs.CV↗

arXiv2024

Discovery of terahertz-frequency orbitally-coupled magnons in a kagome ferromagnet

In ferromagnetic materials, magnons - quanta of spin waves - typically resonate in the gigahertz range. Beyond conventional magnons, while theoretical studies have predicted magnons associated with orbital magnetic moments, their direct observation has remained challenging. Here, we present the discovery of two distinct terahertz orbitally-coupled magnon resonances in the topological kagome ferromagnet Co3Sn2S2. Using time-resolved Kerr rotation spectroscopy, we pinpoint two magnon resonances at 0.61 and 0.49 THz at 6 K, surpassing all previously reported magnon resonances in ferromagnets due to strong magnetocrystalline anisotropy. These dual modes originate from the strong coupling of localized spin and orbital magnetic moments. These findings unveil a novel category of magnons stemming from orbital magnetic moments, and position Co3Sn2S2 as a promising candidate for high-speed terahertz spintronic applications

cond-mat.str-el↗

arXiv2024

Decoupling Feature Representations of Ego and Other Modalities for Incomplete Multi-modal Brain Tumor Segmentation

Multi-modal brain tumor segmentation typically involves four magnetic resonance imaging (MRI) modalities, while incomplete modalities significantly degrade performance. Existing solutions employ explicit or implicit modality adaptation, aligning features across modalities or learning a fused feature robust to modality incompleteness. They share a common goal of encouraging each modality to express both itself and the others. However, the two expression abilities are entangled as a whole in a seamless feature space, resulting in prohibitive learning burdens. In this paper, we propose DeMoSeg to enhance the modality adaptation by Decoupling the task of representing the ego and other Modalities for robust incomplete multi-modal Segmentation. The decoupling is super lightweight by simply using two convolutions to map each modality onto four feature sub-spaces. The first sub-space expresses itself (Self-feature), while the remaining sub-spaces substitute for other modalities (Mutual-features). The Self- and Mutual-features interactively guide each other through a carefully-designed Channel-wised Sparse Self-Attention (CSSA). After that, a Radiologist-mimic Cross-modality expression Relationships (RCR) is introduced to have available modalities provide Self-feature and also `lend' their Mutual-features to compensate for the absent ones by exploiting the clinical prior knowledge. The benchmark results on BraTS2020, BraTS2018 and BraTS2015 verify the DeMoSeg's superiority thanks to the alleviated modality adaptation difficulty. Concretely, for BraTS2020, DeMoSeg increases Dice by at least 0.92%, 2.95% and 4.95% on whole tumor, tumor core and enhanced tumor regions, respectively, compared to other state-of-the-arts. Codes are at https://github.com/kk42yy/DeMoSeg

cs.CV↗

arXiv2024

LiRank: Industrial Large Scale Ranking Models at LinkedIn

We present LiRank, a large-scale ranking framework at LinkedIn that brings to production state-of-the-art modeling architectures and optimization methods. We unveil several modeling improvements, including Residual DCN, which adds attention and residual connections to the famous DCNv2 architecture. We share insights into combining and tuning SOTA architectures to create a unified model, including Dense Gating, Transformers and Residual DCN. We also propose novel techniques for calibration and describe how we productionalized deep learning based explore/exploit methods. To enable effective, production-grade serving of large ranking models, we detail how to train and compress models using quantization and vocabulary compression. We provide details about the deployment setup for large-scale use cases of Feed ranking, Jobs Recommendations, and Ads click-through rate (CTR) prediction. We summarize our learnings from various A/B tests by elucidating the most effective technical approaches. These ideas have contributed to relative metrics improvements across the board at LinkedIn: +0.5% member sessions in the Feed, +1.76% qualified job applications for Jobs search and recommendations, and +4.3% for Ads CTR. We hope this work can provide practical insights and solutions for practitioners interested in leveraging large-scale deep ranking systems.

cs.LG↗