SearcharxivSearch

arXiv subjects

Wenjun Hu

Publications and source records attributed to Wenjun Hu.

18 recordsLinked to original sources

Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guarantees

Graph-based Retrieval-Augmented Generation (RAG) systems leverage interconnected knowledge structures to capture complex relationships that flat retrieval struggles with, enabling multi-hop reasoning. Yet most existing graph-based methods suffer from (i) heuristic designs lacking theoretical guarantees for subgraph quality or relevance and/or (ii) the use of static exploration strategies that ignore the query's holistic meaning, retrieving neighborhoods or communities regardless of intent. We propose Query-Aware Flow Diffusion RAG (QAFD-RAG), a training-free framework that dynamically adapts graph traversal to each query's holistic semantics. The central innovation is query-aware traversal: during graph exploration, edges are dynamically weighted by how well their endpoints align with the query's embedding, guiding flow along semantically relevant paths while avoiding structurally connected but irrelevant regions. These query-specific reasoning subgraphs enable the first statistical guarantees for query-aware graph retrieval, showing that QAFD-RAG recovers relevant subgraphs with high probability under mild signal-to-noise conditions. The algorithm converges exponentially fast, with complexity scaling with the retrieved subgraph size rather than the full graph. Experiments on question answering and text-to-SQL tasks demonstrate consistent improvements over state-of-the-art graph-based RAG methods.

cs.IR

Curator: Efficient Vector Search with Low-Selectivity Filters

Embedding-based dense retrieval has become the cornerstone of many critical applications, where approximate nearest neighbor search (ANNS) queries are often combined with filters on labels such as dates and price ranges. Graph-based indexes achieve state-of-the-art performance on unfiltered ANNS but encounter connectivity breakdown on low-selectivity filtered queries, where qualifying vectors become sparse and the graph structure among them fragments. Recent research proposes specialized graph indexes that address this issue by expanding graph degree, which incurs prohibitively high construction costs. Given these inherent limitations of graph-based methods, we argue for a dual-index architecture and present Curator, a partition-based index that complements existing graph-based approaches for low-selectivity filtered ANNS. Curator builds specialized indexes for different labels within a shared clustering tree, where each index adapts to the distribution of its qualifying vectors to ensure efficient search while sharing structure to minimize memory overhead. The system also supports incremental updates and handles arbitrary complex predicates beyond single-label filters by efficiently constructing temporary indexes on the fly. Our evaluation demonstrates that integrating Curator with state-of-the-art graph indexes reduces low-selectivity query latency by up to 20.9x compared to pre-filtering fallback, while increasing construction time and memory footprint by only 5.5% and 4.3%, respectively.

cs.DB

PaVeRL-SQL: Text-to-SQL via Partial-Match Rewards and Verbal Reinforcement Learning

Text-to-SQL models allow users to interact with a database more easily by generating executable SQL statements from natural-language questions. Despite recent successes on simpler databases and questions, current Text-to-SQL methods still suffer from low execution accuracy on industry-scale databases and complex questions involving domain-specific business logic. We present \emph{PaVeRL-SQL}, a framework that combines \emph{Partial-Match Rewards} and \emph{Verbal Reinforcement Learning} to drive self-improvement in reasoning language models (RLMs) for Text-to-SQL. To handle practical use cases, we adopt two pipelines: (1) a newly designed in-context learning framework with group self-evaluation (verbal-RL), using capable open- and closed-source large language models (LLMs) as backbones; and (2) a chain-of-thought (CoT) RL pipeline with a small backbone model (OmniSQL-7B) trained with a specially designed reward function and two-stage RL. These pipelines achieve state-of-the-art (SOTA) results on popular Text-to-SQL benchmarks -- Spider, Spider 2.0, and BIRD. For the industrial-level Spider2.0-SQLite benchmark, the verbal-RL pipeline achieves an execution accuracy 7.4\% higher than SOTA, and the CoT pipeline is 1.4\% higher. RL training with mixed SQL dialects yields strong, threefold gains, particularly for dialects with limited training data. Overall, \emph{PaVeRL-SQL} delivers reliable, SOTA Text-to-SQL under realistic industrial constraints. The code is available at https://github.com/PaVeRL-SQL/PaVeRL-SQL.

cs.AI

Let Human Sketches Help: Empowering Challenging Image Segmentation Task with Freehand Sketches

Sketches, with their expressive potential, allow humans to convey the essence of an object through even a rough contour. For the first time, we harness this expressive potential to improve segmentation performance in challenging tasks like camouflaged object detection (COD). Our approach introduces an innovative sketch-guided interactive segmentation framework, allowing users to intuitively annotate objects with freehand sketches (drawing a rough contour of the object) instead of the traditional bounding boxes or points used in classic interactive segmentation models like SAM. We demonstrate that sketch input can significantly improve performance in existing iterative segmentation methods, outperforming text or bounding box annotations. Additionally, we introduce key modifications to network architectures and a novel sketch augmentation technique to fully harness the power of sketch input and further boost segmentation accuracy. Remarkably, our model' s output can be directly used to train other neural networks, achieving results comparable to pixel-by-pixel annotations--while reducing annotation time by up to 120 times, which shows great potential in democratizing the annotation process and enabling model training with less reliance on resource-intensive, laborious pixel-level annotations. We also present KOSCamo+, the first freehand sketch dataset for camouflaged object detection. The dataset, code, and the labeling tool will be open sourced.

cs.CV

Bayesian Active Learning for Semantic Segmentation

Fully supervised training of semantic segmentation models is costly and challenging because each pixel within an image needs to be labeled. Therefore, the sparse pixel-level annotation methods have been introduced to train models with a subset of pixels within each image. We introduce a Bayesian active learning framework based on sparse pixel-level annotation that utilizes a pixel-level Bayesian uncertainty measure based on Balanced Entropy (BalEnt) [84]. BalEnt captures the information between the models' predicted marginalized probability distribution and the pixel labels. BalEnt has linear scalability with a closed analytical form and can be calculated independently per pixel without relational computations with other pixels. We train our proposed active learning framework for Cityscapes, Camvid, ADE20K and VOC2012 benchmark datasets and show that it reaches supervised levels of mIoU using only a fraction of labeled pixels while outperforming the previous state-of-the-art active learning models with a large margin.

cs.CV

Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation

Assessing response quality to instructions in language models is vital but challenging due to the complexity of human language across different contexts. This complexity often results in ambiguous or inconsistent interpretations, making accurate assessment difficult. To address this issue, we propose a novel Uncertainty-aware Reward Model (URM) that introduces a robust uncertainty estimation for the quality of paired responses based on Bayesian approximation. Trained with preference datasets, our uncertainty-enabled proxy not only scores rewards for responses but also evaluates their inherent uncertainty. Empirical results demonstrate significant benefits of incorporating the proposed proxy into language model training. Our method boosts the instruction following capability of language models by refining data curation for training and improving policy optimization objectives, thereby surpassing existing methods by a large margin on benchmarks such as Vicuna and MT-bench. These findings highlight that our proposed approach substantially advances language model training and paves a new way of harnessing uncertainty within language models.

cs.CL

RESMatch: Referring Expression Segmentation in a Semi-Supervised Manner

Referring expression segmentation (RES), a task that involves localizing specific instance-level objects based on free-form linguistic descriptions, has emerged as a crucial frontier in human-AI interaction. It demands an intricate understanding of both visual and textual contexts and often requires extensive training data. This paper introduces RESMatch, the first semi-supervised learning (SSL) approach for RES, aimed at reducing reliance on exhaustive data annotation. Extensive validation on multiple RES datasets demonstrates that RESMatch significantly outperforms baseline approaches, establishing a new state-of-the-art. Although existing SSL techniques are effective in image segmentation, we find that they fall short in RES. Facing the challenges including the comprehension of free-form linguistic descriptions and the variability in object attributes, RESMatch introduces a trifecta of adaptations: revised strong perturbation, text augmentation, and adjustments for pseudo-label quality and strong-weak supervision. This pioneering work lays the groundwork for future research in semi-supervised learning for referring expression segmentation.

cs.CV

Curator: Efficient Indexing for Multi-Tenant Vector Databases

Vector databases have emerged as key enablers for bridging intelligent applications with unstructured data, providing generic search and management support for embedding vectors extracted from the raw unstructured data. As multiple data users can share the same database infrastructure, multi-tenancy support for vector databases is increasingly desirable. This hinges on an efficient filtered search operation, i.e., only querying the vectors accessible to a particular tenant. Multi-tenancy in vector databases is currently achieved by building either a single, shared index among all tenants, or a per-tenant index. The former optimizes for memory efficiency at the expense of search performance, while the latter does the opposite. Instead, this paper presents Curator, an in-memory vector index design tailored for multi-tenant queries that simultaneously achieves the two conflicting goals, low memory overhead and high performance for queries, vector insertion, and deletion. Curator indexes each tenant's vectors with a tenant-specific clustering tree and encodes these trees compactly as sub-trees of a shared clustering tree. Each tenant's clustering tree adapts dynamically to its unique vector distribution, while maintaining a low per-tenant memory footprint. Our evaluation, based on two widely used data sets, confirms that Curator delivers search performance on par with per-tenant indexing, while maintaining memory consumption at the same level as metadata filtering on a single, shared index.

cs.DB

Deep3DSketch+: Obtaining Customized 3D Model by Single Free-Hand Sketch through Deep Learning

As 3D models become critical in today's manufacturing and product design, conventional 3D modeling approaches based on Computer-Aided Design (CAD) are labor-intensive, time-consuming, and have high demands on the creators. This work aims to introduce an alternative approach to 3D modeling by utilizing free-hand sketches to obtain desired 3D models. We introduce Deep3DSketch+, which is a deep-learning algorithm that takes the input of a single free-hand sketch and produces a complete and high-fidelity model that matches the sketch input. The neural network has view- and structural-awareness enabled by a Shape Discriminator (SD) and a Stroke Enhancement Module (SEM), which overcomes the limitations of sparsity and ambiguity of the sketches. The network design also brings high robustness to partial sketch input in industrial applications.Our approach has undergone extensive experiments, demonstrating its state-of-the-art (SOTA) performance on both synthetic and real-world datasets. These results validate the effectiveness and superiority of our method compared to existing techniques. We have demonstrated the conversion of free-hand sketches into physical 3D objects using additive manufacturing. We believe that our approach has the potential to accelerate product design and democratize customized manufacturing.

cs.MM

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for novice users. Sketch-based 3D modeling provides a promising solution by leveraging the intuitive nature of human-computer interaction. However, generating high-quality content that accurately reflects the creator's ideas can be challenging due to the sparsity and ambiguity of sketches. Furthermore, novice users often find it challenging to create accurate drawings from multiple perspectives or follow step-by-step instructions in existing methods. To address this, we introduce a groundbreaking end-to-end approach in our work, enabling 3D modeling from a single free-hand sketch, Deep3DSketch+$\backslash$+. The issue of sparsity and ambiguity using single sketch is resolved in our approach by leveraging the symmetry prior and structural-aware shape discriminator. We conducted comprehensive experiments on diverse datasets, including both synthetic and real data, to validate the efficacy of our approach and demonstrate its state-of-the-art (SOTA) performance. Users are also more satisfied with results generated by our approach according to our user study. We believe our approach has the potential to revolutionize the process of 3D modeling by offering an intuitive and easy-to-use solution for novice users.

cs.HC

Cross-Media Wireless Made Easier: Tuning Media Interfaces with Flexible Metasurfaces

Emerging wireless IoT applications increasingly venture beyond over-the-air communication, such as deep-tissue networking for implantable sensors, air-water communication for ocean monitoring, and soil sensing. These applications face the fundamental challenge of significant power loss due to reflection at media interfaces. We present RF-Mediator, a programmable metasurface system placed at media interfaces to virtually mask the presence of the physical boundary. It is designed as a single-layer metasurface comprising arrays of varactor-based elements. By tuning the bias voltage element-wise, the surface mediates between media on both sides dynamically and beamforms towards the endpoint to boost transmission through the interface, as if no media interface existed. The control algorithm determines the surface configuration by probing the search space efficiently. We fabricate the surface on a thin, flexible substrate, and experiment with several cross-media setups. Extensive evaluation shows that RF-Mediator provides a median power gain of 8 dB for air-to-tissue links and up to 30 dB for cross-media backscatter links.

cs.NI

Softly, Deftly, Scrolls Unfurl Their Splendor: Rolling Flexible Surfaces for Wideband Wireless

With new frequency bands opening up, emerging wireless IoT devices are capitalizing on an increasingly divergent range of frequencies. However, existing coverage provisioning practice is often tied to specific standards and frequencies. There is little shareable wireless infrastructure for concurrent links on different frequencies, across networks and standards. This paper presents Scrolls, a frequency-tunable soft smart surface system to enhance wideband, multi-network coverage. Scrolls' hardware comprises many rows of rollable thin plastic film, each attached with flexible copper strips. When rolled to different lengths, the copper strips act as wire antennas reflecting signals on the corresponding frequencies. The surface control algorithm determines the unrolled strip lengths for link enhancement by probing the search space efficiently. We build a set of distributed, composable Scrolls prototypes and deploy them in an office. Extensive evaluation shows that Scrolls can adapt the antenna lengths effectively to provide link enhancement across diverse standards on sub-6 GHz bands. For concurrent links on 900 MHz (LoRa), 2.4 GHz (Wi-Fi), 3.7 GHz, and 5 GHz, Scrolls can provide received signal strength gains to all links simultaneously, by a median of 4 dB and up to 10 dB

cs.NI

Scalable variational Monte Carlo with graph neural ansatz

Deep neural networks have been shown as a potentially powerful ansatz in variational Monte Carlo for solving quantum many-body problems. We propose two improvements in this direction. The first is graph neural ansatz (GNA), which is a variational wavefunction universal to arbitrary geometry. GNA results in accurate ground-state energies on 2D Kagome lattices, triangular lattices, and randomly connected graphs. Secondly, we design a distributed workflow on multiple accelerators to scale up the computation. We compute Kagome lattices with sizes up to 432 sites on 128 TPU cores. The parameter sharing nature of the GNA also leads to transferability across different system sizes and geometries.

cond-mat.str-el

Similarities and differences between nickelate and cuprate films grown on a SrTiO$_3$ substrate

The recent discovery of superconductivity in Sr-doped NdNiO$_2$ films grown on SrTiO$_3$ started a novel field within unconventional superconductivity. To understand the similarities and differences between nickelate and cuprate layers on the same SrTiO$_3$ substrate, here based on the density functional theory we have systematically investigated the structural, electronic, and magnetic properties of NdNiO$_2$/SrTiO$_3$ and CaCuO$_2$/SrTiO$_3$ systems. Our results revealed a strong lattice reconstruction in the case of NdNiO$_2$/SrTiO$_3$, resulting in a polar film, with the surface and interfacial NiO$_2$ layers presenting opposite displacements. However, for CaCuO$_2$/SrTiO$_3$, the distortions of those same two CuO$_2$ layers were in the same direction. In addition, we found this distortion to be approximately independent of the studied range of film thickness for both the nickelate and cuprates films. Furthermore, we also observed a two-dimensional electron gas at the interface between NdNiO$_2$ and SrTiO$_3$, caused by the polar discontinuity, in agreement with recent literature. For NdNiO$_2$/SrTiO$_3$ the two-dimensional electron gas extends over several layers, while for CaCuO$_2$/SrTiO$_3$ this electronic rearrangement is very localized at the interface between CaCuO$_2$ and SrTiO$_3$. The electronic reconstruction found at the interface involves a strong occupation of the Ti $3d_{xy}$ state. In both cases, there is a significant electronic charge transfer from the surface Ni or Cu layers to the Ti interface layer. The interfacial Ni and Cu layer is hole and electron doped, respectively. By introducing magnetism and electronic correlation, we observed that the $d_{3z^2-r^2}$ orbital of Ni becomes itinerant while the same orbital for Cu remains doubly occupied, establishing a clear two- vs one-orbital active framework for the description of these systems.

cond-mat.str-el

Pushing the Physical Limits of IoT Devices with Programmable Metasurfaces

Small, low-cost IoT devices are typically equipped with only a single, low-quality antenna, significantly limiting communication range and link quality. In particular, these antennas are typically linearly polarized and therefore susceptible to polarization mismatch, which can easily cause 10-15 dBm of link loss on communication to and from such devices. In this work, we highlight this under-appreciated issue and propose the augmentation of IoT deployment environments with programmable, RF-sensitive surfaces made of metamaterials. Our smart meta-surface mitigates polarization mismatch by rotating the polarization of signals that pass through or reflect off the surface. We integrate our metasurface into an IoT network as LAMA, a Low-power Lattice of Actuated Metasurface Antennas, designed for the pervasively used 2.4 GHz ISM band. We optimize LAMA's metasurface design for both low transmission loss and low cost, to facilitate deployment at scale. We then build an end-to-end system that actuates the metasurface structure to optimize for link performance in real time. Our experimental prototype-based evaluation demonstrates gains in link power of up to 15 dBm, and wireless capacity improvements of 100 and 180 Kbit/s/Hz in through-surface and surface-reflective scenarios, respectively, attributable to the polarization rotation properties of LAMA'S metasurface.

cs.NI

Broken mirror symmetry, incommensurate spin correlations, and $B_{2g}$ nematic order in iron pnictides

Motivated by growing indications for a distinct form of nematic correlations in the extremely hole doped iron pnictide compounds $A$Fe$_2$As$_2$ ($A$=K,Rb,Cs), we consider spin-driven nematic order in the general case of incommensurate magnetic fluctuations. We classify the nematic order parameters by broken mirror symmetries of the tetragonal $D_{4h}$ point group, and use this scheme to construct a general Ginzburg-Landau theory that links the nematic order to spatial pattern of magnetic fluctuations. Our analysis points to incommensurate magnetic fluctuations of wavevector $(q,q)$ as underlying a $B_{2g}$ nematic order in $A$Fe$_2$As$_2$. We substantiate this idea by microscopic calculations of the nematic order based on 3-sublattice $(2\pi/3,2\pi/3)$ spin correlations in an extended bilinear-biquadratic Heisenberg model. We summarize the existing evidence in support of the proposed mechanism, suggest ways to further test it in future experiments, and discuss the implications of our results for iron-based high temperature superconductivity.

cond-mat.supr-con

Taming Energy Cost of Disk Encryption Software on Data-Intensive Mobile Devices

Disk encryption is frequently used to secure confidential data on mobile devices. However, the high energy cost of disk encryption poses a heavy burden on those devices with limited battery capacity especially when a large amount of data needs to be protected by disk encryption. To address the challenge, we develop a new kernel-level disk encryption software, Populus. Almost 98% of Populus's encryption/decryption computation is not related with the input plaintext/ciphertext, so we accomplish the computation in advance during initialization when a consistent power supply is available. We conduct cryptanalysis on Populus and finally conclude that state-of-the-art cryptanalysis techniques fail to break Populus in reasonable computational complexity. We also conduct energy consumption experiments on Populus and dm-crypt, a famous disk encryption software for Android and Linux mobile devices. The experimental results demonstrate that Populus consumes 50%-70% less energy than dm-crypt.

cs.CR

Gapped spin liquid phase in the J1-J2 Heisenberg model by a Bosonic resonating valence-bond ansatz

We study the ground-state phase diagram of the spin-1/2 J1-J2 Heisenberg model on the square lattice with an accurate Bosonic resonating valence-bond (RVB) wave function. In contrast to the RVB ansatz based on Schwinger Fermions, the representation based on Schwinger Bosons, supplemented by a variational Monte Carlo technique enforcing the exact projection onto the physical subspace, is able to describe a fully gapped spin liquid in the strongly frustrated regime. In particular, a fully symmetric Z2 spin liquid is stable between two antiferromagnetic phases; a continuous transition at J2=0.4J1, when the Marshall sign rule begins to be essentially violated, and a first-order transition around J2=0.6J1 are present. Most importantly, the triplet gap is found to have a non-monotonic behavior, reaching a maximum around J2=0.51J1, when the lowest spinon excitation moves from the \Gamma to the M point, i.e., k=(\pi,0).

cond-mat.str-el