SearcharxivSearch

arXiv subjects

Hengxuan Lou

Publications and source records attributed to Hengxuan Lou.

3 recordsLinked to original sources

MUSE: A Heterogeneity-Aware Multimedia Search Engine for Mobile SoCs

On-device multimedia retrieval is vital for smartphones, enabling applications like cross-modal semantic search and multimodal personal AI agents. However, realizing efficient retrieval on mobile SoCs remains a critical systems challenge. Unlike text-based search, multimedia applications depend on high-dimensional cross-modal embeddings (often exceeding 1024 dimensions) and continuously expanding media streams (e.g., video lifelogs and ambient audio). Mobile devices must process these intensive workloads under strict latency, energy, and memory constraints. Existing vector retrieval systems, designed primarily for static server datasets, are poorly suited for the dynamic execution models of mobile SoCs, where interactive queries must coexist with continuous background media ingestion and index maintenance. To address these challenges, we propose MUSE, a MUltimedia Search Engine comprehensively co-designed for mobile SoCs. MUSE tackles these issues through an architecture-index co-design. It introduces a three-stage asynchronous execution pipeline that overlaps DMA transfers, NPU matrix computation, and hardware-vector data adaptation to overcome the memory wall of high-dimensional embeddings. Furthermore, it redesigns the Inverted File Index (IVF) and introduces workload-aware heterogeneous scheduling across the CPU, GPU, and NPU for hybrid interactive-and-ingestion workloads. Evaluated on Snapdragon 8-series SoCs using real-world multimodal datasets, MUSE improves query throughput by up to 1.4x at matched recall, achieves up to 7x faster index construction, and delivers up to 6x higher insertion throughput under concurrent streaming. Crucially, its accelerator-native design ensures strict physical compliance, capping peak device temperatures at 38°C and reducing total energy consumption by up to 4.6x compared to CPU-bound baselines.

cs.DC

FAVA: Formal Authorization for Verified Agents with Evidence-Backed Permission Graphs

Large language model (LLM) agents autonomously interleave semantic reasoning with complex system operations. In these dynamic environments, static tool-level permissions are fundamentally insufficient; safe authorization is highly context-dependent and heavily reliant on evolving runtime states and data flows. We present FAVA (Formal Authorization for Verified Agents), a permission-carrying authorization framework for agent execution. FAVA utilizes an LLM-guided Permission Intermediate Representation (IR) to translate ambiguous natural-language tasks into structured constraints. A deterministic lowering pass then converts this IR into an evidence-backed permission graph that explicitly tracks data flows, dependencies, and contextual labels. To provide strict security guarantees, a Satisfiability Modulo Theories (SMT) authorizer mathematically verifies the current graph against security policies before any effectful action executes. A runtime gateway then enforces the solver's result, either authorizing the execution or intercepting it with a precise counterexample. We evaluate FAVA across OpenAgentSafety, OctoBench, and ActPlane scenarios. Our evaluation demonstrates that FAVA achieves a 90.5% Decision Compliance Rate (DCR) over the aggregate dataset, successfully intercepting dynamic violating traces in the evaluated trace-conditioned scenarios.

cs.CR

GRAB-ANNS: High-Throughput Indexing and Hybrid Search via GPU-Native Bucketing

Hybrid search, which jointly optimizes vector similarity and structured predicate filtering, has become a fundamental building block for modern AI-driven systems. While recent predicate-aware ANN indices improve filtering efficiency on CPUs, their performance is increasingly constrained by limited memory bandwidth and parallelism. Although GPUs offer massive parallelism and superior memory bandwidth, directly porting CPU-centric hybrid search algorithms to GPUs leads to severe performance degradation due to architectural mismatches, including irregular memory access, branch divergence, and excessive CPU-GPU synchronization. In this paper, we present GRAB-ANNS, a high-throughput, GPU-native graph index for dynamic hybrid search. Our key insight is to rethink hybrid indexing from a hardware-first perspective. We introduce a bucket-based memory layout that transforms range predicates into lightweight bucket selection, enabling coalesced memory accesses and efficient SIMT execution. To preserve global navigability under arbitrary filters, we design a hybrid graph topology that combines dense intra-bucket local edges with sparse inter-bucket remote edges. We further develop an append-only update pipeline that supports efficient batched insertions and parallel graph maintenance on GPUs. Extensive experiments on large-scale datasets show that GRAB-ANNS achieves up to 240.1 times higher query throughput and 12.6 times faster index construction than state-of-the-art CPU-based systems, and up to 10 times higher throughput compared to optimized GPU-native reimplementations, while maintaining high recall.

cs.DB