SearcharxivSearch

arXiv subjects

Qin Shi

Publications and source records attributed to Qin Shi.

11 recordsLinked to original sources

Knowledge Distillation Detection for Open-weights Models

We propose the task of knowledge distillation detection, which aims to determine whether a student model has been distilled from a given teacher, under a practical setting where only the student's weights and the teacher's API are available. This problem is motivated by growing concerns about model provenance and unauthorized replication through distillation. To address this task, we introduce a model-agnostic framework that combines data-free input synthesis and statistical score computation for detecting distillation. Our approach is applicable to both classification and generative models. Experiments on diverse architectures for image classification and text-to-image generation show that our method improves detection accuracy over the strongest baselines by 59.6% on CIFAR-10, 71.2% on ImageNet, and 20.0% for text-to-image generation. The code is available at https://github.com/shqii1j/distillation_detection.

cs.LG

Joint LOS Identification and Data Association for 6G-Enabled Networked Device-Free Sensing

This paper considers networked device-free sensing in an orthogonal frequency division multiplexing (OFDM) cellular system with multipath environment, where the passive targets reflect the downlink signals to the base stations (BSs) via non-line-of-sight (NLOS) paths and/or line-of-sight (LOS) paths, and the BSs share the sensing information extracted from their received echoes to jointly localize the targets. A two-phase localization protocol is considered. In Phase I, we design an efficient method that is able to accurately estimate the range of any path from a transmitting BS to a receiving BS via a target, even if the transmitting and receiving BSs are separated and not perfectly synchronized. In Phase II, we propose an effective method that is able to jointly identify the ranges of the LOS paths between the targets and the BSs as well as associate the ranges of LOS paths with the right targets, such that the number and the locations of the targets both can be accurately estimated. Numerical results verify that our proposed two-phase protocol can achieve high performance of networked sensing in the multipath environment.

eess.SP

User Equipment Assisted Localization for 6G Integrated Sensing and Communication

This paper investigates user equipment (UE) assisted device-free networked sensing in the sixth-generation (6G) integrated sensing and communication (ISAC) system, where one base station (BS) and multiple UEs, such as unmanned aerial vehicles (UAVs), serve as anchors to cooperatively localize multiple passive targets based on the range information. Three challenges arise from the above scheme. First, the UEs are not perfectly synchronized with the BSs. Second, the UE (anchor) positions are usually estimated by the Global Positioning System (GPS) and subject to unknown errors. Third, data association is challenging, since it is hard for each anchor to associate each rang estimation to the right target under device-free sensing. We first tackle the above three challenges under a passive UE based sensing mode, where UEs only passively hear the signals over the BS-target-UE paths. A two-phase UE assisted localization protocol is proposed. In Phase I, we design an efficient method to accurately estimate the ranges from the BS to the targets and those from the BS to the targets to the UEs in the presence of synchronization errors between the BS and the UEs. In Phase II, an efficient algorithm is proposed to localize the targets via jointly removing the UEs with quite inaccurate position information from the anchor set and matching the estimated ranges at the BS and the remaining UEs with the targets. Next, we also consider an active UE based sensing mode, where the UEs can actively emit signals to obtain additional range information from them to the targets. We show that this additional range information can be utilized to significantly reduce the complexity of Phase II in the aforementioned two-phase localization protocol. Numerical results show that our proposed UE assisted networked sensing scheme can achieve very high localization accuracy.

eess.SP

Sequential Subset Matching for Dataset Distillation

Dataset distillation is a newly emerging task that synthesizes a small-size dataset used in training deep neural networks (DNNs) for reducing data storage and model training costs. The synthetic datasets are expected to capture the essence of the knowledge contained in real-world datasets such that the former yields a similar performance as the latter. Recent advancements in distillation methods have produced notable improvements in generating synthetic datasets. However, current state-of-the-art methods treat the entire synthetic dataset as a unified entity and optimize each synthetic instance equally. This static optimization approach may lead to performance degradation in dataset distillation. Specifically, we argue that static optimization can give rise to a coupling issue within the synthetic data, particularly when a larger amount of synthetic data is being optimized. This coupling issue, in turn, leads to the failure of the distilled dataset to extract the high-level features learned by the deep neural network (DNN) in the latter epochs. In this study, we propose a new dataset distillation strategy called Sequential Subset Matching (SeqMatch), which tackles this problem by adaptively optimizing the synthetic data to encourage sequential acquisition of knowledge during dataset distillation. Our analysis indicates that SeqMatch effectively addresses the coupling issue by sequentially generating the synthetic instances, thereby enhancing its performance significantly. Our proposed SeqMatch outperforms state-of-the-art methods in various datasets, including SVNH, CIFAR-10, CIFAR-100, and Tiny ImageNet. Our code is available at https://github.com/shqii1j/seqmatch.

cs.CV

Joint Data Association, NLOS Mitigation, and Clutter Suppression for Networked Device-Free Sensing in 6G Cellular Network

Recently, there is a growing interest in achieving integrated sensing and communication (ISAC) in the sixth-generation (6G) cellular network. Inspired by this trend and the success of cooperative communication in cloud radio access network, this paper considers a networked device-free sensing architecture based on base station (BS) cooperation to transform the cellular network into a huge sensor that can provide ubiquitous and high-performance sensing services. Under this framework, the BSs first transmit the downlink communication signals to the mobile users and then estimate the range information of the targets based on their echoes. Next, a central processor collects the range information from all the BSs via the fronthaul links and localizes each target based on its distances to various BSs. To enable the above strategy in the 6G network, we will perform joint data association, non-line-of-sight (NLOS) mitigation, and clutter suppression, such that the central processor is able to find out the useful range estimations extracted from the line-of-sight (LOS) paths and match them to the right targets for localization. Numerical results show that our interested networked device-free sensing scheme for the 6G network can localize the targets with high accuracy in the challenging multi-path propagation environment.

eess.SP

Device-Free Sensing in OFDM Cellular Network

This paper considers device-free sensing in an orthogonal frequency division multiplexing (OFDM) cellular network to enable integrated sensing and communication (ISAC). A novel two-phase sensing framework is proposed to localize the passive targets that cannot transmit/receive reference signals to/from the base stations (BSs), where the ranges of the targets are estimated based on their reflected OFDM signals to the BSs in Phase I, and the location of each target is estimated based on its ranges to different BSs in Phase II. Specifically, in Phase I, we design a model-free range estimation approach by leveraging the OFDM channel estimation technique for determining the delay values of all the two-way BS-target-BS paths, which does not rely on any BS-target channel model. In Phase II, we reveal that ghost targets may be falsely detected in some cases as all the targets reflect the same signals to the BSs, which thus do not know how to match each estimated range with the right target. Interestingly, we show that the above data association issue is not a fundamental limitation for device-free sensing: under the ideal case of perfect range estimation in Phase I, the probability for ghost targets to exist is proved to be negligible when the targets are randomly located. Moreover, under the practical case of imperfect range estimation in Phase I, we propose an efficient algorithm for joint data association and target localization in Phase II. Numerical results show that our proposed two-phase framework can achieve very high accuracy in the localization of passive targets, which increases with the system bandwidth.

eess.SP

Sequential TOA-Based Moving Target Localization in Multi-Agent Networks

Localizing moving targets in unknown harsh environments has always been a severe challenge. This letter investigates a novel localization system based on multi-agent networks, where multiple agents serve as mobile anchors broadcasting their time-space information to the targets. We study how the moving target can localize itself using the sequential time of arrival (TOA) of the one-way broadcast signals. An extended two-step weighted least squares (TSWLS) method is proposed to jointly estimate the position and velocity of the target in the presence of agent information uncertainties. We also address the large target clock offset (LTCO) problem for numerical stability. Analytical results reveal that our method reaches the Cramer-Rao lower bound (CRLB) under small noises. Numerical results show that the proposed method performs better than the existing algorithms.

eess.SP

Visual-UWB Navigation System for Unknown Environments

Navigation applications relying on the Global Navigation Satellite System (GNSS) are limited in indoor environments and GNSS-denied outdoor terrains such as dense urban or forests. In this paper, we present a novel accurate, robust and low-cost GNSS-independent navigation system, which is composed of a monocular camera and Ultra-wideband (UWB) transceivers. Visual techniques have gained excellent results when computing the incremental motion of the sensor, and UWB methods have proved to provide promising localization accuracy due to the high time resolution of the UWB ranging signals. However, the monocular visual techniques with scale ambiguity are not suitable for applications requiring metric results, and UWB methods assume that the positions of the UWB transceiver anchor are pre-calibrated and known, thus precluding their application in unknown and challenging environments. To this end, we advocate leveraging the monocular camera and UWB to create a map of visual features and UWB anchors. We propose a visual-UWB Simultaneous Localization and Mapping (SLAM) algorithm which tightly combines visual and UWB measurements to form a joint non-linear optimization problem on Lie-Manifold. The 6 Degrees of Freedom (DoF) state of the vehicles and the map are estimated by minimizing the UWB ranging errors and landmark reprojection errors. Our navigation system starts with an exploratory task which performs the real-time visual-UWB SLAM to obtain the global map, then the navigation task by reusing this global map. The tasks can be performed by different vehicles in terms of equipped sensors and payload capability in a heterogeneous team. We validate our system on the public datasets, achieving typical centimeter accuracy and 0.1% scale error.

cs.RO

Range-only Collaborative Localization for Ground Vehicles

High-accuracy absolute localization for a team of vehicles is essential when accomplishing various kinds of tasks. As a promising approach, collaborative localization fuses the individual motion measurements and the inter-vehicle measurements to collaboratively estimate the states. In this paper, we focus on the range-only collaborative localization, which specifies the inter-vehicle measurements as inter-vehicle ranging measurements. We first investigate the observability properties of the system and derive that to achieve bounded localization errors, two vehicles are required to remain static like external infrastructures. Under the guide of the observability analysis, we then propose our range-only collaborative localization system which categorize the ground vehicles into two static vehicles and dynamic vehicles. The vehicles are connected utilizing a UWB network that is capable of both producing inter-vehicle ranging measurements and communication. Simulation results validate the observability analysis and demonstrate that collaborative localization is capable of achieving higher accuracy when utilizing the inter-vehicle measurements. Extensive experimental results are performed for a team of 3 and 5 vehicles. The real-world results illustrate that our proposed system enables accurate and real-time estimation of all vehicles' absolute poses.

cs.RO

BLAS: Broadcast Relative Localization and Clock Synchronization for Dynamic Dense Multi-Agent Systems

The spatiotemporal information plays crucial roles in a multi-agent system (MAS). However, for a highly dynamic and dense MAS in unknown environments, estimating its spatiotemporal states is a difficult problem. In this paper, we present BLAS: a wireless broadcast relative localization and clock synchronization system to address these challenges. Our BLAS system exploits a broadcast architecture, under which a MAS is categorized into parent agents that broadcast wireless packets and child agents that are passive receivers, to reduce the number of required packets among agents for relative localization and clock synchronization. We first propose an asynchronous broadcasting and passively receiving (ABPR) protocol. The protocol schedules the broadcast of parent agents using a distributed time division multiple access (D-TDMA) scheme and delivers inter-agent information used for joint relative localization and clock synchronization. We then present distributed state estimation approaches in parent and child agents that utilize the broadcast inter-agent information for joint estimation of spatiotemporal states. The simulations and real-world experiments based on ultra-wideband (UWB) illustrate that our proposed BLAS cannot only enable accurate, high-frequency and real-time estimation of relative position and clock parameters but also support theoretically an unlimited number of agents.

cs.RO

Analytical and simulation studies of pedestrian flow at a crossing with random update rule

The intersecting pedestrian flow on the 2D lattice with random update rule is studied. Each pedestrian has three moving directions without the back step. Under periodic boundary conditions, an intermediate phase has been found at which some pedestrians could move along the border of jamming stripes. We have performed mean field analysis for the moving and intermediate phase respectively. The analytical results agree with the simulation results well. The empty site moves along the interface of jamming stripes when the system only has one empty site. The average movement of empty site in one Monte Carlo step (MCS) has been analyzed through the master equation. Under open boundary conditions, the system exhibits moving and jamming phases. The critical injection probability $α_c$ shows nontrivially against the forward moving probability $q$. The analytical results of average velocity, the density and the flow rate against the injection probability in the moving phase also agree with simulation results well.

nlin.CG