Searcharxiv⌕ Search

arXiv subjects

Ao Shen

Publications and source records attributed to Ao Shen.

25 records · Page 2Linked to original sources

Canvas: End-to-End Kernel Architecture Search in Neural Networks

The demands for higher performance and accuracy in neural networks (NNs) never end. Existing tensor compilation and Neural Architecture Search (NAS) techniques orthogonally optimize the two goals but actually share many similarities in their concrete strategies. We exploit such opportunities by combining the two into one and make a case for Kernel Architecture Search (KAS). KAS reviews NAS from a system perspective and zooms into a more fine-grained level to generate neural kernels with both high performance and good accuracy. To demonstrate the potential of KAS, we build an end-to-end framework, Canvas, to find high-quality kernels as convolution replacements. Canvas samples from a rich set of fine-grained primitives to stochastically and iteratively construct new kernels and evaluate them according to user-specified constraints. Canvas supports freely adjustable tensor dimension sizes inside the kernel and uses two levels of solvers to satisfy structural legality and fully utilize model budgets. The evaluation shows that by replacing standard convolutions with generated new kernels in common NNs, Canvas achieves average 1.5x speedups compared to the previous state-of-the-art with acceptable accuracy loss and search efficiency. Canvas verifies the practicability of KAS by rediscovering many manually designed kernels in the past and producing new structures that may inspire future machine learning innovations. For source code and implementation, we open-sourced Canvas at https://github.com/tsinghua-ideal/Canvas.

cs.LG↗

$ω$-well-filtered spaces, revisited

We prove that a $T_0$ topological space is $ω$-well-filtered if and only if it does not admit either the natural numbers with the cofinite topology or with the Scott topology as its closed subsets in the strong topology. Based on this, we offer a refined topological characterization for the $ω$-well-filterification of $T_0$-spaces and solve a problem posed by Xiaoquan Xu. In the setting of second countable spaces, we also characterise sobriety by convergences of certain $Π^0_2$-Cauchy subsets of the spaces.

math.GN↗

Marine Debris Detection in Satellite Surveillance using Attention Mechanisms

Marine debris is an important issue for environmental protection, but current methods for locating marine debris are yet limited. In order to achieve higher efficiency and wider applicability in the localization of Marine debris, this study tries to combine the instance segmentation of YOLOv7 with different attention mechanisms and explores the best model. By utilizing a labelled dataset consisting of satellite images containing ocean debris, we examined three attentional models including lightweight coordinate attention, CBAM (combining spatial and channel focus), and bottleneck transformer (based on self-attention). Box detection assessment revealed that CBAM achieved the best outcome (F1 score of 77%) compared to coordinate attention (F1 score of 71%) and YOLOv7/bottleneck transformer (both F1 scores around 66%). Mask evaluation showed CBAM again leading with an F1 score of 73%, whereas coordinate attention and YOLOv7 had comparable performances (around F1 score of 68%/69%) and bottleneck transformer lagged behind at F1 score of 56%. These findings suggest that CBAM offers optimal suitability for detecting marine debris. However, it should be noted that the bottleneck transformer detected some areas missed by manual annotation and displayed better mask precision for larger debris pieces, signifying potentially superior practical performance.

cs.CV↗

Experimental quantum secret sharing based on phase encoding of coherent states

Quantum secret sharing (QSS) is one of the basic communication primitives in future quantum networks which addresses part of the basic cryptographic tasks of multiparty communication and computation. Nevertheless, it is a challenge to provide a practical QSS protocol with security against general attacks. A QSS protocol that balances security and practicality is still lacking. Here, we propose a QSS protocol with simple phase encoding of coherent states among three parties. Removing the requirement of impractical entangled resources and the need for phase randomization, our protocol can be implemented with accessible technology. We provide the finite-key analysis against coherent attacks and implement a proof-of-principle experiment to demonstrate our scheme's feasibility. Our scheme achieves a key rate of 85.3 bps under a 35 dB channel loss. Combined with security against general attacks and accessible technology, our protocol is a promising candidate for practical multiparty quantum communication networks.

quant-ph↗

Bunching Effect and Quantum Statistics of Partially Indistinguishable Photons

The quantum statistics of particles is determined by both the spins and the indistinguishability of quantum states. Here we studied the quantum statistics of partially distinguishable photons by defining the multi-photon indistinguishability. The photon bunching co-efficient was formulated based on the properties of permutation symmetry, and a modified Bose--Einstein statistics was presented with an indistinguishability induced photon bunching effect. Moreover, the statistical transition of the photon state was studied for partially distinguishable photons, and the results shows the that indistinguishability exhibits the same role as that observed in the generation of laser. The results will fill the gap between Bose--Einstein and Poisson statistics for photons, and a formula is presented for the study of multi-photon quantum information processes.

quant-ph↗

Indistinguishability-induced classical-to-nonclassical transition of photon statistics

Photon statistics is one of the key properties of the photon state for the study of quantum coherence and quantum information techniques. Here, we discuss the photon indistinguishability induced bunching effect which can significantly change photon statistics. Through the measurement of the second-order degree of coherence of a mixed photon state composed of a single-photon state and a weak coherent state, the statistical transition from a classical behavior to a nonclassical behavior is experimentally demonstrated by modifying the indistinguishability of the two-photon states. The study will help us to understand and control the photon statistics with a method for quantum optical coherence and quantum information applications. It also indicates that the photon indistinguishability is a key parameter for multipartite quantum coherence.

quant-ph↗

Near-infrared-enhanced charge state conversion for low power optical nanoscopy with nitrogen vacancy center in diamond

The near-infrared (NIR) optical pumped photophysics of nitrogen vacancy (NV) center in diamond was experimentally studied by considering both the charge state conversion and stimulated emission. We found that the NIR laser can help to highly enhance the charge state conversion rate, which can be applied to improve the performance of charge state depletion nanoscopy. Using a doughnut-shaped visible laser beam and a Gaussian-shaped NIR laser beam for charge state manipulation, we developed a low power charge state depletion nanoscopy for NV center. A spatial resolution of 14 nm was achieved with the depletion laser intensity approximately three orders lower than that used for the stimulated emission depletion nanoscopy with NV center. With high spatial resolution and low laser power, the nanoscopy can be used for nanoscale quantum sensing with NV center. And our study on the charge state conversion can help to further optimize the NV center spin state initialization and detection.

physics.optics↗