arXiv subjects

Liu Yang

Publications and source records attributed to Liu Yang.

At least 163 records · Page 9Linked to original sources

arXiv2022

An Evolutionary Game based Secure Clustering Protocol with Fuzzy Trust Evaluation and Outlier Detection for Wireless Sensor Networks

Trustworthy and reliable data delivery is a challenging task in Wireless Sensor Networks (WSNs) due to unique characteristics and constraints. To acquire secured data delivery and address the conflict between security and energy, in this paper we present an evolutionary game based secure clustering protocol with fuzzy trust evaluation and outlier detection for WSNs. Firstly, a fuzzy trust evaluation method is presented to transform the transmission evidences into trust values while effectively alleviating the trust uncertainty. And then, a K-Means based outlier detection scheme is proposed to further analyze plenty of trust values obtained via fuzzy trust evaluation or trust recommendation. It can discover the commonalities and differences among sensor nodes while improving the accuracy of outlier detection. Finally, we present an evolutionary game based secure clustering protocol to achieve a trade-off between security assurance and energy saving for sensor nodes when electing for the cluster heads. A sensor node which failed to be the cluster head can securely choose its own head by isolating the suspicious nodes. Simulation results verify that our secure clustering protocol can effectively defend the network against the attacks from internal selfish or compromised nodes. Correspondingly, the timely data transfer rate can be improved significantly.

cs.NI↗

arXiv2022

Downwash-aware Control Allocation for Over-actuated UAV Platforms

Tracking position and orientation independently affords more agile maneuver for over-actuated multirotor Unmanned Aerial Vehicles (UAVs) while introducing undesired downwash effects; downwash flows generated by thrust generators may counteract others due to close proximity, which significantly threatens the stability of the platform. The complexity of modeling aerodynamic airflow challenges control algorithms from properly compensating for such a side effect. Leveraging the input redundancies in over-actuated UAVs, we tackle this issue with a novel control allocation framework that considers downwash effects and explores the entire allocation space for an optimal solution. This optimal solution avoids downwash effects while providing high thrust efficiency within the hardware constraints. To the best of our knowledge, ours is the first formal derivation to investigate the downwash effects on over-actuated UAVs. We verify our framework on different hardware configurations in both simulation and experiment.

cs.RO↗

arXiv2022

A Secure Clustering Protocol with Fuzzy Trust Evaluation and Outlier Detection for Industrial Wireless Sensor Networks

Security is one of the major concerns in Industrial Wireless Sensor Networks (IWSNs). To assure the security in clustered IWSNs, this paper presents a secure clustering protocol with fuzzy trust evaluation and outlier detection (SCFTO). Firstly, to deal with the transmission uncertainty in an open wireless medium, an interval type-2 fuzzy logic controller is adopted to estimate the trusts. And then a density based outlier detection mechanism is introduced to acquire an adaptive trust threshold used to isolate the malicious nodes from being cluster heads. Finally, a fuzzy based cluster heads election method is proposed to achieve a balance between energy saving and security assurance, so that a normal sensor node with more residual energy or less confidence on other nodes has higher probability to be the cluster head. Extensive experiments verify that our secure clustering protocol can effectively defend the network against attacks from internal malicious or compromised nodes.

cs.NI↗

arXiv2022

An Intelligent Trust Cloud Management Method for Secure Clustering in 5G enabled Internet of Medical Things

5G edge computing enabled Internet of Medical Things (IoMT) is an efficient technology to provide decentralized medical services while Device-to-device (D2D) communication is a promising paradigm for future 5G networks. To assure secure and reliable communication in 5G edge computing and D2D enabled IoMT systems, this paper presents an intelligent trust cloud management method. Firstly, an active training mechanism is proposed to construct the standard trust clouds. Secondly, individual trust clouds of the IoMT devices can be established through fuzzy trust inferring and recommending. Thirdly, a trust classification scheme is proposed to determine whether an IoMT device is malicious. Finally, a trust cloud update mechanism is presented to make the proposed trust management method adaptive and intelligent under an open wireless medium. Simulation results demonstrate that the proposed method can effectively address the trust uncertainty issue and improve the detection accuracy of malicious devices.

cs.NI↗

arXiv2022

An Intelligent Deterministic Scheduling Method for Ultra-Low Latency Communication in Edge Enabled Industrial Internet of Things

Edge enabled Industrial Internet of Things (IIoT) platform is of great significance to accelerate the development of smart industry. However, with the dramatic increase in real-time IIoT applications, it is a great challenge to support fast response time, low latency, and efficient bandwidth utilization. To address this issue, Time Sensitive Network (TSN) is recently researched to realize low latency communication via deterministic scheduling. To the best of our knowledge, the combinability of multiple flows, which can significantly affect the scheduling performance, has never been systematically analyzed before. In this article, we first analyze the combinability problem. Then a non-collision theory based deterministic scheduling (NDS) method is proposed to achieve ultra-low latency communication for the time-sensitive flows. Moreover, to improve bandwidth utilization, a dynamic queue scheduling (DQS) method is presented for the best-effort flows. Experiment results demonstrate that NDS/DQS can well support deterministic ultra-low latency services and guarantee efficient bandwidth utilization.

cs.NI↗

arXiv2022

Practical Lossless Federated Singular Vector Decomposition over Billion-Scale Data

With the enactment of privacy-preserving regulations, e.g., GDPR, federated SVD is proposed to enable SVD-based applications over different data sources without revealing the original data. However, many SVD-based applications cannot be well supported by existing federated SVD solutions. The crux is that these solutions, adopting either differential privacy (DP) or homomorphic encryption (HE), suffer from accuracy loss caused by unremovable noise or degraded efficiency due to inflated data. In this paper, we propose FedSVD, a practical lossless federated SVD method over billion-scale data, which can simultaneously achieve lossless accuracy and high efficiency. At the heart of FedSVD is a lossless matrix masking scheme delicately designed for SVD: 1) While adopting the masks to protect private data, FedSVD completely removes them from the final results of SVD to achieve lossless accuracy; and 2) As the masks do not inflate the data, FedSVD avoids extra computation and communication overhead during the factorization to maintain high efficiency. Experiments with real-world datasets show that FedSVD is over 10000 times faster than the HE-based method and has 10 orders of magnitude smaller error than the DP-based solution on SVD tasks. We further build and evaluate FedSVD over three real-world applications: principal components analysis (PCA), linear regression (LR), and latent semantic analysis (LSA), to show its superior performance in practice. On federated LR tasks, compared with two state-of-the-art solutions: FATE and SecureML, FedSVD-LR is 100 times faster than SecureML and 10 times faster than FATE.

cs.DC↗

arXiv2022

Secure Forward Aggregation for Vertical Federated Neural Networks

Vertical federated learning (VFL) is attracting much attention because it enables cross-silo data cooperation in a privacy-preserving manner. While most research works in VFL focus on linear and tree models, deep models (e.g., neural networks) are not well studied in VFL. In this paper, we focus on SplitNN, a well-known neural network framework in VFL, and identify a trade-off between data security and model performance in SplitNN. Briefly, SplitNN trains the model by exchanging gradients and transformed data. On the one hand, SplitNN suffers from the loss of model performance since multiply parties jointly train the model using transformed data instead of raw data, and a large amount of low-level feature information is discarded. On the other hand, a naive solution of increasing the model performance through aggregating at lower layers in SplitNN (i.e., the data is less transformed and more low-level feature is preserved) makes raw data vulnerable to inference attacks. To mitigate the above trade-off, we propose a new neural network protocol in VFL called Security Forward Aggregation (SFA). It changes the way of aggregating the transformed data and adopts removable masks to protect the raw data. Experiment results show that networks with SFA achieve both data security and high model performance.

cs.CR↗

arXiv2022

Practical and Secure Federated Recommendation with Personalized Masks

Federated recommendation addresses the data silo and privacy problems altogether for recommender systems. Current federated recommender systems mainly utilize cryptographic or obfuscation methods to protect the original ratings from leakage. However, the former comes with extra communication and computation costs, and the latter damages model accuracy. Neither of them could simultaneously satisfy the real-time feedback and accurate personalization requirements of recommender systems. In this paper, we proposed federated masked matrix factorization (FedMMF) to protect the data privacy in federated recommender systems without sacrificing efficiency and effectiveness. In more details, we introduce the new idea of personalized mask generated only from local data and apply it in FedMMF. On the one hand, personalized mask offers protection for participants' private data without effectiveness loss. On the other hand, combined with the adaptive secure aggregation protocol, personalized mask could further improve efficiency. Theoretically, we provide security analysis for personalized mask. Empirically, we also show the superiority of the designed model on different real-world data sets.

cs.IR↗

arXiv2022

Rare Gems: Finding Lottery Tickets at Initialization

Large neural networks can be pruned to a small fraction of their original size, with little loss in accuracy, by following a time-consuming "train, prune, re-train" approach. Frankle & Carbin conjecture that we can avoid this by training "lottery tickets", i.e., special sparse subnetworks found at initialization, that can be trained to high accuracy. However, a subsequent line of work by Frankle et al. and Su et al. presents concrete evidence that current algorithms for finding trainable networks at initialization, fail simple baseline comparisons, e.g., against training random sparse subnetworks. Finding lottery tickets that train to better accuracy compared to simple baselines remains an open problem. In this work, we resolve this open problem by proposing Gem-Miner which finds lottery tickets at initialization that beat current baselines. Gem-Miner finds lottery tickets trainable to accuracy competitive or better than Iterative Magnitude Pruning (IMP), and does so up to $19\times$ faster.

cs.LG↗

arXiv2022

SeqDialN: Sequential Visual Dialog Networks in Joint Visual-Linguistic Representation Space

In this work, we formulate a visual dialog as an information flow in which each piece of information is encoded with the joint visual-linguistic representation of a single dialog round. Based on this formulation, we consider the visual dialog task as a sequence problem consisting of ordered visual-linguistic vectors. For featurization, we use a Dense Symmetric Co-Attention network as a lightweight vison-language joint representation generator to fuse multimodal features (i.e., image and text), yielding better computation and data efficiencies. For inference, we propose two Sequential Dialog Networks (SeqDialN): the first uses LSTM for information propagation (IP) and the second uses a modified Transformer for multi-step reasoning (MR). Our architecture separates the complexity of multimodal feature fusion from that of inference, which allows simpler design of the inference engine. IP based SeqDialN is our baseline with a simple 2-layer LSTM design that achieves decent performance. MR based SeqDialN, on the other hand, recurrently refines the semantic question/history representations through the self-attention stack of Transformer and produces promising results on the visual dialog task. On VisDial v1.0 test-std dataset, our best single generative SeqDialN achieves 62.54% NDCG and 48.63% MRR; our ensemble generative SeqDialN achieves 63.78% NDCG and 49.98% MRR, which set a new state-of-the-art generative visual dialog model. We fine-tune discriminative SeqDialN with dense annotations and boost the performance up to 72.41% NDCG and 55.11% MRR. In this work, we discuss the extensive experiments we have conducted to demonstrate the effectiveness of our model components. We also provide visualization for the reasoning process from the relevant conversation rounds and discuss our fine-tuning methods. Our code is available at https://github.com/xiaoxiaoheimei/SeqDialN

cs.CV↗

arXiv2022

High Spatial and Temporal Resolution NIR-IIb Gastrointestinal Imaging in Mice

Conventional biomedical imaging modalities, including endoscopy, X-rays, and magnetic resonance, are invasive and cannot provide sufficient spatial and temporal resolutions for regular imaging of gastrointestinal (GI) tract to guide prognosis and therapy of GI diseases. Here we report a non-invasive method for optical imaging of GI tract. It is based on a new type of lanthanide-doped nanocrystal with near-infrared (NIR) excitation at 980 nm and second NIR window (NIR-IIb) (1500~1700 nm) fluorescence emission at around 1530 nm. The rational design and controlled synthesis of nanocrystals with high brightness have led to an absolute quantum yield (QY) up to 48.6%. Further benefitting from the minimized scattering through the NIR-IIb window, we enhanced the spatial resolution by 3 times compared with the other NIR-IIa (1000~1500 nm) contract agents for GI tract imaging. The approach also led to a high temporal resolution of 8 frames per second, so that the moment of mice intestinal peristalsis happened in one minute can be captured. Furthermore, with a light-sheet imaging system, we demonstrated a three-dimensional (3D) imaging of the stereoscopic structure of the GI tract. Moreover, we successfully translate these advances to diagnose inflammatory bowel disease (IBD) in a pre-clinical model of mice colitis.

physics.med-ph↗

arXiv2022

Inflation-induced aneurysm formation and evolution in graded cylindrical tubes of arbitrary thickness

We study the initiation and evolution of aneurysmal morphology in a pressurized soft tube where the elastic modulus is non-uniform in the radial direction. The primary deformation prior to instability is characterized within the framework of nonlinear elasticity for a general material constitution and a generic modulus gradient. To unravel the influence of modulus gradient on aneurysm formation, we employ the incompressible Gent model and select three representative modulus gradients, including a linear, an exponential, and a sinusoidal function. In particular, the sinusoidal distribution can be used to model actual artery structure. In addition, two prototypical loading conditions are considered, namely, either the resultant axial force or the axial length can be fixed. Based on an explicit bifurcation condition in terms of the internal pressure and the resultant axial force for aneurysm formation or localized bulging, an exhaustive theoretical analysis on bulge initiation is carried out and the effect of geometric and material parameters and modulus gradient on the critical stretch generating localized bulging is revealed. It turns out that the modulus mismatch, as well as the position of maximum modulus, can dramatically affect the onset of localized bulging. Then we analytically elucidate the influence of modulus gradient on bulge propagation and conduct a finite element analysis of bulge evolution based on a robust finite element model established in Abaqus by UHYPER subroutine coding. Interestingly, it is found that a sinusoidally distributed modulus has negligible influence on the critical stretch of bulge initiation, the deformation process of bugle growth, and the maximum size of a bulge. The current analysis can provide useful insight into the biological evolution of human artery and into localized instabilities in graded structures.

cond-mat.soft↗

arXiv2022

Phonon-mediated superconductivity in two-dimensional hydrogenated phosphorus carbide: HPC$_{3}$

In the recent years, three-dimensional (3D) high-temperature superconductors at ultrahigh pressure have been reported, typical examples are the polyhydrides H$_{3}$S, LaH$_{10}$, and YH$_{9}$, etc. To find high-temperature superconductors in two-dimensional (2D) at atmosphere pressure is another research hotspot. Here, we investigated the possible superconductivity in a hydrogenated monolayer phosphorus carbide based on first-principles calculations. The results reveal that monolayer PC$_{3}$ transforms from a semiconductor to a metal after hydrogenation. Interestingly, the C-$π$-bonding band contributes most to the states at the Fermi level. Based on the electron-phonon coupling mechanism, it is found that the electron-phonon coupling constant of HPC$_{3}$ is 0.95, which mainly origins from the coupling of C-$π$ electrons with the in-plane vibration modes of C and H. The calculated critical temperature $T_{c}$ is 31.0 K, which is higher than most of the 2D superconductors. By further applying biaxial tensile strain of 3$\%$, the $T_{c}$ can be boosted to 57.3 K, exceeding the McMillan limit. Thus, hydrogenation and strain are effective ways for increasing the superconducting $T_{c}$ of 2D materials.

cond-mat.supr-con↗

arXiv2022

DS-Sync: Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training

Bulk synchronous parallel (BSP) is the de-facto paradigm for distributed DNN training in today's production clusters. However, due to the global synchronization nature, its performance can be significantly influenced by network bottlenecks caused by either static topology heterogeneity or dynamic bandwidth contentions. Existing solutions, either system-level optimizations strengthening BSP (e.g., Ring or Hierarchical All-reduce) or algorithmic optimizations replacing BSP (e.g., ASP or SSP, which relax the global barriers), do not completely solve the problem, as they may still suffer from communication inefficiency or risk convergence inaccuracy. In this paper, we present a novel divide-and-shuffle synchronization (DS-Sync) to realize communication efficiency without sacrificing convergence accuracy for distributed DNN training. At its heart, by taking into account the network bottlenecks, DS-Sync improves communication efficiency by dividing workers into non-overlap groups to synchronize independently in a bottleneck-free manner. Meanwhile, it maintains convergence accuracy by iteratively shuffling workers among different groups to ensure a global consensus. We theoretically prove that DS-Sync converges properly in non-convex and smooth conditions like DNN. We further implement DS-Sync and integrate it with PyTorch, and our testbed experiments show that DS-Sync can achieve up to $94\%$ improvements on the end-to-end training time with existing solutions while maintaining the same accuracy.

cs.LG↗

arXiv2021

Parametric resonance of spin waves in ferromagnetic nanowires tuned by spin Hall torque

We present a joint experimental and theoretical study of parametric resonance of spin wave eigenmodes in Ni$_{80}$Fe$_{20}$/Pt bilayer nanowires. Using electrically detected magnetic resonance, we measure the spectrum of spin wave eigenmodes in transversely magnetized nanowires and study parametric excitation of these eigenmodes by a microwave magnetic field. We also develop an analytical theory of spin wave eigenmodes and their parametric excitation in the nanowire geometry that takes into account magnetic dilution at the nanowire edges. We measure tuning of the parametric resonance threshold by antidamping spin Hall torque from a direct current for the edge and bulk eigenmodes, which allows us to independently evaluate frequency, damping and ellipticity of the modes. We find good agreement between theory and experiment for parametric resonance of the bulk eigenmodes but significant discrepancies arise for the edge modes. The data reveals that ellipticity of the edge modes is significantly lower than expected, which can be attributed to strong modification of magnetism at the nanowire edges. Our work demonstrates that parametric resonance of spin wave eigenmodes is a sensitive probe of magnetic properties at edges of thin-film nanomagnets.

cond-mat.mes-hall↗

arXiv2021

Natural Language Understanding with Privacy-Preserving BERT

Privacy preservation remains a key challenge in data mining and Natural Language Understanding (NLU). Previous research shows that the input text or even text embeddings can leak private information. This concern motivates our research on effective privacy preservation approaches for pretrained Language Models (LMs). We investigate the privacy and utility implications of applying dx-privacy, a variant of Local Differential Privacy, to BERT fine-tuning in NLU applications. More importantly, we further propose privacy-adaptive LM pretraining methods and show that our approach can boost the utility of BERT dramatically while retaining the same level of privacy protection. We also quantify the level of privacy preservation and provide guidance on privacy configuration. Our experiments and findings lay the groundwork for future explorations of privacy-preserving NLU with pretrained LMs.

cs.CL↗

arXiv2021

Quantum compressed sensing of ultra-wideband radio-frequency signal

Real-time sensing of ultra-wideband radio-frequency signal with high frequency resolution is challenging, which is confined by the sampling rate of electronic analog-to-digital converter and the capability of digital signal processing. By combining quantum mechanics with compressed sensing, quantum compressed sensing is proposed for wideband radio-frequency signal frequency measurement. By using an electro-optical crystal as a sensor which modulates the wave function of the coherent photons with the signal to be measured. The frequency spectrum could be recovered by detecting the modulated sparse photons with a low time-jitter single-photon detector and a time-to-digital converter. More than 50 GHz real-time analysis bandwidth is demonstrated with the Fourier transform limit resolution. The further simulation shows it can be extended to more than 300 GHz with the present technologies.

quant-ph↗

arXiv2021

The Threat of Offensive AI to Organizations

AI has provided us with the ability to automate tasks, extract information from vast amounts of data, and synthesize media that is nearly indistinguishable from the real thing. However, positive tools can also be used for negative purposes. In particular, cyber adversaries can use AI (such as machine learning) to enhance their attacks and expand their campaigns. Although offensive AI has been discussed in the past, there is a need to analyze and understand the threat in the context of organizations. For example, how does an AI-capable adversary impact the cyber kill chain? Does AI benefit the attacker more than the defender? What are the most significant AI threats facing organizations today and what will be their impact on the future? In this survey, we explore the threat of offensive AI on organizations. First, we present the background and discuss how AI changes the adversary's methods, strategies, goals, and overall attack model. Then, through a literature review, we identify 33 offensive AI capabilities which adversaries can use to enhance their attacks. Finally, through a user study spanning industry and academia, we rank the AI threats and provide insights on the adversaries.

cs.AI↗