Searcharxiv⌕ Search

arXiv subjects

Jiaqi Li

Publications and source records attributed to Jiaqi Li.

At least 217 records · Page 12Linked to original sources

Robust penalized empirical likelihood in high dimensional longitudinal data analysis

As an effective nonparametric method, empirical likelihood (EL) is appealing in combining estimating equations flexibly and adaptively for incorporating data information. To select important variables and estimating equations in the sparse high-dimensional model, we consider a penalized EL method based on robust estimating functions by applying two penalty functions for regularizing the regression parameters and the associated Lagrange multipliers simultaneously, which allows the dimensionalities of both regression parameters and estimating equations to grow exponentially with the sample size. A first inspection on the robustness of estimating equations contributing to the estimating equations selection and variable selection is discussed from both theoretical perspective and intuitive simulation results in this paper. The proposed method can improve the robustness and effectiveness when the data have underlying outliers or heavy tails in the response variables and/or covariates. The robustness of the estimator is measured via the bounded influence function, and the oracle properties are also established under some regularity conditions. Extensive simulation studies and a yeast cell data are used to evaluate the performance of the proposed method. The numerical results reveal that the robustness of sparse estimating equations selection fundamentally enhances variable selection accuracy when the data have heavy tails and/or include underlying outliers.

stat.ME↗

Aggregating From Multiple Target-Shifted Sources

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain. Hence, a crucial aspect is to properly combine different sources based on their relations. In this paper, we analyzed the problem for aggregating source domains with different label distributions, where most recent source selection approaches fail. Our proposed algorithm differs from previous approaches in two key ways: the model aggregates multiple sources mainly through the similarity of semantic conditional distribution rather than marginal distribution; the model proposes a \emph{unified} framework to select relevant sources for three popular scenarios, i.e., domain adaptation with limited label on target domain, unsupervised domain adaptation and label partial unsupervised domain adaption. We evaluate the proposed method through extensive experiments. The empirical results significantly outperform the baselines.

cs.LG↗

Robust approach for variable selection with high dimensional Logitudinal data analysis

This paper proposes a new robust smooth-threshold estimating equation to select important variables and automatically estimate parameters for high dimensional longitudinal data. A novel working correlation matrix is proposed to capture correlations within the same subject. The proposed procedure works well when the number of covariates p increases as the number of subjects n increases. The proposed estimates are competitive with the estimates obtained with the true correlation structure, especially when the data are contaminated. Moreover, the proposed method is robust against outliers in the response variables and/or covariates. Furthermore, the oracle properties for robust smooth-threshold estimating equations under "large n, diverging p" are established under some regularity conditions. Extensive simulation studies and a yeast cell cycle data are used to evaluate the performance of the proposed method, and results show that our proposed method is competitive with existing robust variable selection procedures.

stat.ME↗

Robust error bounds for quantised and pruned neural networks

With the rise of smartphones and the internet-of-things, data is increasingly getting generated at the edge on local, personal devices. For privacy, latency and energy saving reasons, this shift is causing machine learning algorithms to move towards decentralisation with the data and algorithms stored, and even trained, locally on devices. The device hardware becomes the main bottleneck for model capability in this set-up, creating a need for slimmed down, more efficient neural networks. Neural network pruning and quantisation are two methods that have been developed for this, with both approaches demonstrating impressive results in reducing the computational cost without sacrificing significantly on model performance. However, the understanding behind these reduction methods remains underdeveloped. To address this issue, a semi-definite program is introduced to bound the worst-case error caused by pruning or quantising a neural network. The method can be applied to many neural network structures and nonlinear activation functions with the bounds holding robustly for all inputs in specified sets. It is hoped that the computed bounds will provide certainty to the performance of these algorithms when deployed on safety-critical systems.

cs.LG↗

DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehension

Multiparty Dialogue Machine Reading Comprehension (MRC) differs from traditional MRC as models must handle the complex dialogue discourse structure, previously unconsidered in traditional MRC. To fully exploit such discourse structure in multiparty dialogue, we present a discourse-aware dialogue graph neural network, DADgraph, which explicitly constructs the dialogue graph using discourse dependency links and discourse relations. To validate our model, we perform experiments on the Molweni corpus, a large-scale MRC dataset built over multiparty dialogue annotated with discourse structure. Experiments on Molweni show that our discourse-aware model achieves statistically significant improvements compared against strong neural network MRC baselines.

cs.CL↗

Rapid Robust Principal Component Analysis: CUR Accelerated Inexact Low Rank Estimation

Robust principal component analysis (RPCA) is a widely used tool for dimension reduction. In this work, we propose a novel non-convex algorithm, coined Iterated Robust CUR (IRCUR), for solving RPCA problems, which dramatically improves the computational efficiency in comparison with the existing algorithms. IRCUR achieves this acceleration by employing CUR decomposition when updating the low rank component, which allows us to obtain an accurate low rank approximation via only three small submatrices. Consequently, IRCUR is able to process only the small submatrices and avoid expensive computing on the full matrix through the entire algorithm. Numerical experiments establish the computational advantage of IRCUR over the state-of-art algorithms on both synthetic and real-world datasets.

stat.ML↗

Insights into ventilation hysteresis shift due to flow unsteadiness in ventilated supercavitation

Understanding ventilation strategy of a supercavity is important for designing high-speed underwater vehicles wherein an artificial gas pocket is created behind a flow separation device for drag reduction. Our study investigates the effect of flow unsteadiness on the ventilation requirements to form (CQf) and collapse (CQc) a supercavity. Imposing flow unsteadiness on the incoming flow has shown an increment in higher CQf at low free stream velocity and lower CQf at high free stream velocity. High-speed imaging reveals distinctly different behaviors in the recirculation region for low and high freestream velocity under unsteady flows. At low free stream velocities, the recirculation region formed downstream of a cavitator shifted vertically with flow unsteadiness, resulting in lower bubble collision and coalescence probability, which is critical for the supercavity formation process. The recirculation region negligibly changed with flow unsteadiness at high free stream velocity and less ventilation is required to form a supercavity compared to that of the steady incoming flow. Such a difference is attributed to the increased transverse Reynolds stress that aids bubble collision in a confined space of the recirculation region. CQc is found to heavily rely on the vertical component of the flow unsteadiness and the free stream velocity. Interfacial instability located upper rear of the supercavity develops noticeably with flow unsteadiness and additional bubbles formed by the distorted interface shed from the supercavity, resulting in an increased CQc. Further analysis on the quantification of such additional bubble leakage rate indicates that the development and amplitude of the interfacial instability accounts for the variation of CQc under a wide range of flow unsteadiness. Our study provides some insights on the design of a ventilation strategy for supercavitating vehicles in practice.

physics.flu-dyn↗

Synchrotron Microtomography and Neutron Radiography Characterization of the Microstruture and Water Absorption of Concrete from Pompeii

There is renewed interest in using advanced techniques to characterize ancient Roman concrete. In the present work, samples were drilled from the "Hospitium" in Pompeii and were analyzed by synchrotron microtomography (uCT) and neutron radiography to study how the microstructure, including the presence of induced cracks, affects their water adsorption. The water distribution and absorptivity were quantified by neutron radiography. The 3D crack propagation, pore size distribution and orientation, tortuosity, and connectivity were analyzed from uCT results using advanced imaging methods. The concrete characterization also included classical methods (e.g., differential thermal-thermogravimetric, X-ray diffractometry, and scanning electron microscopy). Ductile fracture patterns were observed once cracks were introduced. When compared to Portland cement mortar/concrete, Pompeii samples had relatively high porosity, low connectivity, and similar coefficient of capillary penetration. In addition, the permeability was predicted from models based on percolation theory and the pore structure data to evaluate the fluid transport properties.

physics.app-ph↗

Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure

Research into the area of multiparty dialog has grown considerably over recent years. We present the Molweni dataset, a machine reading comprehension (MRC) dataset with discourse structure built over multiparty dialog. Molweni's source samples from the Ubuntu Chat Corpus, including 10,000 dialogs comprising 88,303 utterances. We annotate 30,066 questions on this corpus, including both answerable and unanswerable questions. Molweni also uniquely contributes discourse dependency annotations in a modified Segmented Discourse Representation Theory (SDRT; Asher et al., 2016) style for all of its multiparty dialogs, contributing large-scale (78,245 annotated discourse relations) data to bear on the task of multiparty dialog discourse parsing. Our experiments show that Molweni is a challenging dataset for current MRC models: BERT-wwm, a current, strong SQuAD 2.0 performer, achieves only 67.7% F1 on Molweni's questions, a 20+% significant drop as compared against its SQuAD 2.0 performance.

cs.CL↗

Towards Efficiently Establishing Mutual Distrust Between Host Application and Enclave for SGX

Since its debut, SGX has been used in many applications, e.g., secure data processing. However, previous systems usually assume a trusted enclave and ignore the security issues caused by an untrusted enclave. For instance, a vulnerable (or even malicious) third-party enclave can be exploited to attack the host application and the rest of the system. In this paper, we propose an efficient mechanism to confine an untrusted enclave's behaviors. The threats of an untrusted enclave come from the enclave-host asymmetries. They can be abused to access arbitrary memory regions of its host application, jump to any code location after leaving the enclave and forge the stack register to manipulate the saved context. Our solution breaks such asymmetries and establishes mutual distrust between the host application and the enclave. It leverages Intel MPK for efficient memory isolation and the x86 single-step debugging mechanism to capture the event when an enclave is existing. It then performs the integrity check for the jump target and the stack pointer. We have solved two practical challenges and implemented a prototype system. The evaluation with multiple micro-benchmarks and representative real-world applications demonstrated the efficiency of our system, with less than 4% performance overhead.

cs.CR↗

Droplet evaporation residue indicating SARS-COV-2 survivability on surfaces

SARS-CoV-2 survives and remains viable on surfaces for several days under different environments as reported in recent studies. However, it is unclear how the viruses survive for such a long time and why their survivability varies across different surfaces. To address these questions, we conduct systematic experiments investigating the evaporation of droplets produced by a nebulizer and human-exhaled gas on surfaces. We found that these droplets do not disappear with evaporation, but instead shrink to a size of a few micrometers (referred to as residues), persist for more than 24 hours, and are highly durable against changes of environmental conditions. The characteristics of these residues change significantly across surface types. Specifically, surfaces with high thermal conductivity like copper do not leave any resolvable residues, while stainless steel, plastic, and glass surfaces form residues from a varying fraction of all deposited droplets at 40% relative humidity. Lowering humidity level suppresses the formation of residues while increasing humidity level enhances it. Our results suggest that these microscale residues can potentially insulate the virus against environmental changes, allowing them to survive inhospitable environments and remain infectious for prolonged durations after deposition. Our findings can also be extended to other viruses transmitted through respiratory droplets (e.g., SARS-CoV, flu viruses, etc.), and can thus lead to practical guidelines for disinfecting surfaces and other prevention measures (e.g., humidity control) for limiting viral transmission.

physics.med-ph↗

Risk assessment of airborne transmission of COVID-19 by asymptomatic individuals under different practical settings

The lack of quantitative risk assessment of airborne transmission of COVID-19 under practical settings leads to large uncertainties and inconsistencies in our preventive measures. Combining in situ measurements and numerical simulations, we quantify the exhaled particles from normal respiratory behaviors and their transport under elevator, small classroom and supermarket settings to evaluate the risk of inhaling potentially virus-containing particles. Our results show that the design of ventilation is critical for reducing the risk of particle encounters. Inappropriate design can significantly limit the efficiency of particle removal, create local hot spots with orders of magnitude higher risks, and enhance particle deposition causing surface contamination. Additionally, our measurements reveal the presence of substantial fraction of crystalline particles from normal breathing and its strong correlation with breathing depth.

physics.med-ph↗

Machine learning shadowgraph for particle size and shape characterization

Conventional image processing for particle shadow image is usually time-consuming and suffers degraded image segmentation when dealing with the images consisting of complex-shaped and clustered particles with varying backgrounds. In this paper, we introduce a robust learning-based method using a single convolution neural network (CNN) for analyzing particle shadow images. Our approach employs a two-channel-output U-net model to generate a binary particle image and a particle centroid image. The binary particle image is subsequently segmented through marker-controlled watershed approach with particle centroid image as the marker image. The assessment of this method on both synthetic and experimental bubble images has shown better performance compared to the state-of-art non-machine-learning method. The proposed machine learning shadow image processing approach provides a promising tool for real-time particle image analysis.

eess.IV↗

An Annotation Scheme of A Large-scale Multi-party Dialogues Dataset for Discourse Parsing and Machine Comprehension

In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension. The main goal of this project is to help understand multi-party dialogues. Our dataset is based on the Ubuntu Chat Corpus. For each multi-party dialogue, we annotate the discourse structure and question-answer pairs for dialogues. As we know, this is the first large scale corpus for multi-party dialogues discourse parsing, and we firstly propose the task for multi-party dialogues machine reading comprehension.

cs.CL↗

Effect of mounting strut and cavitator shape on the ventilation demand for ventilated supercavitation

The present work reports behaviors regarding the formation and collapse of a ventilated supercavity while varying the cavitator shapes, including triangle, disk, and cone and varying mounting struts. Three cavitators with the same frontal area are fabricated with 3D printing and mounted on a forward facing model (FFM). The ventilation requirements to generate (C_Qf) and sustain (C_Qc) a supercavity are tested over a wide range of Froude number (Fr) for each cavitator and compared with backward facing model(BFM). Compared to the triangle and disk cavitators, the cone-shaped cavitator requires the least amount of air to generate a supercavity in nearly all of the tested flow regime except very high Fr. The C_Qc of disk FFM is lower than that of its BFM counterpart at small Fr and exceeds the BFM C_Qc with further increase of Fr. The cone cavitator has the smallest C_Qc among all the cavitators across the range of Fr in our experiments. Simultaneous internal pressure and cavity dimension measurements are conducted to elucidate the cavity sustenance behaviors. The cone-generated cavity yields a significantly smaller maximum diameter and a shorter half-length. Cavity geometric information and cavity pressure measurements with high-speed imaging of re-entrant jet are employed to estimate the re-entrant jet momentum under different Fr for disk and cone cavitators. The estimated re-entrant jet momentum shows reasonable match with the ventilation air momentum under C_Qc in lower Fr for both cavitator cases, with the disk cavitator case yielding significantly stronger re-entrant jet, providing support to the re-entrant jet mechanism governing on the cavity collapse. Our study sheds some light on the cavitator design and ventilation strategy for a supercavitating vehicle in practice.

physics.flu-dyn↗

AI-based Two-Stage Intrusion Detection for Software Defined IoT Networks

Software Defined Internet of Things (SD-IoT) Networks profits from centralized management and interactive resource sharing which enhances the efficiency and scalability of IoT applications. But with the rapid growth in services and applications, it is vulnerable to possible attacks and faces severe security challenges. Intrusion detection has been widely used to ensure network security, but classical detection means are usually signature-based or explicit-behavior-based and fail to detect unknown attacks intelligently, which are hard to satisfy the requirements of SD-IoT Networks. In this paper, we propose an AI-based two-stage intrusion detection empowered by software defined technology. It flexibly captures network flows with a globle view and detects attacks intelligently through applying AI algorithms. We firstly leverage Bat algorithm with swarm division and Differential Mutation to select typical features. Then, we exploit Random forest through adaptively altering the weights of samples using weighted voting mechanism to classify flows. Evaluation results prove that the modified intelligent algorithms select more important features and achieve superior performance in flow classification. It is also verified that intelligent intrusion detection shows better accuracy with lower overhead comparied with existing solutions.

cs.CR↗

On the controller-stopper problems with controlled jumps

We analyze the continuous time zero-sum and cooperative controller-stopper games of Karatzas and Sudderth [Annals of Probability, 2001], Karatzas and Zamfirescu [Annals of Probability, 2008] and Karatzas and Zamfirescu [Applied Mathematics and Optimization, 2005] when the volatility of the state process is controlled as in Bayraktar and Huang [SIAM Journal on Control and Optimization, 2013] but additionally when the state process has controlled jumps. We perform this analysis by first resolving the stochastic target problems (of Soner and Touzi [SIAM Journal on Control and Optimization, 2002; Journal of European Mathematical Society, 2002]) with a cooperative or a non-cooperative stopper and then embedding the original problem into the latter set-up. Unlike in Bayraktar and Huang [SIAM Journal on Control and Optimization, 2013] our analysis relies crucially on the Stochastic Perron method of Bayraktar and Sirbu [SIAM Journal on Control and Optimization, 2013] but not the dynamic programming principle, which is difficult to prove directly for games.

math.OC↗

A Machine Learning Based Intrusion Detection System for Software Defined 5G Network

As an inevitable trend of future 5G networks, Software Defined architecture has many advantages in providing central- ized control and flexible resource management. But it is also confronted with various security challenges and potential threats with emerging services and technologies. As the focus of network security, Intrusion Detection Systems (IDS) are usually deployed separately without collaboration. They are also unable to detect novel attacks with limited intelligent abilities, which are hard to meet the needs of software defined 5G. In this paper, we propose an intelligent intrusion system taking the advances of software defined technology and artificial intelligence based on Software Defined 5G architecture. It flexibly combines security function mod- ules which are adaptively invoked under centralized management and control with a globle view. It can also deal with unknown intrusions by using machine learning algorithms. Evaluation results prove that the intelligent intrusion detection system achieves a better performance.

cs.CR↗