arXiv subjects

Chen Luo

Publications and source records attributed to Chen Luo.

103 records · Page 6Linked to original sources

arXiv2019

A Simulation Framework for Fast Design Space Exploration of Unmanned Air System Traffic Management Policies

The number of daily small Unmanned Aircraft Systems (sUAS) operations in uncontrolled low altitude airspace is expected to reach into the millions. UAS Traffic Management (UTM) is an emerging concept aiming at the safe and efficient management of such very dense traffic, but few studies are addressing the policies to accommodate such demand and the required ground infrastructure in suburban or urban environments. Searching for the optimal air traffic management policy is a combinatorial optimization problem with intractable complexity when the number of sUAS and the constraints increases. As the demands on the airspace increase and traffic patterns get complicated, it is difficult to forecast the potential low altitude airspace hotspots and the corresponding ground resource requirements. This work presents a Multi-agent Air Traffic and Resource Usage Simulation (MATRUS) framework that aims for fast evaluation of different air traffic management policies and the relationship between policy, environment and resulting traffic patterns. It can also be used as a tool to decide the resource distribution and launch site location in the planning of a next-generation smart city. As a case study, detailed comparisons are provided for the sUAS flight time, conflict ratio, cellular communication resource usage, for a managed (centrally coordinated) and unmanaged (free flight) traffic scenario.

eess.SY↗

arXiv2019

Palladium Diselenide Long-Wavelength Infrared Photodetector with High Sensitivity and Stability

A long-wavelength infrared (IR) photodetector based on two-dimensional materials working at room temperature would have wide applications in many aspects in remote sensing, thermal imaging, biomedical optics, and medical imaging. However, sub-bandgap light detection in graphene and black phosphorus has been a long-standing scientific challenge because of low photoresponsivity, instability in the air and highdark current. In this study, we report a highly sensitive, air-stable and operable long-wavelength infrared photodetector at room temperature based on PdSe2 phototransistors and its heterostructure. A high photoresponsivity of ~42.1 AW-1 (at 10.6 μm) was demonstrated, which is an order of magnitude higher than the current record of platinum diselenide. Moreover, the dark current and noise power density were suppressed effectively by fabricating a van der Waals heterostructure. This work fundamentally contributes to establishing long-wavelength infrared detection by PdSe2 at the forefront of long-IR two-dimensional-materials-based photonics.

physics.app-ph↗

arXiv2019

Efficient Data Ingestion and Query Processing for LSM-Based Storage Systems

In recent years, the Log Structured Merge (LSM) tree has been widely adopted by NoSQL and NewSQL systems for its superior write performance. Despite its popularity, however, most existing work has focused on LSM-based key-value stores with only a primary LSM-tree index; auxiliary structures, which are critical for supporting ad-hoc queries, have received much less attention. In this paper, we focus on efficient data ingestion and query processing for general-purpose LSM-based storage systems. We first propose and evaluate a series of optimizations for efficient batched point lookups, significantly improving the range of applicability of LSM-based secondary indexes. We then present several new and efficient maintenance strategies for LSM-based storage systems. Finally, we have implemented and experimentally evaluated the proposed techniques in the context of the Apache AsterixDB system, and we present the results here.

cs.DB↗

arXiv2018

X-ray magnetic linear dichroism as a probe for non-collinear magnetic state in ferrimagnetic single layer exchange bias systems

Ferrimagnetic alloys are extensively studied for their unique magnetic properties leading to possible applications in perpendicular magnetic recording, due to their deterministic ultrafast switching and heat assisted magnetic recording capabilities. On a prototype ferrimagnetic alloy we demonstrate fascinating properties that occur close to a critical temperature where the magnetization is vanishing, just as in an antiferromagnet. From the X-ray magnetic circular dichroism measurements, an anomalous 'wing shape' hysteresis loop is observed slightly above the compensation temperature. This bears the characteristics of an intrinsic exchange bias effect, referred to as atomic exchange bias. We further exploit the X-ray magnetic linear dichroism (XMLD) contrast for probing non-collinear states which allows us to discriminate between two main reversal mechanisms, namely perpendicular domain wall formation versus spin-flop transition. Ultimately, we analyze the elemental magnetic moments for the surface and the bulk parts, separately, which allows to identify in the phase diagram the temperature window where this effect takes place. Moreover, we suggests that this effect is a general phenomenon in ferrimagnetic thin films which may also contribue to the understanding of the mechanism behind the all optical switching effect.

cond-mat.mtrl-sci↗

arXiv2018

Scaling-up Split-Merge MCMC with Locality Sensitive Sampling (LSS)

Split-Merge MCMC (Monte Carlo Markov Chain) is one of the essential and popular variants of MCMC for problems when an MCMC state consists of an unknown number of components. It is well known that state-of-the-art methods for split-merge MCMC do not scale well. Strategies for rapid mixing requires smart and informative proposals to reduce the rejection rate. However, all known smart proposals involve expensive operations to suggest informative transitions. As a result, the cost of each iteration is prohibitive for massive scale datasets. It is further known that uninformative but computationally efficient proposals, such as random split-merge, leads to extremely slow convergence. This tradeoff between mixing time and per update cost seems hard to get around. In this paper, we show a sweet spot. We leverage some unique properties of weighted MinHash, which is a popular LSH, to design a novel class of split-merge proposals which are significantly more informative than random sampling but at the same time efficient to compute. Overall, we obtain a superior tradeoff between convergence and per update cost. As a direct consequence, our proposals are around 6X faster than the state-of-the-art sampling methods on two large real datasets KDDCUP and PubMed with several millions of entities and thousands of clusters.

cs.LG↗

arXiv2018

Want to bring a community together? Create more sub-communities

Understanding overlapping community structures is crucial for network analysis and prediction. AGM (Affiliation Graph Model) is one of the favorite models for explaining the densely overlapped community structures. In this paper, we thoroughly re-investigate the assumptions made by the AGM model on real datasets. We find that the AGM model is not sufficient to explain several empirical behaviors observed in popular real-world networks. To our surprise, all our experimental results can be explained by a parameter-free hypothesis, leading to more straightforward modeling than AGM which has many parameters. Based on these findings, we propose a parameter-free Jaccard-based Affiliation Graph (JAG) model which models the probability of edge as a network specific constant times the Jaccard similarity between community sets associated with the individuals. Our modeling is significantly simpler than AGM, and it eliminates the need of associating a parameter, the probability value, with each community. Furthermore, JAG model naturally explains why (and in fact when) overlapping communities are densely connected. Based on these observations, we propose a new community-driven friendship formation process, which mathematically recovers the JAG model. JAG is the first model that points towards a direct causal relationship between tight connections in the given community with the number of overlapping communities inside it. Thus, \emph{the most effective way to bring a community together is to form more sub-communities within it.} The community detection algorithm based on our modeling demonstrates a significantly simple algorithm with state-of-the-art accuracy on six real-world network datasets compared to the existing link analysis based methods.

cs.SI↗

arXiv2018

Learning Scene-specific Object Detectors Based on a Generative-Discriminative Model with Minimal Supervision

One object class may show large variations due to diverse illuminations, backgrounds and camera viewpoints. Traditional object detection methods often perform worse under unconstrained video environments. To address this problem, many modern approaches model deep hierarchical appearance representations for object detection. Most of these methods require a timeconsuming training process on large manual labelling sample set. In this paper, the proposed framework takes a remarkably different direction to resolve the multi-scene detection problem in a bottom-up fashion. First, a scene-specific objector is obtained from a fully autonomous learning process triggered by marking several bounding boxes around the object in the first video frame via a mouse. Here the human labeled training data or a generic detector are not needed. Second, this learning process is conveniently replicated many times in different surveillance scenes and results in particular detectors under various camera viewpoints. Thus, the proposed framework can be employed in multi-scene object detection applications with minimal supervision. Obviously, the initial scene-specific detector, initialized by several bounding boxes, exhibits poor detection performance and is difficult to improve with traditional online learning algorithm. Consequently, we propose Generative-Discriminative model to partition detection response space and assign each partition an individual descriptor that progressively achieves high classification accuracy. A novel online gradual optimized process is proposed to optimize the Generative-Discriminative model and focus on the hard samples.Experimental results on six video datasets show our approach achieves comparable performance to robust supervised methods, and outperforms the state of the art self-learning methods under varying imaging conditions.

cs.CV↗

arXiv2017

Accelerating Dependency Graph Learning from Heterogeneous Categorical Event Streams via Knowledge Transfer

Dependency graph, as a heterogeneous graph representing the intrinsic relationships between different pairs of system entities, is essential to many data analysis applications, such as root cause diagnosis, intrusion detection, etc. Given a well-trained dependency graph from a source domain and an immature dependency graph from a target domain, how can we extract the entity and dependency knowledge from the source to enhance the target? One way is to directly apply a mature dependency graph learned from a source domain to the target domain. But due to the domain variety problem, directly using the source dependency graph often can not achieve good performance. Traditional transfer learning methods mainly focus on numerical data and are not applicable. In this paper, we propose ACRET, a knowledge transfer based model for accelerating dependency graph learning from heterogeneous categorical event streams. In particular, we first propose an entity estimation model to filter out irrelevant entities from the source domain based on entity embedding and manifold learning. Only the entities with statistically high correlations are transferred to the target domain. On the surviving entities, we propose a dependency construction model for constructing the unbiased dependency relationships by solving a two-constraint optimization problem. The experimental results on synthetic and real-world datasets demonstrate the effectiveness and efficiency of ACRET. We also apply ACRET to a real enterprise security system for intrusion detection. Our method is able to achieve superior detection performance at least 20 days lead lag time in advance with more than 70% accuracy.

cs.AI↗

arXiv2017

Arrays of (locality-sensitive) Count Estimators (ACE): High-Speed Anomaly Detection via Cache Lookups

Anomaly detection is one of the frequent and important subroutines deployed in large-scale data processing systems. Even being a well-studied topic, existing techniques for unsupervised anomaly detection require storing significant amounts of data, which is prohibitive from memory and latency perspective. In the big-data world existing methods fail to address the new set of memory and latency constraints. In this paper, we propose ACE (Arrays of (locality-sensitive) Count Estimators) algorithm that can be 60x faster than the ELKI package~\cite{DBLP:conf/ssd/AchtertBKSZ09}, which has the fastest implementation of the unsupervised anomaly detection algorithms. ACE algorithm requires less than $4MB$ memory, to dynamically compress the full data information into a set of count arrays. These tiny $4MB$ arrays of counts are sufficient for unsupervised anomaly detection. At the core of the ACE algorithm, there is a novel statistical estimator which is derived from the sampling view of Locality Sensitive Hashing(LSH). This view is significantly different and efficient than the widely popular view of LSH for near-neighbor search. We show the superiority of ACE algorithm over 11 popular baselines on 3 benchmark datasets, including the KDD-Cup99 data which is the largest available benchmark comprising of more than half a million entries with ground truth anomaly labels.

cs.DB↗

arXiv2016

SSH (Sketch, Shingle, & Hash) for Indexing Massive-Scale Time Series

Similarity search on time series is a frequent operation in large-scale data-driven applications. Sophisticated similarity measures are standard for time series matching, as they are usually misaligned. Dynamic Time Warping or DTW is the most widely used similarity measure for time series because it combines alignment and matching at the same time. However, the alignment makes DTW slow. To speed up the expensive similarity search with DTW, branch and bound based pruning strategies are adopted. However, branch and bound based pruning are only useful for very short queries (low dimensional time series), and the bounds are quite weak for longer queries. Due to the loose bounds branch and bound pruning strategy boils down to a brute-force search. To circumvent this issue, we design SSH (Sketch, Shingle, & Hashing), an efficient and approximate hashing scheme which is much faster than the state-of-the-art branch and bound searching technique: the UCR suite. SSH uses a novel combination of sketching, shingling and hashing techniques to produce (probabilistic) indexes which align (near perfectly) with DTW similarity measure. The generated indexes are then used to create hash buckets for sub-linear search. Our results show that SSH is very effective for longer time sequence and prunes around 95% candidates, leading to the massive speedup in search with DTW. Empirical results on two large-scale benchmark time series data show that our proposed method can be around 20 times faster than the state-of-the-art package (UCR suite) without any significant loss in accuracy.

cs.IR↗

arXiv2014

Hete-CF: Social-Based Collaborative Filtering Recommendation using Heterogeneous Relations

Collaborative filtering algorithms haven been widely used in recommender systems. However, they often suffer from the data sparsity and cold start problems. With the increasing popularity of social media, these problems may be solved by using social-based recommendation. Social-based recommendation, as an emerging research area, uses social information to help mitigate the data sparsity and cold start problems, and it has been demonstrated that the social-based recommendation algorithms can efficiently improve the recommendation performance. However, few of the existing algorithms have considered using multiple types of relations within one social network. In this paper, we investigate the social-based recommendation algorithms on heterogeneous social networks and proposed Hete-CF, a Social Collaborative Filtering algorithm using heterogeneous relations. Distinct from the exiting methods, Hete-CF can effectively utilize multiple types of relations in a heterogeneous social network. In addition, Hete-CF is a general approach and can be used in arbitrary social networks, including event based social networks, location based social networks, and any other types of heterogeneous information networks associated with social information. The experimental results on two real-world data sets, DBLP (a typical heterogeneous information network) and Meetup (a typical event based social network) show the effectiveness and efficiency of our algorithm.

cs.IR↗

arXiv2014

SINAP surface preparation processing for 500MHz superconducting cavity

This paper illustrates the design, fabrication and experiment results of surface preparation system for 500MHz superconducting cavity at Shanghai Institute of Applied Physic (SINAP). The SINAP established a set of clean room, buffered chemical polishing equipment, and high pressure ultra-pure water rinsing facility. The whole surface preparation procedure has been operated successfully and verified by the successful vertical tests of 500MHz single cell superconducting cavity.

physics.acc-ph↗

arXiv2014

Studies of LL-type 500MHz 5-cell superconducting cavity at SINAP

A low loss (LL) type 500 MHz 5-cell superconducting niobium prototype cavity with large beam aperture has been developed successfully including the optimization, the deep drawing and electron beam welding, the surface treatment and the vertical testing. The performance of the fundamental mode was optimized and the higher order modes were damped by adopting an enlarged beam pipe for propagation. Surface preparation or treatment including mechanical polishing, buffered chemical polishing and high pressure rinsing with ultra-pure water and so on was carried out carefully to promise a perfect inner surface condition. The vertical testing results show that the accelerating voltage higher than 7.5 MV was obtained while the quality factor was better than 1E9 at 4.2 K. No obvious multipacting or field emission was found during the test. However, a quench happened while increasing the field a little higher than 7.5 MV that at present limited the cavity performance.

physics.acc-ph↗