Searcharxiv⌕ Search

arXiv subjects

Hao Ren

Publications and source records attributed to Hao Ren.

53 records · Page 3Linked to original sources

Efficiency Boosting of Secure Cross-platform Recommender Systems over Sparse Data

Fueled by its successful commercialization, the recommender system (RS) has gained widespread attention. However, as the training data fed into the RS models are often highly sensitive, it ultimately leads to severe privacy concerns, especially when data are shared among different platforms. In this paper, we follow the tune of existing works to investigate the problem of secure sparse matrix multiplication for cross-platform RSs. Two fundamental while critical issues are addressed: preserving the training data privacy and breaking the data silo problem. Specifically, we propose two concrete constructions with significantly boosted efficiency. They are designed for the sparse location insensitive case and location sensitive case, respectively. State-of-the-art cryptography building blocks including homomorphic encryption (HE) and private information retrieval (PIR) are fused into our protocols with non-trivial optimizations. As a result, our schemes can enjoy the HE acceleration technique without privacy trade-offs. We give formal security proofs for the proposed schemes and conduct extensive experiments on both real and large-scale simulated datasets. Compared with state-of-the-art works, our two schemes compress the running time roughly by 10* and 2.8*. They also attain up to 15* and 2.3* communication reduction without accuracy loss.

cs.CR↗

Evaluating Generalization Ability of Convolutional Neural Networks and Capsule Networks for Image Classification via Top-2 Classification

Image classification is a challenging problem which aims to identify the category of object in the image. In recent years, deep Convolutional Neural Networks (CNNs) have been applied to handle this task, and impressive improvement has been achieved. However, some research showed the output of CNNs can be easily altered by adding relatively small perturbations to the input image, such as modifying few pixels. Recently, Capsule Networks (CapsNets) are proposed, which can help eliminating this limitation. Experiments on MNIST dataset revealed that capsules can better characterize the features of object than CNNs. But it's hard to find a suitable quantitative method to compare the generalization ability of CNNs and CapsNets. In this paper, we propose a new image classification task called Top-2 classification to evaluate the generalization ability of CNNs and CapsNets. The models are trained on single label image samples same as the traditional image classification task. But in the test stage, we randomly concatenate two test image samples which contain different labels, and then use the trained models to predict the top-2 labels on the unseen newly-created two label image samples. This task can provide us precise quantitative results to compare the generalization ability of CNNs and CapsNets. Back to the CapsNet, because it uses Full Connectivity (FC) mechanism among all capsules, it requires many parameters. To reduce the number of parameters, we introduce the Parameter-Sharing (PS) mechanism between capsules. Experiments on five widely used benchmark image datasets demonstrate the method significantly reduces the number of parameters, without losing the effectiveness of extracting features. Further, on the Top-2 classification task, the proposed PS CapsNets obtain impressive higher accuracy compared to the traditional CNNs and FC CapsNets by a large margin.

cs.CV↗

Compositional Coding Capsule Network with K-Means Routing for Text Classification

Text classification is a challenging problem which aims to identify the category of texts. In the process of training, word embeddings occupy a large part of parameters. Under the limitation of limited computing resources, it indirectly limits the ability of subsequent network designs. In order to reduce the number of parameters, the compositional coding mechanism has been proposed recently. Based on this, this paper further explores compositional coding and proposes a compositional weighted coding method. And we apply capsule network to model the relationship between word embeddings, a new routing algorithm, which is based on k-means clustering theory, is proposed to fully mine the relationship between word embeddings. Combined with our compositional weighted coding method and the routing algorithm, we design a neural network for text classification. Experiments conducted on eight challenging text classification datasets show that the proposed method achieves competitive accuracy compared to the state-of-the-art approach with significantly fewer parameters.

cs.LG↗

A Verification Framework for Certifying Learning-Based Safety-Critical Aviation Systems

We present a safety verification framework for design-time and run-time assurance of learning-based components in aviation systems. Our proposed framework integrates two novel methodologies. From the design-time assurance perspective, we propose offline mixed-fidelity verification tools that incorporate knowledge from different levels of granularity in simulated environments. From the run-time assurance perspective, we propose reachability- and statistics-based online monitoring and safety guards for a learning-based decision-making model to complement the offline verification methods. This framework is designed to be loosely coupled among modules, allowing the individual modules to be developed using independent methodologies and techniques, under varying circumstances and with different tool access. The proposed framework offers feasible solutions for meeting system safety requirements at different stages throughout the system development and deployment cycle, enabling the continuous learning and assessment of the system product.

eess.SY↗

DesCert: Design for Certification

The goal of the DARPA Automated Rapid Certification Of Software (ARCOS) program is to "automate the evaluation of software assurance evidence to enable certifiers to determine rapidly that system risk is acceptable." As part of this program, the DesCert project focuses on the assurance-driven development of new software. The DesCert team consists of SRI International, Honeywell Research, and the University of Washington. We have adopted a formal, tool-based approach to the construction of software artifacts that are supported by rigorous evidence. The DesCert workflow integrates evidence generation into a design process that goes from requirements capture and analysis to the decomposition of the high-level software requirements into architecture properties and software components with assertional contracts, and on to software that can be analyzed both dynamically and statically. The generated evidence is organized by means of an assurance ontology and integrated into the RACK knowledge base.

cs.SE↗

A Framework for Multi-stage Bonus Allocation in meal delivery Platform

Online meal delivery is undergoing explosive growth, as this service is becoming increasingly popular. A meal delivery platform aims to provide excellent and stable services for customers and restaurants. However, in reality, several hundred thousand orders are canceled per day in the Meituan meal delivery platform since they are not accepted by the crowd soucing drivers. The cancellation of the orders is incredibly detrimental to the customer's repurchase rate and the reputation of the Meituan meal delivery platform. To solve this problem, a certain amount of specific funds is provided by Meituan's business managers to encourage the crowdsourcing drivers to accept more orders. To make better use of the funds, in this work, we propose a framework to deal with the multi-stage bonus allocation problem for a meal delivery platform. The objective of this framework is to maximize the number of accepted orders within a limited bonus budget. This framework consists of a semi-black-box acceptance probability model, a Lagrangian dual-based dynamic programming algorithm, and an online allocation algorithm. The semi-black-box acceptance probability model is employed to forecast the relationship between the bonus allocated to order and its acceptance probability, the Lagrangian dual-based dynamic programming algorithm aims to calculate the empirical Lagrangian multiplier for each allocation stage offline based on the historical data set, and the online allocation algorithm uses the results attained in the offline part to calculate a proper delivery bonus for each order. To verify the effectiveness and efficiency of our framework, both offline experiments on a real-world data set and online A/B tests on the Meituan meal delivery platform are conducted. Our results show that using the proposed framework, the total order cancellations can be decreased by more than 25\% in reality.

cs.AI↗

MMLN: Leveraging Domain Knowledge for Multimodal Diagnosis

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest X-ray (CXR) images and electronic medical records (EMRs). However, most existing methods incorporate them in a model-free manner, which lacks theoretical support and ignores the intrinsic relations between different data sources. To address this problem, we propose a knowledge-driven and data-driven framework for lung disease diagnosis. By incorporating domain knowledge, machine learning models can reduce the dependence on labeled data and improve interpretability. We formulate diagnosis rules according to authoritative clinical medicine guidelines and learn the weights of rules from text data. Finally, a multimodal fusion consisting of text and image data is designed to infer the marginal probability of lung disease. We conduct experiments on a real-world dataset collected from a hospital. The results show that the proposed method outperforms the state-of-the-art multimodal baselines in terms of accuracy and interpretability.

cs.LG↗

Transceiving signals by mechanical resonance: A low frequency (LF) magnetoelectric mechanical antenna pair with integrated DC magnetic bias

Low frequency communication systems offer significant potential in portable electronics and internet of things (IoT) applications due to the low propagation loss and long transmission range. However, because the dimension of electrical antenna is comparable to one quarter wavelength of the electromagnetic wave that it transmits and receives, currently a gap exists between LF communication systems and IoT, as IoT generally implement miniaturized electrical antennas with a small wavelength at a high frequency while traditional LF electrical antennas are too bulky. In this paper, we present an LF magnetoelectric mechanical transmitting and receiving antenna pair to significantly miniaturize the dimension of LF antennas. As the operation principle of the magnetoelectric mechanical antenna pair is based on mechanical resonance, its dimension is reduced by four orders of magnitude compared with an electrical antenna counterpart. The transmitting and receiving antennas are the same in structure and dimensions: they are both composed of magnetostrictive Terfenol-D and piezoelectric PZT laminate, and their dimensions are both 38x12x8.2mm3. Both the transmitting and receiving antennas are integrated with DC magnetic bias to improve its performance. Antenna pair performance measurement demonstrates that a maximum operation distance of 9m is demonstrated with DC magnetic bias, while maximum operation distance without DC magnetic bias is 4m, which is reduced by 56%. The LF magnetoelectric mechanical antenna pair may be a promising candidate for the portable electronics and IoT applications.

physics.app-ph↗

A Miniaturized Low Frequency (LF) Magnetoelectric Receiving Antenna with an Integrated DC Magnetic Bias

Due to the applications in meteorological broadcasts, radio navigation and underwater communications, low-frequency(LF) receiving antennas have been actively studied. However, because the frequency range of LF antenna is 30kHz to 300kHz, its electromagnetic wavelength is 1km to 10km, which makes LF electromagnetic antennas difficult to be implemented in miniaturized or portable devices. This article presents a miniaturized LF magnetoelectric(ME) receiving antenna with an integrated DC magnetic bias. The antenna is based on the magnetoelectric effect and operates by resonance at its mechanical resonant frequency. Thus, compared with traditional LF wire antennas, the dimension of ME antenna is reduced significantly. Compared with prior art of ME antennas which do not have DC magnetic bias, higher performance can be achieved by integrating the miniaturized DC magnetic bias. Compared with prior art of an ME antenna with bulky external DC magnetic bias, the ME antenna with an integrated DC magnetic bias significantly reduce its dimension. Magnetostrictive TbDyFe2(Terfenol-D) and piezoelectric lead zirconate titanate(PZT) thin films are bonded together to form the 38x12x5.8mm3 ME receiving antenna. Four 10x10x10mm3 Rb magnets are implemented to provide an optimal DC bias for the antenna. A maximum operation distance of 2.5m is demonstrated with the DC magnetic field bias, 2.27 times of the maximum operation distance of the antenna without DC magnet field bias. The efficiency, gain and quality factor the ME receiving antenna is also characterized. The miniaturized LF ME antenna could have potential applications in portable electronics, internet of things and underwater communications.

physics.app-ph↗

"ReLIC: Reduced Logic Inference for Composition" for Quantifier Elimination based Compositional Reasoning and Verification

The paper presents our research on quantifier elimination (QE) for compositional reasoning and verification. For compositional reasoning, QE provides the foundation of our approach, serving as the calculus for composition to derive the strongest system-property in a single step, from the given component atomic-properties and their interconnection relation. We first developed this framework for time-independent properties, and later extended it to time-dependent property composition. The extension requires, in addition, shifting the given properties along time to span the time horizon of interest, he least of which for the strongest system-property is no more than the total time horizons of the component level atomic-properties. The system-initial-condition is also composed from atomic-initial-conditions of the components the same way. It is used to verify a desired system-level property, alongside the derived strongest system-property, by way of induction. Our composition approach is uniform regardless of the composition types (cascade/parallel/feedback) for both time-dependent and time-independent properties. We developed a new prototype verifier named ReLIC (Reduced Logic Inference for Composition) that implements our above approaches. We demonstrated it through several illustrative and practical examples. Further, we advanced the $k$-induction based model-checking with QE capabilities, by formulating its base and inductive steps into QE problems where all the variables are universally quantified. Our integration of the QE solver Redlog with the $k$-induction based model-checking tool JKind, shows the successful solving of a non-linear problem that the SMT capable JKind failed to resolve. Finally, we also showcase the recent adoption of our approaches within an industrial V\&V tool suite for augmented static analysis of Simulink models and Deep Neural Networks (DNNs).

cs.LO↗

Using Quantifier Elimination to Enhance the Safety Assurance of Deep Neural Networks

Advances in the field of Machine Learning and Deep Neural Networks (DNNs) has enabled rapid development of sophisticated and autonomous systems. However, the inherent complexity to rigorously assure the safe operation of such systems hinders their real-world adoption in safety-critical domains such as aerospace and medical devices. Hence, there is a surge in interest to explore the use of advanced mathematical techniques such as formal methods to address this challenge. In fact, the initial results of such efforts are promising. Along these lines, we propose the use of quantifier elimination (QE) - a formal method technique, as a complimentary technique to the state-of-the-art static analysis and verification procedures. Using an airborne collision avoidance DNN as a case example, we illustrate the use of QE to formulate the precise range forward propagation through a network as well as analyze its robustness. We discuss the initial results of this ongoing work and explore the future possibilities of extending this approach and/or integrating it with other approaches to perform advanced safety assurance of DNNs.

cs.LG↗

Diabatic Hamiltonian Construction in van der Waals heterostructure complexes

A diabatization method is developed for the approximated description of the photoinduced charge separation/transfer processes in the van der Waals (vdW) heterostructure complex, which is based on the wavefunction projection approach using a plane wave basis set in the framework of the single-particle picture. We build the diabatic Hamiltonian for the description of the interlayer photoinduced hole-transfer process of the two-dimensional vdW MoS2/WS2 heterostructure complexes. The diabatic Hamiltonian gives the energies of the localized valence band states (located at MoS2 and valence band states (located at WS2), as well as the couplings between them. The wavefunction projection method provides a practical and reasonable approach to construct the diabatic model in the description of photoinduced charge transfer processes in the vdW heterostructure complexes.

physics.chem-ph↗

Conformal Mapping for Multiple Terminals

Conformal mapping is an important mathematical tool in many physical and engineering fields, especially in electrostatics, fluid mechanics, classical mechanics, and transformation optics. However in the existing textbooks and literatures, it is only adopted to solve the problems which have only two terminals. Two terminals with electric potential differences, pressure difference, optical path difference, etc., can be mapped conformally onto a solvable structure, e.g., a rectangle, where the two terminals are mapped onto two opposite edges of the rectangle. Here we show a conformal mapping method for multiple terminals, which is more common in practical applications. Through accurate analysis of the boundary conditions, additional terminals or boundaries are folded in the inner of the mapped rectangle. Then the solution will not be influenced. The method is described in several typical situations and two application examples are detailed. The first example is an electrostatic actuator with three electrodes. A previous literature dealt with this problem by approximately treat the three electrodes as two electrodes. Based on the proposed method, a preciser result is achieved in our paper. The second example is a light beam splitter designed by transformation optics, which is recently attracting growing interests around the world. The splitter has three ports, one for input and two for output. Based on the proposed method, a relatively simple and precise solution compared with previously reported results is obtained.

physics.class-ph↗

Edge Effects on the Electronic Structures of Chemically Modified Armchair Graphene Nanoribbons

In this paper, we apply the first-principle theory to explore how the electronic structures of armchair graphene nanoribbons (AGNRs) are affected by chemical modifications. The edge addends include H, F, N, NH$_{2}$, and NO$_{2}$. Our theoretical results show that the energy gaps are highly tunable by controlling the widths of AGNRs and addends. The most interesting finding is that N-passivated AGNRs with various widths are metallic due to the unique electronic features of N-N bonds. This property change of AGNRs (from semiconducting to metallic) is important in developing graphene-based devices.

cond-mat.mtrl-sci↗

Switching mechanism of photochromic diarylethene derivatives molecular junctions

The electronic transport properties and switching mechanism of single photochromic diarylethene derivatives sandwiched between two gold surfaces with closed and open configurations are investigated by a fully self-consistent nonequilibrium Green's function method combined with density functional theory. The calculated transmission spectra of two configurations are strikingly distinctive. The open form lacks any significant transmission peak within a wide energy window, while the closed structure has two significant transmission peaks on the both sides of the Fermi level. The electronic transport properties of the molecular junction with closed structure under a small bias voltage are mainly determined by the tail of the transmission peak contributed unusually by the perturbed lowest perturbed unoccupied molecular orbital. The calculated on-off ratio of currents between the closed and open configurations is about two orders of magnitude, which reproduces the essential features of the experimental measured results. Moreover, we find that the switching behavior within a wide bias voltage window is extremely robust to both substituting F or S for H or O and varying end anchoring atoms from S to Se and Te.

cond-mat.other↗

Strain Effect on Energy Gaps of Armchair Graphene Nanoribbons

We report a first-principles study on electronic structures of the deformed armchair graphene nanoribbons (AGNRs). The variation of the energy gap of AGNRs as a function of uniaxial strain displays a zigzag pattern, which indicates that the energy gaps of AGNRs can be effectively tuned. The spatial distributions of two occupied and two empty subbands close to the Fermi level are swapped under different strains. The tunable width of energy gaps becomes narrower as increasing the width of AGNRs. Our simulations with tight binding approximation, including the nearest neighbor hopping integrals between $π$- orbitals of carbon atoms, reproduce these results by first-principles calculations. One simple empirical formula is obtained to describe the scaling behavior of the maximal value of energy gap as a function of the width of AGNRs.

cond-mat.mtrl-sci↗

Tuning the electronic structures of armchair graphene nanoribbons through chemical edge modification: A theoretical study

We report combined first-principle and tight-binding (TB) calculations to simulate the effects of chemical edge modifications on structural and electronic properties. The C-C bond lengths and bond angles near the GNR edge have considerable changes when edge carbon atoms are bounded to different atoms. By introducing a phenomenological hopping parameter $t_{1}$ for nearest-neighboring hopping to represent various chemical edge modifications, we investigated the electronic structural changes of nanoribbons with different widths based on the tight-binding scheme. Theoretical results show that addends can change the band structures of armchair GNRs and even result in observable metal-to-insulator transition.

cond-mat.mtrl-sci↗