arXiv subjects

Xinyu Huang

Publications and source records attributed to Xinyu Huang.

98 records · Page 6Linked to original sources

arXiv2020

Channel Characterization for 1D Molecular Communication with Two Absorbing Receivers

This letter develops a one-dimensional (1D) diffusion-based molecular communication system to analyze channel responses between a single transmitter (TX) and two fully-absorbing receivers (RXs). Incorporating molecular degradation in the environment, rigorous analytical formulas for i) the fraction of molecules absorbed, ii) the corresponding hitting rate, and iii) the asymptotic fraction of absorbed molecules as time approaches infinity at each RX are derived when an impulse of molecules are released at the TX. By using particle-based simulations, the derived analytical expressions are validated. Simulations also present the distance ranges of two RXs that do not impact molecular absorption of each other, and demonstrate that the mutual imfluence of two active RXs reduces with the increase in the degradation rate.

cs.ET↗

arXiv2019

A More Refined Mobile Edge Cache Replacement Scheme for Adaptive Video Streaming with Mutual Cooperation in Multi-MEC Servers

In this paper, we propose a more refined video segment based Mobile Edge Computing (MEC) enhanced cache update strategy, which takes into account the client's playback status and transmission state, MEC cache capacity and the popularity of each segment, to improve the quality of experience (QoE) of clients and the use ratio of MEC cache. In each cache update period, the segments which cannot bring significant QoE improvement will be deleted and meanwhile more suitable representations of the segments will be cahed instead. First, we divide the MEC cache space into three parts based on segment popularity and segment importance level. In addition, the size of different cache parts can be transformed to each other to further exploit the MEC cache space. For different parts, the corresponding deleted strategy and caching strategy are formulated, where the deleted strategy combines the requested times of segment and transmission capability of clients, and the caching strategy utilizes the playback state of clients to calculate the caching priority. Furthermore, we formulate the cache update problem to maximize the utility function of clients subject to the constraint of MEC cache size and transmission capacity. The brand and branch method is emplyed to obatain the optimal solution. Simulation results show that our proposed algorithm can improve system throughput and hit ratio of video segment, and at the same time decrease playback frozen time and system backhaul traffic compared with other existing algorithms.

eess.IV↗

arXiv2019

Part-level Car Parsing and Reconstruction from Single Street View

Part information has been shown to be resistant to occlusions and viewpoint changes, which is beneficial for various vision-related tasks. However, we found very limited work in car pose estimation and reconstruction from street views leveraging the part information. There are two major contributions in this paper. Firstly, we make the first attempt to build a framework to simultaneously estimate shape, translation, orientation, and semantic parts of cars in 3D space from a single street view. As it is labor-intensive to annotate semantic parts on real street views, we propose a specific approach to implicitly transfer part features from synthesized images to real street views. For pose and shape estimation, we propose a novel network structure that utilizes both part features and 3D losses. Secondly, we are the first to construct a high-quality dataset that contains 348 different car models with physical dimensions and part-level annotations based on global and local deformations. Given these models, we further generate 60K synthesized images with randomization of orientation, illumination, occlusion, and texture. Our results demonstrate that our part segmentation performance is significantly improved after applying our implicit transfer approach. Our network for pose and shape estimation achieves the state-of-the-art performance on the ApolloCar3D dataset and outperforms 3D-RCNN and DeepMANTA by 12.57 and 8.91 percentage points in terms of mean A3DP-Abs.

cs.CV↗

arXiv2019

The ApolloScape Open Dataset for Autonomous Driving and its Application

Autonomous driving has attracted tremendous attention especially in the past few years. The key techniques for a self-driving car include solving tasks like 3D map construction, self-localization, parsing the driving road and understanding objects, which enable vehicles to reason and act. However, large scale data set for training and system evaluation is still a bottleneck for developing robust perception models. In this paper, we present the ApolloScape dataset [1] and its applications for autonomous driving. Compared with existing public datasets from real scenes, e.g. KITTI [2] or Cityscapes [3], ApolloScape contains much large and richer labelling including holistic semantic dense point cloud for each site, stereo, per-pixel semantic labelling, lanemark labelling, instance segmentation, 3D car instance, high accurate location for every frame in various driving videos from multiple sites, cities and daytimes. For each task, it contains at lease 15x larger amount of images than SOTA datasets. To label such a complete dataset, we develop various tools and algorithms specified for each task to accelerate the labelling process, such as 3D-2D segment labeling tools, active labelling in videos etc. Depend on ApolloScape, we are able to develop algorithms jointly consider the learning and inference of multiple tasks. In this paper, we provide a sensor fusion scheme integrating camera videos, consumer-grade motion sensors (GPS/IMU), and a 3D semantic map in order to achieve robust self-localization and semantic segmentation for autonomous driving. We show that practically, sensor fusion and joint learning of multiple tasks are beneficial to achieve a more robust and accurate system. We expect our dataset and proposed relevant algorithms can support and motivate researchers for further development of multi-sensor fusion and multi-task learning in the field of computer vision.

cs.CV↗

arXiv2018

Room temperature infrared photodetectors with hybrid structure based on 2D materials

Two-dimensional (2D) materials, such as graphene, transition metal dichalcogenides (TMDs), black phosphorus (BP) and related derivatives, have attracted great attention due to their advantages of flexibility, strong light-matter interaction, broadband absorption and high carrier mobility, and have become a powerful contender for next-generation infrared photodetectors. However, since the thickness of two-dimensional materials is on the order of nanometers, the absorption of two-dimensional materials is very weak, which limits the detection performance of 2D materials-based infrared photodetector. In order to solve this problem, scientific researchers have tried to use optimized device structures to combine with two-dimensional materials for improving the performance of infrared photodetector. In this review, we review the progress of room temperature infrared photodetectors with hybrid structure based on 2D materials in recent years, focusing mainly on 2D-nD (n = 0, 1, 2) heterostructures, the integration between 2D materials and on-chip or plasmonic structure. Finally, we summarize the current challenges and point out the future development direction.

physics.app-ph↗

arXiv2018

RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

3D point cloud generation by the deep neural network from a single image has been attracting more and more researchers' attention. However, recently-proposed methods require the objects be captured with relatively clean backgrounds, fixed viewpoint, while this highly limits its application in the real environment. To overcome these drawbacks, we proposed to integrate the prior 3D shape knowledge into the network to guide the 3D generation. By taking additional 3D information, the proposed network can handle the 3D object generation from a single real image captured from any viewpoint and complex background. Specifically, giving a query image, we retrieve the nearest shape model from a pre-prepared 3D model database. Then, the image together with the retrieved shape model is fed into the proposed network to generate the fine-grained 3D point cloud. The effectiveness of our proposed framework has been verified on different kinds of datasets. Experimental results show that the proposed framework achieves state-of-the-art accuracy compared to other volumetric-based and point set generation methods. Furthermore, the proposed framework works well for real images in complex backgrounds with various view angles.

cs.CV↗

arXiv2018

A Network Structure to Explicitly Reduce Confusion Errors in Semantic Segmentation

Confusing classes that are ubiquitous in real world often degrade performance for many vision related applications like object detection, classification, and segmentation. The confusion errors are not only caused by similar visual patterns but also amplified by various factors during the training of our designed models, such as reduced feature resolution in the encoding process or imbalanced data distributions. A large amount of deep learning based network structures has been proposed in recent years to deal with these individual factors and improve network performance. However, to our knowledge, no existing work in semantic image segmentation is designed to tackle confusion errors explicitly. In this paper, we present a novel and general network structure that reduces confusion errors in more direct manner and apply the network for semantic segmentation. There are two major contributions in our network structure: 1) We ensemble subnets with heterogeneous output spaces based on the discriminative confusing groups. The training for each subnet can distinguish confusing classes within the group without affecting unrelated classes outside the group. 2) We propose an improved cross-entropy loss function that maximizes the probability assigned to the correct class and penalizes the probabilities assigned to the confusing classes at the same time. Our network structure is a general structure and can be easily adapted to any other networks to further reduce confusion errors. Without any changes in the feature encoder and post-processing steps, our experiments demonstrate consistent and significant improvements on different baseline models on Cityscapes and PASCAL VOC datasets (e.g., 3.05% over ResNet-101 and 1.30% over ResNet-38).

cs.CV↗

arXiv2016

Mask-off: Synthesizing Face Images in the Presence of Head-mounted Displays

A head-mounted display (HMD) could be an important component of augmented reality system. However, as the upper face region is seriously occluded by the device, the user experience could be affected in applications such as telecommunication and multi-player video games. In this paper, we first present a novel experimental setup that consists of two near-infrared (NIR) cameras to point to the eye regions and one visible-light RGB camera to capture the visible face region. The main purpose of this paper is to synthesize realistic face images without occlusions based on the images captured by these cameras. To this end, we propose a novel synthesis framework that contains four modules: 3D head reconstruction, face alignment and tracking, face synthesis, and eye synthesis. In face synthesis, we propose a novel algorithm that can robustly align and track a personalized 3D head model given a face that is severely occluded by the HMD. In eye synthesis, in order to generate accurate eye movements and dynamic wrinkle variations around eye regions, we propose another novel algorithm to colorize the NIR eye images and further remove the "red eye" effects caused by the colorization. Results show that both hardware setup and system framework are robust to synthesize realistic face images in video sequences.

cs.CV↗