arXiv subjects

Haoyuan Zhang

Publications and source records attributed to Haoyuan Zhang.

26 records · Page 2Linked to original sources

arXiv2024

Technique Report of CVPR 2024 PBDL Challenges

The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. In recent years, deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop. The challenge consisted of eight tracks, focusing on Low-Light Enhancement and Detection as well as High Dynamic Range (HDR) Imaging. This report details the objectives, methodologies, and results of each track, highlighting the top-performing solutions and their innovative approaches.

cs.CV↗

arXiv2023

A combining earthquake forecasting model between deep learning and Epidemic-Type Aftershock Sequence (ETAS) model

The scientific process of earthquake forecasting involves estimating the probability and intensity of earthquakes in a specific area within a certain timeframe, based on seismic activity laws and observational data. Epidemic-Type Aftershock Sequence (ETAS) models, which rely on seismic empirical laws, is one of the most commonly used methods for earthquake forecasting. However, it underestimates feature in short-term time scale and overestimates in long-term time scale. Convolutional Long Short-Term Memory (ConvLSTM), has emerged as a promising approach capable of extracting spatio-temporal features. Hence, we propose a novel composite model named CL-ETAS model, which combines the strengths of ConvLSTM and ETAS model. We conduct experimental verification on real seismic data in Southern California. Our results show that CL-ETAS model outperforms both ETAS model and ConvLstm in accurately forecasting the number of earthquake events, their magnitude, and spatial distribution. Additionally, CL-ETAS model demonstrates notable enhancements in forecast stability and interpretability. These results offer valuable insights and recommendations for future earthquake forecasting endeavors.

physics.geo-ph↗

arXiv2023

NTU4DRadLM: 4D Radar-centric Multi-Modal Dataset for Localization and Mapping

Simultaneous Localization and Mapping (SLAM) is moving towards a robust perception age. However, LiDAR- and visual- SLAM may easily fail in adverse conditions (rain, snow, smoke and fog, etc.). In comparison, SLAM based on 4D Radar, thermal camera and IMU can work robustly. But only a few literature can be found. A major reason is the lack of related datasets, which seriously hinders the research. Even though some datasets are proposed based on 4D radar in past four years, they are mainly designed for object detection, rather than SLAM. Furthermore, they normally do not include thermal camera. Therefore, in this paper, NTU4DRadLM is presented to meet this requirement. The main characteristics are: 1) It is the only dataset that simultaneously includes all 6 sensors: 4D radar, thermal camera, IMU, 3D LiDAR, visual camera and RTK GPS. 2) Specifically designed for SLAM tasks, which provides fine-tuned ground truth odometry and intentionally formulated loop closures. 3) Considered both low-speed robot platform and fast-speed unmanned vehicle platform. 4) Covered structured, unstructured and semi-structured environments. 5) Considered both middle- and large- scale outdoor environments, i.e., the 6 trajectories range from 246m to 6.95km. 6) Comprehensively evaluated three types of SLAM algorithms. Totally, the dataset is around 17.6km, 85mins, 50GB and it will be accessible from this link: https://github.com/junzhang2016/NTU4DRadLM

cs.RO↗

arXiv2023

Microwave heating as a universal method to transform confined molecules into armchair graphene nanoribbons

Armchair graphene nanoribbons (AGNRs) with sub-nanometer width are potential materials for fabrication of novel nanodevices thanks to their moderate direct band gaps. AGNRs are usually synthesized by polymerizing precursor molecules on substrate surface. However, it is time-consuming and not suitable for large-scale production. AGNRs can also be grown by transforming precursor molecules inside single-walled carbon nanotubes via furnace annealing, but the obtained AGNRs are normally twisted. In this work, microwave heating is applied for transforming precursor molecules into AGNRs. The fast heating process allows synthesizing the AGNRs in seconds. Several different molecules were successfully transformed into AGNRs, suggesting that it is a universal method. More importantly, as demonstrated by Raman spectroscopy, aberration-corrected high-resolution transmission electron microscopy and theoretical calculations, less twisted AGNRs are synthesized by the microwave heating than the furnace annealing. Our results reveal a route for rapid production of AGNRs in large scale, which would benefit future applications in novel AGNRs-based semiconductor devices.

cond-mat.mtrl-sci↗

arXiv2022

Contrastive Positive Mining for Unsupervised 3D Action Representation Learning

Recent contrastive based 3D action representation learning has made great progress. However, the strict positive/negative constraint is yet to be relaxed and the use of non-self positive is yet to be explored. In this paper, a Contrastive Positive Mining (CPM) framework is proposed for unsupervised skeleton 3D action representation learning. The CPM identifies non-self positives in a contextual queue to boost learning. Specifically, the siamese encoders are adopted and trained to match the similarity distributions of the augmented instances in reference to all instances in the contextual queue. By identifying the non-self positive instances in the queue, a positive-enhanced learning strategy is proposed to leverage the knowledge of mined positives to boost the robustness of the learned latent space against intra-class and inter-class diversity. Experimental results have shown that the proposed CPM is effective and outperforms the existing state-of-the-art unsupervised methods on the challenging NTU and PKU-MMD datasets.

cs.CV↗

arXiv2021

Decomposition Formula for the Wall Heat Flux of a Compressible Boundary Layer

Understanding the generation mechanism of the heating flux is essential for the design of hypersonic vehicles. We proposed a novel formula to decompose the heat flux coefficient into the contributions of different terms by integrating the conservative equation of the total energy. The reliability of the formula is well demonstrated by the direct numerical simulation results of a hypersonic transitional boundary layer. Through this formula, the exact process of the energy transport in the boundary layer can be explained and the dominant contributors to the heat flux can be explored, which are beneficial for the prediction of the heat and design of the thermal protection devices

physics.flu-dyn↗

arXiv2020

SAR-NAS: Skeleton-based Action Recognition via Neural Architecture Searching

This paper presents a study of automatic design of neural network architectures for skeleton-based action recognition. Specifically, we encode a skeleton-based action instance into a tensor and carefully define a set of operations to build two types of network cells: normal cells and reduction cells. The recently developed DARTS (Differentiable Architecture Search) is adopted to search for an effective network architecture that is built upon the two types of cells. All operations are 2D based in order to reduce the overall computation and search space. Experiments on the challenging NTU RGB+D and Kinectics datasets have verified that most of the networks developed to date for skeleton-based action recognition are likely not compact and efficient. The proposed method provides an approach to search for such a compact network that is able to achieve comparative or even better performance than the state-of-the-art methods.

cs.CV↗

arXiv2020

Taking the pulse of COVID-19: A spatiotemporal perspective

The sudden outbreak of the Coronavirus disease (COVID-19) swept across the world in early 2020, triggering the lockdowns of several billion people across many countries, including China, Spain, India, the U.K., Italy, France, Germany, and most states of the U.S. The transmission of the virus accelerated rapidly with the most confirmed cases in the U.S., and New York City became an epicenter of the pandemic by the end of March. In response to this national and global emergency, the NSF Spatiotemporal Innovation Center brought together a taskforce of international researchers and assembled implemented strategies to rapidly respond to this crisis, for supporting research, saving lives, and protecting the health of global citizens. This perspective paper presents our collective view on the global health emergency and our effort in collecting, analyzing, and sharing relevant data on global policy and government responses, geospatial indicators of the outbreak and evolving forecasts; in developing research capabilities and mitigation measures with global scientists, promoting collaborative research on outbreak dynamics, and reflecting on the dynamic responses from human societies.

physics.soc-ph↗