arXiv subjects

Haiyang Wang

Publications and source records attributed to Haiyang Wang.

At least 55 records · Page 3Linked to original sources

arXiv2024

Congruence properties of the coefficients of the classical modular polynomials

The classical modular polynomials $Φ_\ell(X,Y)$ give plane curve models for the modular curves $X_0(\ell)/\mathbb{Q}$ and have been extensively studied. In this article, we provide closed formulas for $\ell$ nontrivial coefficients of the classical modular polynomials $Φ_\ell(X,Y)$ in terms of the Fourier coefficients of the modular invariant function $j(z)$ for a prime $\ell$. Our interest in the formulas were motivated by our conjectures on congruences modulo powers of the primes $2,3$ and $5$ satisfied by the coefficients of these polynomials. We deduce congruences from these formulas supporting the conjectures.

math.NT↗

arXiv2024

From stars to diverse mantles, melts, crusts and atmospheres of rocky exoplanets

This review is focused on describing the logic by which we make predictions of exoplanetary compositions and mineralogies, and how these processes could lead to compositional diversity among rocky exoplanets. We use these predictions to determine the sensitivity of present-day and future observations to detecting compositional differences between rocky exoplanets and the four terrestrial planets. First, we review data on stellar abundances and infer how changes in composition may manifest themselves in the expected bulk compositions of rocky exoplanets (section 2). Converting this information in mass-radius relationships requires calculation of the stable mineral assemblages at a given temperature-pressure-composition (T-P-X), an exercise we describe in section 3. Should the planet be hot enough to engender partial melting of the mantle, then these liquids are likely to rise to the surface and erupt to form planetary crusts; the possible compositional and mineralogical variability of which we examine in section 4. Finally, the expected spectroscopic responses of such crusts are examined in section 5.

astro-ph.EP↗

arXiv2024

GiT: Towards Generalist Vision Transformer through Universal Language Interface

This paper proposes a simple, yet effective framework, called GiT, simultaneously applicable for various vision tasks only with a vanilla ViT. Motivated by the universality of the Multi-layer Transformer architecture (e.g, GPT) widely used in large language models (LLMs), we seek to broaden its scope to serve as a powerful vision foundation model (VFM). However, unlike language modeling, visual tasks typically require specific modules, such as bounding box heads for detection and pixel decoders for segmentation, greatly hindering the application of powerful multi-layer transformers in the vision domain. To solve this, we design a universal language interface that empowers the successful auto-regressive decoding to adeptly unify various visual tasks, from image-level understanding (e.g., captioning), over sparse perception (e.g., detection), to dense prediction (e.g., segmentation). Based on the above designs, the entire model is composed solely of a ViT, without any specific additions, offering a remarkable architectural simplification. GiT is a multi-task visual model, jointly trained across five representative benchmarks without task-specific fine-tuning. Interestingly, our GiT builds a new benchmark in generalist performance, and fosters mutual enhancement across tasks, leading to significant improvements compared to isolated training. This reflects a similar impact observed in LLMs. Further enriching training with 27 datasets, GiT achieves strong zero-shot results over various tasks. Due to its simple design, this paradigm holds promise for narrowing the architectural gap between vision and language. Code and models will be available at \url{https://github.com/Haiyang-W/GiT}.

cs.CV↗

arXiv2023

Experimental demonstration of mice tumor control with a laser-accelerated high-energy electron radiotherapy prototype

Radiotherapy using very-high-energy electron (VHEE) beams (50-300 MeV) has attracted considerable attention due to its advantageous dose deposition characteristics, enabling deep penetration and the potential for ultra-high dose rate treatment. One promising approach to compactly delivering these high energy electron beams in a cost-effective manner is laser wakefield acceleration (LWFA), which offers ultra-strong accelerating gradients. However, the transition from this concept to a functional machine intended for tumor treatment is still being investigated. Here we present the first self-developed prototype for LWFA-based VHEE radiotherapy, exhibiting high compactness (occupying less than 5 square meters) and high operational stability (validated over a period of one month). Subsequently, we employed this device to irradiate a tumor implanted in a mouse model. Following a dose delivery of $5.8\pm0.2$ Gy with precise tumor conformity, all irradiated mice exhibited pronounced control of tumor growth. For comparison, this tumor-control efficacy was similar to that achieved using commercial X-ray radiotherapy equipment operating at equivalent doses. These results demonstrate the potential of a compact laser-driven VHEE system for preclinical studies involving small animal models and its promising prospects for future clinical translation in cancer therapy.

physics.med-ph↗

arXiv2023

Rational Spherical Triangles

A rational spherical triangle is a triangle on the unit sphere such that the lengths of its three sides and its area are rational multiples of $π$. Little and Coxeter have given examples of rational spherical triangles in 1980s. In this work, we are interested in determining all the rational spherical triangles. We introduce a conjecture on the solutions to a trigonometric Diophantine equation. An implication of the conjecture is that the only rational spherical triangles are the ones given by Little and Coxeter. We prove some partial results towards the conjecture.

math.NT↗

arXiv2023

PRED: Pre-training via Semantic Rendering on LiDAR Point Clouds

Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where only a fraction of the points are captured by LiDAR, leading to ambiguity during the training phase. On the other hand, images offer more comprehensive information and richer semantics that can bolster point cloud encoders in addressing the incompleteness issue inherent in point clouds. Yet, incorporating images into point cloud pre-training presents its own challenges due to occlusions, potentially causing misalignments between points and pixels. In this work, we propose PRED, a novel image-assisted pre-training framework for outdoor point clouds in an occlusion-aware manner. The main ingredient of our framework is a Birds-Eye-View (BEV) feature map conditioned semantic rendering, leveraging the semantics of images for supervision through neural rendering. We further enhance our model's performance by incorporating point-wise masking with a high mask ratio (95%). Extensive experiments demonstrate PRED's superiority over prior point cloud pre-training methods, providing significant improvements on various large-scale datasets for 3D perception tasks. Codes will be available at https://github.com/PRED4pc/PRED.

cs.CV↗

arXiv2023

UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representation

Jointly processing information from multiple sensors is crucial to achieving accurate and robust perception for reliable autonomous driving systems. However, current 3D perception research follows a modality-specific paradigm, leading to additional computation overheads and inefficient collaboration between different sensor data. In this paper, we present an efficient multi-modal backbone for outdoor 3D perception named UniTR, which processes a variety of modalities with unified modeling and shared parameters. Unlike previous works, UniTR introduces a modality-agnostic transformer encoder to handle these view-discrepant sensor data for parallel modal-wise representation learning and automatic cross-modal interaction without additional fusion steps. More importantly, to make full use of these complementary sensor types, we present a novel multi-modal integration strategy by both considering semantic-abundant 2D perspective and geometry-aware 3D sparse neighborhood relations. UniTR is also a fundamentally task-agnostic backbone that naturally supports different 3D perception tasks. It sets a new state-of-the-art performance on the nuScenes benchmark, achieving +1.1 NDS higher for 3D object detection and +12.0 higher mIoU for BEV map segmentation with lower inference latency. Code will be available at https://github.com/Haiyang-W/UniTR .

cs.CV↗

arXiv2023

DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets

Designing an efficient yet deployment-friendly 3D backbone to handle sparse point clouds is a fundamental problem in 3D perception. Compared with the customized sparse convolution, the attention mechanism in Transformers is more appropriate for flexibly modeling long-range relationships and is easier to be deployed in real-world applications. However, due to the sparse characteristics of point clouds, it is non-trivial to apply a standard transformer on sparse points. In this paper, we present Dynamic Sparse Voxel Transformer (DSVT), a single-stride window-based voxel Transformer backbone for outdoor 3D perception. In order to efficiently process sparse points in parallel, we propose Dynamic Sparse Window Attention, which partitions a series of local regions in each window according to its sparsity and then computes the features of all regions in a fully parallel manner. To allow the cross-set connection, we design a rotated set partitioning strategy that alternates between two partitioning configurations in consecutive self-attention layers. To support effective downsampling and better encode geometric information, we also propose an attention-style 3D pooling module on sparse points, which is powerful and deployment-friendly without utilizing any customized CUDA operations. Our model achieves state-of-the-art performance with a broad range of 3D perception tasks. More importantly, DSVT can be easily deployed by TensorRT with real-time inference speed (27Hz). Code will be available at \url{https://github.com/Haiyang-W/DSVT}.

cs.CV↗

arXiv2023

Transformation and reconstruction towards two-dimensional atomic laminates

Two-dimensional (2D) nanomaterials derived from non-van der Waals solids are promising due to their fantastic physical and chemical properties, but it remains challenging to obtain 2D atomic laminates with high stability owing to the strong intrinsic covalent/metallic bonds and highly exposed active surface. Here, we report a versatile and scalable protocol to produce 2D atomic laminates, based on an unexpected topological transformation of MAX phases under hydrogen chloride gas, and/or subsequent reconstruction under some programmed gases/vapors. In contrast to the known approaches with liquid or molten medium, our method involves in a gas-phase reaction with fast thermodynamics for A layers and positive Gibbs free energies for MX slabs. Remarkably, through subsequent reconstruction in some active gases/vapors (O2, H2S, P, CH4, Al and Sn metal vapors), a big family of 2D atomic laminates with elusive configurations as well as high chemical/thermal stabilities and tunable electrical properties (from metallic to semiconductor-like behaviors) are achieved. Moreover, the resultant 2D atomic laminates can be facilely scaled up to 10 kilograms. We believe that the 2D atomic laminates would have broad applications in catalysis, energy storage, electromagnetic shielding interface and microwave absorption.

cond-mat.mtrl-sci↗

arXiv2023

Metal-bonded Atomic Layers of Transition Metal Carbides (MXenes)

Although two-dimensional transition metal carbides and nitrides (MXenes) have fantastic physical and chemical properties as well as wide applications, it remains challenging to produce stable MXenes due to their rapid structural degradation. Here, unique metal-bonded atomic layers of transition metal carbides with high stabilities are produced via a simple topological reaction between chlorine-terminated MXenes and selected metals, where the metals enable to not only remove Cl terminations, but also efficiently bond with adjacent atomic MXene slabs, driven by the symmetry of MAX phases. The films constructed from Al-bonded Ti$_3$C$_2$Cl$_x$ atomic layers show high oxidation resistance up to 400 degrees centigrade and low sheet resistance of 9.3 ohm per square. Coupled to the multi-layer structure, the Al-bonded Ti$_3$C$_2$Cl$_x$ film displays a significantly improved EMI shielding capability with a total shielding effectiveness value of 39 dB at a low thickness of 3.1 micron, outperforming pure Ti$_3$C$_2$Cl$_x$ film.

cond-mat.mtrl-sci↗

arXiv2023

Adversarial Learning-based Stance Classifier for COVID-19-related Health Policies

The ongoing COVID-19 pandemic has caused immeasurable losses for people worldwide. To contain the spread of the virus and further alleviate the crisis, various health policies (e.g., stay-at-home orders) have been issued which spark heated discussions as users turn to share their attitudes on social media. In this paper, we consider a more realistic scenario on stance detection (i.e., cross-target and zero-shot settings) for the pandemic and propose an adversarial learning-based stance classifier to automatically identify the public's attitudes toward COVID-19-related health policies. Specifically, we adopt adversarial learning that allows the model to train on a large amount of labeled data and capture transferable knowledge from source topics, so as to enable generalize to the emerging health policies with sparse labeled data. To further enhance the model's deeper understanding, we incorporate policy descriptions as external knowledge into the model. Meanwhile, a GeoEncoder is designed which encourages the model to capture unobserved background factors specified by each region and then represent them as non-text information. We evaluate the performance of a broad range of baselines on the stance detection task for COVID-19-related health policies, and experimental results show that our proposed method achieves state-of-the-art performance in both cross-target and zero-shot settings.

cs.CL↗

arXiv2022

CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Clouds

We present a novel two-stage fully sparse convolutional 3D object detection framework, named CAGroup3D. Our proposed method first generates some high-quality 3D proposals by leveraging the class-aware local group strategy on the object surface voxels with the same semantic predictions, which considers semantic consistency and diverse locality abandoned in previous bottom-up approaches. Then, to recover the features of missed voxels due to incorrect voxel-wise segmentation, we build a fully sparse convolutional RoI pooling module to directly aggregate fine-grained spatial information from backbone for further proposal refinement. It is memory-and-computation efficient and can better encode the geometry-specific features of each 3D proposal. Our model achieves state-of-the-art 3D detection performance with remarkable gains of +\textit{3.6\%} on ScanNet V2 and +\textit{2.6}\% on SUN RGB-D in term of mAP@0.25. Code will be available at https://github.com/Haiyang-W/CAGroup3D.

cs.CV↗

arXiv2022

RBGNet: Ray-based Grouping for 3D Object Detection

As a fundamental problem in computer vision, 3D object detection is experiencing rapid growth. To extract the point-wise features from the irregularly and sparsely distributed points, previous methods usually take a feature grouping module to aggregate the point features to an object candidate. However, these methods have not yet leveraged the surface geometry of foreground objects to enhance grouping and 3D box generation. In this paper, we propose the RBGNet framework, a voting-based 3D detector for accurate 3D object detection from point clouds. In order to learn better representations of object shape to enhance cluster features for predicting 3D boxes, we propose a ray-based feature grouping module, which aggregates the point-wise features on object surfaces using a group of determined rays uniformly emitted from cluster centers. Considering the fact that foreground points are more meaningful for box estimation, we design a novel foreground biased sampling strategy in downsample process to sample more points on object surfaces and further boost the detection performance. Our model achieves state-of-the-art 3D detection performance on ScanNet V2 and SUN RGB-D with remarkable performance gains. Code will be available at https://github.com/Haiyang-W/RBGNet.

cs.CV↗

arXiv2022

Reflection spectra of accretion disks illuminated by disk-like coronae

Relativistic reflection features in the X-ray spectra of black hole binaries and AGNs are thought to be produced through illumination of a cold accretion disk by a hot corona. In this work, we assume that the corona has the shape of an infinitesimally thin disk with its central axis the same as the rotational axis of the black hole. The corona can either be static or corotate with the accretion disk. We calculate the disk's emissivity profiles and iron line shapes for a set of coronal radii and heights. We incorporate these emissivity profiles into RELXILL_NK and we simulate some observations of a black hole binary with NuSTAR to study the impact of a disk-like coronal geometry on the measurement of the properties of the system and, in particular, on the possibility of testing the Kerr nature of the source. We find that, in general, the astrophysical properties of the accretion disk are recovered well even if we fit the data with a model employing a broken power-law or a lamppost emissivity profile, while it is more challenging to constrain the geometric properties of the black hole spacetime.

astro-ph.HE↗

arXiv2022

The Accretion flow in M87 is really MAD

The supermassive black holes in most galaxies in the universe are powered by hot accretion flows. Both theoretical analysis and numerical simulations have indicated that, depending on the degree of magnetization, black hole hot accretion flow is divided into two modes, namely SANE (standard and normal evolution) and MAD (magnetically arrested disk). It has been an important question which mode the hot accretion flows in individual sources should belong to in reality, SANE or MAD. This issue has been investigated in some previous works but they all suffer from various uncertainties. By using the measured rotation measure values in the prototype low-luminosity active galactic nuclei in {M87} at 2, 5, and 8 GHz along the jet at various distances from the black hole, combined with three dimensional general relativity magnetohydrodynamical numerical simulations of SANE and MAD, we show in this paper that the predicted rotation measure values by MAD are well consistent with observations, while the SANE model overestimates the rotation measure by over two orders of magnitude thus is ruled out.

astro-ph.HE↗

arXiv2021

Full-attention based Neural Architecture Search using Context Auto-regression

Self-attention architectures have emerged as a recent advancement for improving the performance of vision tasks. Manual determination of the architecture for self-attention networks relies on the experience of experts and cannot automatically adapt to various scenarios. Meanwhile, neural architecture search (NAS) has significantly advanced the automatic design of neural architectures. Thus, it is appropriate to consider using NAS methods to discover a better self-attention architecture automatically. However, it is challenging to directly use existing NAS methods to search attention networks because of the uniform cell-based search space and the lack of long-term content dependencies. To address this issue, we propose a full-attention based NAS method. More specifically, a stage-wise search space is constructed that allows various attention operations to be adopted for different layers of a network. To extract global features, a self-supervised search algorithm is proposed that uses context auto-regression to discover the full-attention architecture. To verify the efficacy of the proposed methods, we conducted extensive experiments on various learning tasks, including image classification, fine-grained image recognition, and zero-shot image retrieval. The empirical results show strong evidence that our method is capable of discovering high-performance, full-attention architectures while guaranteeing the required search efficiency.

cs.CV↗

arXiv2021

Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize, and most of the existing theoretical results make strong assumptions on the loss function. In this work we bridge the gap by studying DRO algorithms for general smooth non-convex losses. By carefully exploiting the specific form of the DRO objective, we are able to provide non-asymptotic convergence guarantees even though the objective function is possibly non-convex, non-smooth and has unbounded gradient noise. In particular, we prove that a special algorithm called the mini-batch normalized gradient descent with momentum, can find an $ε$ first-order stationary point within $O( ε^{-4} )$ gradient complexity. We also discuss the conditional value-at-risk (CVaR) setting, where we propose a penalized DRO objective based on a smoothed version of the CVaR that allows us to obtain a similar convergence guarantee. We finally verify our theoretical results in a number of tasks and find that the proposed algorithm can consistently achieve prominent acceleration.

cs.LG↗

arXiv2021

Collaborative Visual Navigation

As a fundamental problem for Artificial Intelligence, multi-agent system (MAS) is making rapid progress, mainly driven by multi-agent reinforcement learning (MARL) techniques. However, previous MARL methods largely focused on grid-world like or game environments; MAS in visually rich environments has remained less explored. To narrow this gap and emphasize the crucial role of perception in MAS, we propose a large-scale 3D dataset, CollaVN, for multi-agent visual navigation (MAVN). In CollaVN, multiple agents are entailed to cooperatively navigate across photo-realistic environments to reach target locations. Diverse MAVN variants are explored to make our problem more general. Moreover, a memory-augmented communication framework is proposed. Each agent is equipped with a private, external memory to persistently store communication information. This allows agents to make better use of their past communication information, enabling more efficient collaboration and robust long-term planning. In our experiments, several baselines and evaluation metrics are designed. We also empirically verify the efficacy of our proposed MARL approach across different MAVN task settings.

cs.CV↗