Searcharxiv⌕ Search

arXiv subjects

Xin Huang

Publications and source records attributed to Xin Huang.

At least 163 records · Page 9Linked to original sources
arXiv2023

HKUST at SemEval-2023 Task 1: Visual Word Sense Disambiguation with Context Augmentation and Visual Assistance

Visual Word Sense Disambiguation (VWSD) is a multi-modal task that aims to select, among a batch of candidate images, the one that best entails the target word's meaning within a limited context. In this paper, we propose a multi-modal retrieval framework that maximally leverages pretrained Vision-Language models, as well as open knowledge bases and datasets. Our system consists of the following key components: (1) Gloss matching: a pretrained bi-encoder model is used to match contexts with proper senses of the target words; (2) Prompting: matched glosses and other textual information, such as synonyms, are incorporated using a prompting template; (3) Image retrieval: semantically matching images are retrieved from large open datasets using prompts as queries; (4) Modality fusion: contextual information from different modalities are fused and used for prediction. Although our system does not produce the most competitive results at SemEval-2023 Task 1, we are still able to beat nearly half of the teams. More importantly, our experiments reveal acute insights for the field of Word Sense Disambiguation (WSD) and multi-modal learning. Our code is available on GitHub.

cs.CV↗
arXiv2023

HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation

Recent text-to-3D methods employing diffusion models have made significant advancements in 3D human generation. However, these approaches face challenges due to the limitations of text-to-image diffusion models, which lack an understanding of 3D structures. Consequently, these methods struggle to achieve high-quality human generation, resulting in smooth geometry and cartoon-like appearances. In this paper, we propose HumanNorm, a novel approach for high-quality and realistic 3D human generation. The main idea is to enhance the model's 2D perception of 3D geometry by learning a normal-adapted diffusion model and a normal-aligned diffusion model. The normal-adapted diffusion model can generate high-fidelity normal maps corresponding to user prompts with view-dependent and body-aware text. The normal-aligned diffusion model learns to generate color images aligned with the normal maps, thereby transforming physical geometry details into realistic appearance. Leveraging the proposed normal diffusion model, we devise a progressive geometry generation strategy and a multi-step Score Distillation Sampling (SDS) loss to enhance the performance of 3D human generation. Comprehensive experiments substantiate HumanNorm's ability to generate 3D humans with intricate geometry and realistic appearances. HumanNorm outperforms existing text-to-3D methods in both geometry and texture quality. The project page of HumanNorm is https://humannorm.github.io/.

cs.CV↗
arXiv2023

Path integral molecular dynamics approximations of quantum canonical observables

Mean-field molecular dynamics based on path integrals is used to approximate canonical quantum observables for particle systems consisting of nuclei and electrons. A computational bottleneck is the sampling from the Gibbs density of the electron operator, which due to the fermion sign problem has a computational complexity that scales exponentially with the number of electrons. In this work we construct an algorithm that approximates the mean-field Hamiltonian by path integrals for fermions. The algorithm is based on the determinant of a matrix with components based on Brownian bridges connecting permuted electron coordinates. The computational work for $n$ electrons is $\mathcal O(n^3)$, which reduces the computational complexity associated with the fermion sign problem. We analyze a bias resulting from this approximation and provide a computational error indicator. It remains to rigorously explain the surprisingly high accuracy.

math.NA↗
arXiv2023

NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Prediction

Interactions between road agents present a significant challenge in trajectory prediction, especially in cases involving multiple agents. Because existing diversity-aware predictors do not account for the interactive nature of multi-agent predictions, they may miss these important interaction outcomes. In this paper, we propose NashFormer, a framework for trajectory prediction that leverages game-theoretic inverse reinforcement learning to improve coverage of multi-modal predictions. We use a training-time game-theoretic analysis as an auxiliary loss resulting in improved coverage and accuracy without presuming a taxonomy of actions for the agents. We demonstrate our approach on the interactive split of the Waymo Open Motion Dataset, including four subsets involving scenarios with high interaction complexity. Experiment results show that our predictor produces accurate predictions while covering $33\%$ more potential interactions versus a baseline model.

cs.LG↗
arXiv2023

Near-Infrared Ca II Triplet As An Stellar Activity Indicator: Library and Comparative Study

We have established and released a new stellar index library of the Ca II Triplet, which serves as an indicator for characterizing the chromospheric activity of stars. The library is based on data from the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) Low-Resolution Spectroscopic Survey (LRS) Data Release 9 (DR9). To better reflect the chromospheric activity of stars, we have defined new indices $R$ and $R^{+}$. The library includes measurements of $R$ and $R^{+}$ for each Ca II infrared triplet (IRT) from 699,348 spectra of 562,863 F, G and K-type solar-like stars with Signal-to-Noise Ratio (SNR) higher than 100, as well as the stellar atmospheric parameters and basic information inherited from the LAMOST LRS Catalog. We compared the differences between the 3 individual index of the Ca II Triplet and also conducted a comparative analysis of $R^{+}_{\lambda8542}$ to the Ca II H&K $S$ and $R^+_{HK}$ index database. We find the fraction of low active stars decreases with $T_{eff}$ and the fraction of high active first decrease with decreasing temperature and turn to increase with decreasing temperature at 5800K. We also find a significant fraction of stars that show high activity index in both Ca II H&K and IRT are binaries with low activity, some of them could be discriminated in Ca II H&K $S$ index and $R^{+}_{\lambda8542}$ space. This newly stellar library serves as a valuable resource for studying chromospheric activity in stars and can be used to improve our comprehension of stellar magnetic activity and other astrophysical phenomena.

astro-ph.SR↗
arXiv2023

Orbital parameters for an ELM white dwarf with a white dwarf companion: LAMOST J033847.06+413424.2

Double white dwarf systems are of great astrophysical importance in the field of gravitational wave and Type Ia supernova. While the binary fraction of CO core white dwarf is about a few percents, the extremely low mass white dwarfs are all thought to be within binary systems. In this work, we report the orbital solution of a double degenerate system: J033847.06+413424.24, an extremely low mass He core white dwarf orbiting a CO core white dwarf. With LAMOST and P200, time domain spectroscopic observations have been made and spectral atmosphere parameters are estimated to be $T_{\rm eff}\sim22500$ K and log $g\sim5.6$ dex. Combining Gaia parallax, 3D extinction, and evolution tracks, we estimate a radius of $\sim0.12$ $R_{\odot}$ and a mass of $\sim0.22$ $M_{\odot}$. With the 37 single exposure spectra, the radial velocities are measured and the orbital parameters are estimated to be $P=0.1253132(1)$ days, $K1=289\pm4$ km/s and $V_{sys}=-41\pm3$ km/s. The radial velocity based system ephemeris is also provided. The light curves from several photometric surveys show no orbital modulation. The orbital solution suggests that the invisible companion has a minimum mass of about 0.60 $M_{\odot}$ and is $\sim0.79$ $M_{\odot}$ for an inclination of $60.0^{\circ}$, indicating most probably a CO core white dwarf. The system is expected to merge in about 1 Gyr. With present period and distance ($\sim596$ pc) it can not irradiate strong enough gravitational wave for LISA. More double degenerate systems are expected to be discovered and parameterized as the LAMOST survey goes on.

astro-ph.SR↗
arXiv2023

DKWS: A Distributed System for Keyword Search on Massive Graphs (Complete Version)

Due to the unstructuredness and the lack of schemas of graphs, such as knowledge graphs, social networks, and RDF graphs, keyword search for querying such graphs has been proposed. As graphs have become voluminous, large-scale distributed processing has attracted much interest from the database research community. While there have been several distributed systems, distributed querying techniques for keyword search are still limited. This paper proposes a novel distributed keyword search system called $\DKWS$. First, we \revise{present} a {\em monotonic} property with keyword search algorithms that guarantees correct parallelization. Second, we present a keyword search algorithm as monotonic backward and forward search phases. Moreover, we propose new tight bounds for pruning nodes being searched. Third, we propose a {\em notify-push} paradigm and $\PINE$ {\em programming model} of $\DKWS$. The notify-push paradigm allows {\em asynchronously} exchanging the upper bounds of matches across the workers and the coordinator in $\DKWS$. The $\PINE$ programming model naturally fits keyword search algorithms, as they have distinguished phases, to allow {\em preemptive} searches to mitigate staleness in a distributed system. Finally, we investigate the performance and effectiveness of $\DKWS$ through experiments using real-world datasets. We find that $\DKWS$ is up to two orders of magnitude faster than related techniques, and its communication costs are $7.6$ times smaller than those of other techniques.

cs.DB↗
arXiv2023

Howe duality in the toroidal setting

In this paper, we construct and study various dual pairs acting on the oscillator modules of the symplectic toroidal Lie algebras coordinated by irrational quantum tori. This extends the classical Howe dual pairs to the toroidal setup.

math.QA↗
arXiv2023

Controlling Epidemic Spread Under Immunization Delay Constraints

In this paper, we study the problem of minimizing the spread of a viral epidemic when immunization takes a non-negligible amount of time to take into effect. Specifically, our problem is to determine which set of nodes to be vaccinated when vaccines take a random amount of time in order to maximize the total reward, which is the expected number of saved nodes. We first provide a mathematical analysis for the reward function of vaccinating an arbitrary number of nodes when there is a single source of infection. While it is infeasible to obtain the optimal solution analytically due to the combinatorial nature of the problem, we establish that the problem is a monotone submodular maximization problem and develop a greedy algorithm that achieves a $(1\!-\!1/e)$-approximation. We further extend the scenario to the ones with multiple infection sources and discuss how the greedy algorithm can be applied systematically for the multiple-source scenarios. We finally present extensive simulation results to demonstrate the superiority of our greedy algorithm over other baseline vaccination strategies.

cs.SI↗
arXiv2023

HDR-NeRF: High Dynamic Range Neural Radiance Fields

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and novel LDR views under different exposures. The key to our method is to model the physical imaging process, which dictates that the radiance of a scene point transforms to a pixel value in the LDR image with two implicit functions: a radiance field and a tone mapper. The radiance field encodes the scene radiance (values vary from 0 to +infty), which outputs the density and radiance of a ray by giving corresponding ray origin and ray direction. The tone mapper models the mapping process that a ray hitting on the camera sensor becomes a pixel value. The color of the ray is predicted by feeding the radiance and the corresponding exposure time into the tone mapper. We use the classic volume rendering technique to project the output radiance, colors, and densities into HDR and LDR images, while only the input LDR images are used as the supervision. We collect a new forward-facing HDR dataset to evaluate the proposed method. Experimental results on synthetic and real-world scenes validate that our method can not only accurately control the exposures of synthesized views but also render views with a high dynamic range.

cs.CV↗
arXiv2023

Local Implicit Ray Function for Generalizable Radiance Field Representation

We propose LIRF (Local Implicit Ray Function), a generalizable neural rendering approach for novel view rendering. Current generalizable neural radiance fields (NeRF) methods sample a scene with a single ray per pixel and may therefore render blurred or aliased views when the input views and rendered views capture scene content with different resolutions. To solve this problem, we propose LIRF to aggregate the information from conical frustums to construct a ray. Given 3D positions within conical frustums, LIRF takes 3D coordinates and the features of conical frustums as inputs and predicts a local volumetric radiance field. Since the coordinates are continuous, LIRF renders high-quality novel views at a continuously-valued scale via volume rendering. Besides, we predict the visible weights for each input view via transformer-based feature matching to improve the performance in occluded areas. Experimental results on real-world scenes validate that our method outperforms state-of-the-art methods on novel view rendering of unseen scenes at arbitrary scales.

cs.CV↗
arXiv2023

Inverting the Imaging Process by Learning an Implicit Camera Model

Representing visual signals with implicit coordinate-based neural networks, as an effective replacement of the traditional discrete signal representation, has gained considerable popularity in computer vision and graphics. In contrast to existing implicit neural representations which focus on modelling the scene only, this paper proposes a novel implicit camera model which represents the physical imaging process of a camera as a deep neural network. We demonstrate the power of this new implicit camera model on two inverse imaging tasks: i) generating all-in-focus photos, and ii) HDR imaging. Specifically, we devise an implicit blur generator and an implicit tone mapper to model the aperture and exposure of the camera's imaging process, respectively. Our implicit camera model is jointly learned together with implicit scene models under multi-focus stack and multi-exposure bracket supervision. We have demonstrated the effectiveness of our new model on a large number of test images and videos, producing accurate and visually appealing all-in-focus and high dynamic range images. In principle, our new implicit neural camera model has the potential to benefit a wide array of other inverse imaging tasks.

cs.CV↗
arXiv2023

A nonlinearity and model specification test for functional time series

An important issue in functional time series analysis is whether an observed series comes from a purely random process. We extend the BDS test, a widely-used nonlinear independence test, to the functional time series. Like the BDS test in the univariate case, the functional BDS test can act as the model specification test to evaluate the adequacy of various prediction models and as a nonlinearity test to detect the existence of nonlinear structures in a functional time series after removing the linear structure exhibited. We show that the test statistic from the functional BDS test has the same asymptotic properties as those in the univariate case and provides the recommended range of its hyperparameters. Additionally, empirical data analysis features its applications in evaluating the adequacy of the fAR(1) and fGARCH(1,1) models in fitting the daily curves of cumulative intraday returns (CIDR) of the VIX index. We showed that the functional BDS test remedies the weakness of the existing independence test in the literature, as the latter is restricted in detecting linear structures, thus, can neglect nonlinear temporal structures.

stat.ME↗
arXiv2023

MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers

In this paper, we propose Mixed and Masked AutoEncoder (MixMAE), a simple but efficient pretraining method that is applicable to various hierarchical Vision Transformers. Existing masked image modeling (MIM) methods for hierarchical Vision Transformers replace a random subset of input tokens with a special [MASK] symbol and aim at reconstructing original image tokens from the corrupted image. However, we find that using the [MASK] symbol greatly slows down the training and causes pretraining-finetuning inconsistency, due to the large masking ratio (e.g., 60% in SimMIM). On the other hand, MAE does not introduce [MASK] tokens at its encoder at all but is not applicable for hierarchical Vision Transformers. To solve the issue and accelerate the pretraining of hierarchical models, we replace the masked tokens of one image with visible tokens of another image, i.e., creating a mixed image. We then conduct dual reconstruction to reconstruct the two original images from the mixed input, which significantly improves efficiency. While MixMAE can be applied to various hierarchical Transformers, this paper explores using Swin Transformer with a large window size and scales up to huge model size (to reach 600M parameters). Empirical results demonstrate that MixMAE can learn high-quality visual representations efficiently. Notably, MixMAE with Swin-B/W14 achieves 85.1% top-1 accuracy on ImageNet-1K by pretraining for 600 epochs. Besides, its transfer performances on the other 6 datasets show that MixMAE has better FLOPs / performance tradeoff than previous popular MIM methods. Code is available at https://github.com/Sense-X/MixMIM.

cs.CV↗
arXiv2023

Excitons in mesoscopically reconstructed moiré heterostructures

Moiré effects in twisted or lattice-incommensurate vertical assemblies of two-dimensional crystals give rise to a new class of quantum materials with rich transport and optical phenomena, including correlated electron physics in flat bands of bilayer graphene and moiré excitons in semiconductor heterostructures. These phenomena arise from modulations of interlayer hybridization on the nanoscale of spatially varying atomic registries of moiré supercells. Due to finite elasticity, however, lattices of marginally-twisted homobilayers and heterostructures can transform from moiré to periodically reconstructed patterns with triangular or hexagonal tiling. Here, we expand the notion of nanoscale lattice reconstruction to the mesoscopic scale of extended samples and demonstrate rich consequences in optical studies of excitons in MoSe$_2$-WSe$_2$ heterostructures with parallel and antiparallel alignment. Our results provide a unified perspective on diverse and partly controversial signatures of moiré excitons in semiconductor heterostructures by identifying domains with exciton properties of distinct effective dimensionality and establish mesoscopic reconstruction as a compelling feature of real samples and devices with inherent finite-size effects and disorder. Generalized to stacks of other two-dimensional materials, this notion of mesoscale domain formation with emergent topological defects and percolation networks will instructively expand our understanding of fundamental electronic, optical, and magnetic properties of van der Waals heterostructures.

cond-mat.mes-hall↗
arXiv2023

A Generic Knowledge Based Medical Diagnosis Expert System

In this paper, we design and implement a generic medical knowledge based system (MKBS) for identifying diseases from several symptoms. In this system, some important aspects like knowledge bases system, knowledge representation, inference engine have been addressed. The system asks users different questions and inference engines will use the certainty factor to prune out low possible solutions. The proposed disease diagnosis system also uses a graphical user interface (GUI) to facilitate users to interact with the expert system. Our expert system is generic and flexible, which can be integrated with any rule bases system in disease diagnosis.

cs.AI↗
arXiv2023

Canonical mean-field molecular dynamics derived from quantum mechanics

Canonical quantum correlation observables can be approximated by classical molecular dynamics. In the case of low temperature the ab initio molecular dynamics potential energy is based on the ground state electron eigenvalue problem and the accuracy has been proven to be $\mathcal O(M^{-1})$, provided the first electron eigenvalue gap is sufficiently large compared to the given temperature and $M$ is the ratio of nuclei and electron masses. For higher temperature eigenvalues corresponding to excited electron states are required to obtain $\mathcal O(M^{-1})$ accuracy and the derivations assume that all electron eigenvalues are separated, which for instance excludes conical intersections. This work studies a mean-field molecular dynamics approximation where the mean-field Hamiltonian for the nuclei is the partial trace $h:={\rm Tr}(H e^{-βH})/{\rm Tr}(e^{-βH})$ with respect to the electron degrees of freedom and $H$ is the Weyl symbol corresponding to a quantum many body Hamiltonian $\widehat{H}$. It is proved that the mean-field molecular dynamics approximates canonical quantum correlation observables with accuracy $\mathcal O (M^{-1}+ tε^2)$, for correlation time $t$ where $ε^2$ is related to the variance of mean value approximation $h$. Furthermore, the proof derives a precise asymptotic representation of the Weyl symbol of the Gibbs density operator using a path integral formulation. Numerical experiments on a model problem with one nuclei and two electron states show that the mean-field dynamics has similar or better accuracy than standard molecular dynamics based on the ground state electron eigenvalue.

math.NA↗