Searcharxiv⌕ Search

arXiv subjects

Xi Wang

Publications and source records attributed to Xi Wang.

At least 343 records · Page 19Linked to original sources
arXiv2023

Multiferroicity in plastically deformed SrTiO$_3$

A major challenge in the development of quantum technologies is to induce additional types of ferroic orders into materials that exhibit other useful quantum properties. Various techniques have been applied to this end, such as elastically straining, doping, or interfacing a compound with other materials. Plastic deformation introduces permanent topological defects and large local strains into a material, which can give rise to qualitatively new functionality. Here we show via local magnetic imaging that plastic deformation induces robust magnetism in the quantum paraelectric SrTiO3, in both conducting and insulating samples. Our analysis indicates that the magnetic order is localized along dislocation walls and coexists with polar order along the walls. The magnetic signals can be switched on and off in a controllable manner with external stress, which demonstrates that plastically deformed SrTiO3 is a quantum multiferroic. These results establish plastic deformation as a versatile platform for quantum materials engineering.

cond-mat.str-el↗
arXiv2023

LATFormer: Locality-Aware Point-View Fusion Transformer for 3D Shape Recognition

Recently, 3D shape understanding has achieved significant progress due to the advances of deep learning models on various data formats like images, voxels, and point clouds. Among them, point clouds and multi-view images are two complementary modalities of 3D objects and learning representations by fusing both of them has been proven to be fairly effective. While prior works typically focus on exploiting global features of the two modalities, herein we argue that more discriminative features can be derived by modeling ``where to fuse''. To investigate this, we propose a novel Locality-Aware Point-View Fusion Transformer (LATFormer) for 3D shape retrieval and classification. The core component of LATFormer is a module named Locality-Aware Fusion (LAF) which integrates the local features of correlated regions across the two modalities based on the co-occurrence scores. We further propose to filter out scores with low values to obtain salient local co-occurring regions, which reduces redundancy for the fusion process. In our LATFormer, we utilize the LAF module to fuse the multi-scale features of the two modalities both bidirectionally and hierarchically to obtain more informative features. Comprehensive experiments on four popular 3D shape benchmarks covering 3D object retrieval and classification validate its effectiveness.

cs.CV↗
arXiv2023

Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work

The introduction of robots is widely considered to have significant potential of alleviating the issues of worker shortage and stagnant productivity that afflict the construction industry. However, it is challenging to use fully automated robots in complex and unstructured construction sites. Human-Robot Collaboration (HRC) has shown promise of combining human workers' flexibility and robot assistants' physical abilities to jointly address the uncertainties inherent in construction work. When introducing HRC in construction, it is critical to recognize the importance of teamwork and supervision in field construction and establish a natural and intuitive communication system for the human workers and robotic assistants. Natural language-based interaction can enable intuitive and familiar communication with robots for human workers who are non-experts in robot programming. However, limited research has been conducted on this topic in construction. This paper proposes a framework to allow human workers to interact with construction robots based on natural language instructions. The proposed method consists of three stages: Natural Language Understanding (NLU), Information Mapping (IM), and Robot Control (RC). Natural language instructions are input to a language model to predict a tag for each word in the NLU module. The IM module uses the result of the NLU module and building component information to generate the final instructional output essential for a robot to acknowledge and perform the construction task. A case study for drywall installation is conducted to evaluate the proposed approach. The obtained results highlight the potential of using natural language-based interaction to replicate the communication that occurs between human workers within the context of human-robot teams.

cs.RO↗
arXiv2023

Lithium tantalate electro-optical photonic integrated circuits for high volume manufacturing

Photonic integrated circuits based on Lithium Niobate have demonstrated the vast capabilities afforded by material with a high Pockels coefficient, allowing linear and high-speed modulators operating at CMOS voltage levels for applications ranging from data-center communications and photonic accelerators for AI. However despite major progress, the industrial adoption of this technology is compounded by the high cost per wafer. Here we overcome this challenge and demonstrate a photonic platform that satisfies the dichotomy of allowing scalable manufacturing at low cost, while at the same time exhibiting equal, and superior properties to those of Lithium Niobate. We demonstrate that it is possible to manufacture low loss photonic integrated circuits using Lithium Tantalate, a material that is already commercially adopted for acoustic filters in 5G and 6G. We show that LiTaO3 posses equally attractive optical properties and can be etched with high precision and negligible residues using DUV lithography, diamond like carbon (DLC) as a hard mask and alkaline wet etching. Using this approach we demonstrate microresonators with an intrinsic cavity linewidth of 26.8 MHz, corresponding to a linear loss of 5.6 dB/m and demonstrate a Mach Zehnder modulator with Vpi L = 4.2 V cm half-wave voltage length product. In comparison to Lithium Niobate, the photonic integrated circuits based on LiTaO3 exhibit a much lower birefringence, allowing high-density circuits and broadband operation over all telecommunication bands (O to L band), exhibit higher photorefractive damage threshold, and lower microwave loss tangent. Moreover, we show that the platform supports generation of soliton microcombs in X-Cut LiTaO3 racetrack microresonator with electronically detectable repetition rate, i.e. 30.1 GHz.

physics.optics↗
arXiv2023

The flavor transition process $b\rightarrow sγ$ in the $U(1)_X$SSM with the mass insertion approximation

People extend the MSSM with the local gauge group $U(1)_X$ to obtain the $U(1)_X$SSM. In the framework of the $U(1)_X$SSM, we study the flavor transition process $b\rightarrow{sγ}$ with the mass insertion approximation (MIA). By the MIA method and some reasonable parameter assumptions, we can intuitively find the parameters that have obvious effect on the analytic results of the flavor transition process $b\rightarrow{sγ}$. By means of the influences of different sensitive parameters, we can obtain reasonable results to better fit the experimental data.

hep-ph↗
arXiv2023

Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023

We present Palm, a solution to the Long-Term Action Anticipation (LTA) task utilizing vision-language and large language models. Given an input video with annotated action periods, the LTA task aims to predict possible future actions. We hypothesize that an optimal solution should capture the interdependency between past and future actions, and be able to infer future actions based on the structure and dependency encoded in the past actions. Large language models have demonstrated remarkable commonsense-based reasoning ability. Inspired by that, Palm chains an image captioning model and a large language model. It predicts future actions based on frame descriptions and action labels extracted from the input videos. Our method outperforms other participants in the EGO4D LTA challenge and achieves the best performance in terms of action prediction. Our code is available at https://github.com/DanDoge/Palm

cs.CV↗
arXiv2023

Mobile phone data reveal spatiotemporal dynamics of Omicron infections in Beijing after relaxing zero-COVID policy

The swift relaxation of the zero-COVID policy in December 2022 led to an unprecedented surge in Omicron variant infections in China. With the suspension of mandatory testing, tracking this epidemic outbreak was challenging because infections were often underrepresented in survey and testing results, which only involved partial populations. We used large-scale mobile phone data to estimate daily infections in Beijing from November 2022 to January 2023. We demonstrated that an individual's location records of mobile phone could be used to infer his or her infectious status. Then, the derived status of millions of individuals could be summed to reconstruct the citywide spatiotemporal dynamics of infections. We found that the infection incidence peaked on 21 December, and 80.1% of populations had been infected by 14 January 2023 in Beijing. Furthermore, infection dynamics exhibited significant demographic and spatiotemporal disparities. Our work provides a ubiquitous and high-coverage data source for monitoring epidemic outbreaks.

physics.soc-ph↗
arXiv2023

Online Distillation for Pseudo-Relevance Feedback

Model distillation has emerged as a prominent technique to improve neural search models. To date, distillation taken an offline approach, wherein a new neural model is trained to predict relevance scores between arbitrary queries and documents. In this paper, we explore a departure from this offline distillation strategy by investigating whether a model for a specific query can be effectively distilled from neural re-ranking results (i.e., distilling in an online setting). Indeed, we find that a lexical model distilled online can reasonably replicate the re-ranking of a neural model. More importantly, these models can be used as queries that execute efficiently on indexes. This second retrieval stage can enrich the pool of documents for re-ranking by identifying documents that were missed in the first retrieval stage. Empirically, we show that this approach performs favourably when compared with established pseudo relevance feedback techniques, dense retrieval methods, and sparse-dense ensemble "hybrid" approaches.

cs.IR↗
arXiv2023

$B^{0}-\bar{B^{0}}$ mixing in the $U(1)_X$SSM

$U(1)_X$SSM is a non-universal Abelian extension of the Minimal Supersymmetric Standard Model (MSSM) and its local gauge group is extended to $SU(3)_C\times SU(2)_L \times U(1)_Y\times U(1)_X$. Based on the latest data of neutral meson mixing and experimental limitations, we investigate the process of $B^{0}-\bar{B^{0}}$ mixing in $U(1)_X$SSM. Using the effective Hamiltonian method, the Wilson coefficients and mass difference $\triangle m_{B}$ are derived. The abundant numerical results verify that $~v_S,~M^2_D,~λ_C,~μ,~M_2,~\tanβ,~g_{YX},~M_1$ and $~λ_H$ are sensitive parameters to the process of $B^{0}-\bar{B^{0}}$ mixing. With further measurement in the experiment, the parameter space of the $U(1)_X$SSM will be further constrained during the mixing process of $B^{0}-\bar{B^{0}}$.

hep-ph↗
arXiv2023

A Survey on Asking Clarification Questions Datasets in Conversational Systems

The ability to understand a user's underlying needs is critical for conversational systems, especially with limited input from users in a conversation. Thus, in such a domain, Asking Clarification Questions (ACQs) to reveal users' true intent from their queries or utterances arise as an essential task. However, it is noticeable that a key limitation of the existing ACQs studies is their incomparability, from inconsistent use of data, distinct experimental setups and evaluation strategies. Therefore, in this paper, to assist the development of ACQs techniques, we comprehensively analyse the current ACQs research status, which offers a detailed comparison of publicly available datasets, and discusses the applied evaluation metrics, joined with benchmarks for multiple ACQs-related tasks. In particular, given a thorough analysis of the ACQs task, we discuss a number of corresponding research directions for the investigation of ACQs as well as the development of conversational systems.

cs.IR↗
arXiv2023

High-efficiency entanglement of microwave fields in cavity opto-magnomechanical systems

We demonstrate a scheme to realize high-efficiency entanglement of two microwave fields in a dual opto-magnomechanical system. The magnon mode simultaneously couples with the microwave cavity mode and phonon mode via magnetic dipole interaction and magnetostrictive interaction, respectively. Meanwhile, the phonon mode couples with the optical cavity mode via radiation pressure. Each magnon mode and optical cavity mode adopts a strong red detuning driving field to activate the beam splitter interaction. Therefore, the entangled state generated by the injected two-mode squeezed light in optical cavities can be eventually transferred into two microwave cavities. A stationary entanglement E_{a_{1}a_{2}}=0.54 is obtained when the input two-mode squeezed optical field has a squeezing parameter r=1. The entanglement E_{a_{1}a_{2}} increases as the squeezing parameter r increases, and it shows the flexible tunability of the system. Meanwhile, the entanglement survives up to an environmental temperature about 385 mK, which shows high robustness of the scheme. The proposed scheme provides a new mechanism to generate entangled microwave fields via magnons, which enables the degree of the prepared microwave entanglement to a more massive scale. Our result is useful for applications which require high entanglement of microwave fields like quantum radar, quantum navigation, quantum teleportation, quantum wireless fidelity (Wi-Fi) network, etc.

quant-ph↗
arXiv2023

Multi-channel quantum noise suppression and phase-sensitive modulation in a hybrid optical resonant cavity system

Quantum noise suppression and phase-sensitive modulation of continuously variable in vacuum and squeezed fields in a hybrid resonant cavity system are investigated theoretically. Multiple dark windows similar to electromagnetic induction transparency (EIT) are observed in quantum noise fluctuation curve. The effects of pumping light on both suppression of quantum noise and control the widths of dark windows are carefully analyzed, and the saturation point of pumping light for nonlinear crystal conversion is obtained. We find that the noise suppression effect is strongly sensitive to the pumping light power. The degree of noise suppression can be up to 13.9 dB when the pumping light power is 6.5 Beta_th. Moreover, a phase-sensitive modulation scheme is demonstrated, which well fills the gap that multi-channel quantum noise suppression is difficult to realize at the quadrature amplitude of squeezed field. Our result is meaningful for various applications in precise measurement physics, quantum information processing and quantum communications of system-on-a-chip.

quant-ph↗
arXiv2023

EFE: End-to-end Frame-to-Gaze Estimation

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye regions and having fewer confounding factors (such as clothing and hair) is believed to benefit the final model performance. However, this eye/face patch cropping process is expensive, erroneous, and implementation-specific for different methods. In this paper, we propose a frame-to-gaze network that directly predicts both 3D gaze origin and 3D gaze direction from the raw frame out of the camera without any face or eye cropping. Our method demonstrates that direct gaze regression from the raw downscaled frame, from FHD/HD to VGA/HVGA resolution, is possible despite the challenges of having very few pixels in the eye region. The proposed method achieves comparable results to state-of-the-art methods in Point-of-Gaze (PoG) estimation on three public gaze datasets: GazeCapture, MPIIFaceGaze, and EVE, and generalizes well to extreme camera view changes.

cs.CV↗
arXiv2023

When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution

In collaborative tasks, effective communication is crucial for achieving joint goals. One such task is collaborative building where builders must communicate with each other to construct desired structures in a simulated environment such as Minecraft. We aim to develop an intelligent builder agent to build structures based on user input through dialogue. However, in collaborative building, builders may encounter situations that are difficult to interpret based on the available information and instructions, leading to ambiguity. In the NeurIPS 2022 Competition NLP Task, we address two key research questions, with the goal of filling this gap: when should the agent ask for clarification, and what clarification questions should it ask? We move towards this target with two sub-tasks, a classification task and a ranking task. For the classification task, the goal is to determine whether the agent should ask for clarification based on the current world state and dialogue history. For the ranking task, the goal is to rank the relevant clarification questions from a pool of candidates. In this report, we briefly introduce our methods for the classification and ranking task. For the classification task, our model achieves an F1 score of 0.757, which placed the 3rd on the leaderboard. For the ranking task, our model achieves about 0.38 for Mean Reciprocal Rank by extending the traditional ranking model. Lastly, we discuss various neural approaches for the ranking task and future direction.

cs.CL↗
arXiv2023

Particle-based Variational Inference with Preconditioned Functional Gradient Flow

Particle-based variational inference (VI) minimizes the KL divergence between model samples and the target posterior with gradient flow estimates. With the popularity of Stein variational gradient descent (SVGD), the focus of particle-based VI algorithms has been on the properties of functions in Reproducing Kernel Hilbert Space (RKHS) to approximate the gradient flow. However, the requirement of RKHS restricts the function class and algorithmic flexibility. This paper offers a general solution to this problem by introducing a functional regularization term that encompasses the RKHS norm as a special case. This allows us to propose a new particle-based VI algorithm called preconditioned functional gradient flow (PFG). Compared to SVGD, PFG has several advantages. It has a larger function class, improved scalability in large particle-size scenarios, better adaptation to ill-conditioned distributions, and provable continuous-time convergence in KL divergence. Additionally, non-linear function classes such as neural networks can be incorporated to estimate the gradient flow. Our theory and experiments demonstrate the effectiveness of the proposed framework.

stat.ML↗
arXiv2023

FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions

One-shot talking head generation has received growing attention in recent years, with various creative and practical applications. An ideal natural and vivid generated talking head video should contain natural head pose changes. However, it is challenging to map head pose sequences from driving audio since there exists a natural gap between audio-visual modalities. In this work, we propose a Flow-guided One-shot model that achieves NaTural head motions(FONT) over generated talking heads. Specifically, the head pose prediction module is designed to generate head pose sequences from the source face and driving audio. We add the random sampling operation and the structural similarity constraint to model the diversity in the one-to-many mapping between audio-visual modality, thus predicting natural head poses. Then we develop a keypoint predictor that produces unsupervised keypoints from the source face, driving audio and pose sequences to describe the facial structure information. Finally, a flow-guided occlusion-aware generator is employed to produce photo-realistic talking head videos from the estimated keypoints and source face. Extensive experimental results prove that FONT generates talking heads with natural head poses and synchronized mouth shapes, outperforming other compared methods.

cs.CV↗
arXiv2023

GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the face region and eyeballs are separate 3D structures that move in a coordinated yet independent fashion. Our method leverages recent advancements in conditional image-based neural radiance fields and proposes a two-stream architecture that predicts volumetric features for the face and eye regions separately. Rigidly transforming the eye features via a 3D rotation matrix provides fine-grained control over the desired gaze angle. The final, redirected image is then attained via differentiable volume compositing. Our experiments show that this architecture outperforms naively conditioned NeRF baselines as well as previous state-of-the-art 2D gaze redirection methods in terms of redirection accuracy and identity preservation.

cs.CV↗
arXiv2023

JAWS: Just A Wild Shot for Cinematic Transfer in Neural Radiance Fields

This paper presents JAWS, an optimization-driven approach that achieves the robust transfer of visual cinematic features from a reference in-the-wild video clip to a newly generated clip. To this end, we rely on an implicit-neural-representation (INR) in a way to compute a clip that shares the same cinematic features as the reference clip. We propose a general formulation of a camera optimization problem in an INR that computes extrinsic and intrinsic camera parameters as well as timing. By leveraging the differentiability of neural representations, we can back-propagate our designed cinematic losses measured on proxy estimators through a NeRF network to the proposed cinematic parameters directly. We also introduce specific enhancements such as guidance maps to improve the overall quality and efficiency. Results display the capacity of our system to replicate well known camera sequences from movies, adapting the framing, camera parameters and timing of the generated video clip to maximize the similarity with the reference clip.

cs.CV↗