Searcharxiv⌕ Search

arXiv subjects

Jing Li

Publications and source records attributed to Jing Li.

At least 505 records · Page 28Linked to original sources

SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Control

Traffic signal control is safety-critical for our daily life. Roughly one-quarter of road accidents in the U.S. happen at intersections due to problematic signal timing, urging the development of safety-oriented intersection control. However, existing studies on adaptive traffic signal control using reinforcement learning technologies have focused mainly on minimizing traffic delay but neglecting the potential exposure to unsafe conditions. We, for the first time, incorporate road safety standards as enforcement to ensure the safety of existing reinforcement learning methods, aiming toward operating intersections with zero collisions. We have proposed a safety-enhanced residual reinforcement learning method (SafeLight) and employed multiple optimization techniques, such as multi-objective loss function and reward shaping for better knowledge integration. Extensive experiments are conducted using both synthetic and real-world benchmark datasets. Results show that our method can significantly reduce collisions while increasing traffic mobility.

cs.LG↗

Understanding Social Media Cross-Modality Discourse in Linguistic Space

The multimedia communications with texts and images are popular on social media. However, limited studies concern how images are structured with texts to form coherent meanings in human cognition. To fill in the gap, we present a novel concept of cross-modality discourse, reflecting how human readers couple image and text understandings. Text descriptions are first derived from images (named as subtitles) in the multimedia contexts. Five labels -- entity-level insertion, projection and concretization and scene-level restatement and extension -- are further employed to shape the structure of subtitles and texts and present their joint meanings. As a pilot study, we also build the very first dataset containing 16K multimedia tweets with manually annotated discourse labels. The experimental results show that the multimedia encoder based on multi-head attention with captions is able to obtain the-state-of-the-art results.

cs.MM↗

Bilinear magnetoresistance in HgTe topological insulator: opposite signs at opposite interfaces demonstrated by gate control

Spin-orbit effects appearing in topological insulators (TI) and at Rashba interfaces are currently revolutionizing how we can manipulate spins and have led to several newly discovered effects, from spin-charge interconversion and spin-orbit torques to novel magnetoresistance phenomena. In particular, a puzzling magnetoresistance has been evidenced, bilinear in electric and magnetic fields. Here, we report the observation of bilinear magnetoresistance (BMR) in strained HgTe, a prototypical TI. We show that both the amplitude and sign of this BMR can be tuned by controlling, with an electric gate, the relative proportions of the opposite contributions of opposite surfaces. At magnetic fields of 1 T, the magnetoresistance is of the order of 1 \% and has a larger figure of merit than previously measured TIs. We propose a theoretical model giving a quantitative account of our experimental data. This phenomenon, unique to TI, offers novel opportunities to tune their electrical response for spintronics.

cond-mat.mes-hall↗

Comet 108P/Ciffreo: The Blob

Short-period comet 108P/Ciffreo is known for its peculiar double morphology, in which the nucleus is accompanied by a co-moving, detached, diffuse 'blob'. We report new observations of 108P/Ciffreo taken with the Hubble Space Telescope and the Nordic Optical Telescope and use them to determine the cause of this unusual morphology. The separation and the longevity of the blob across several orbits together rule out the possibility of a single, slow-moving secondary object near the primary nucleus. We use a model of coma particle dynamics under the action of solar gravity and radiation pressure to show that the blob is an artifact of the turn-around of particles ejected sunward and repelled by sunlight. Numerical experiments limit the range of directions which can reproduce the morphology and explain why the co-moving blob appearance is rare.

astro-ph.EP↗

RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks with Fine-Grain Utilization

Many emerging cyber-physical systems, such as autonomous vehicles and robots, rely heavily on artificial intelligence and machine learning algorithms to perform important system operations. Since these highly parallel applications are computationally intensive, they need to be accelerated by graphics processing units (GPUs) to meet stringent timing constraints. However, despite the wide adoption of GPUs, efficiently scheduling multiple GPU applications while providing rigorous real-time guarantees remains a challenge. In this paper, we propose RTGPU, which can schedule the execution of multiple GPU applications in real-time to meet hard deadlines. Each GPU application can have multiple CPU execution and memory copy segments, as well as GPU kernels. We start with a model to explicitly account for the CPU and memory copy segments of these applications. We then consider the GPU architecture in the development of a precise timing model for the GPU kernels and leverage a technique known as persistent threads to implement fine-grained kernel scheduling with improved performance through interleaved execution. Next, we propose a general method for scheduling parallel GPU applications in real time. Finally, to schedule multiple parallel GPU applications, we propose a practical real-time scheduling algorithm based on federated scheduling and grid search (for GPU kernel segments) with uniprocessor fixed priority scheduling (for multiple CPU and memory copy segments). Our approach provides superior schedulability compared with previous work, and gives real-time guarantees to meet hard deadlines for multiple GPU applications according to comprehensive validation and evaluation on a real NVIDIA GTX1080Ti GPU system.

cs.DC↗

Audio2Gestures: Generating Diverse Gestures from Audio

People may perform diverse gestures affected by various mental and physical factors when speaking the same sentences. This inherent one-to-many relationship makes co-speech gesture generation from audio particularly challenging. Conventional CNNs/RNNs assume one-to-one mapping, and thus tend to predict the average of all possible target motions, easily resulting in plain/boring motions during inference. So we propose to explicitly model the one-to-many audio-to-motion mapping by splitting the cross-modal latent code into shared code and motion-specific code. The shared code is expected to be responsible for the motion component that is more correlated to the audio while the motion-specific code is expected to capture diverse motion information that is more independent of the audio. However, splitting the latent code into two parts poses extra training difficulties. Several crucial training losses/strategies, including relaxed motion loss, bicycle constraint, and diversity loss, are designed to better train the VAE. Experiments on both 3D and 2D motion datasets verify that our method generates more realistic and diverse motions than previous state-of-the-art methods, quantitatively and qualitatively. Besides, our formulation is compatible with discrete cosine transformation (DCT) modeling and other popular backbones (\textit{i.e.} RNN, Transformer). As for motion losses and quantitative motion evaluation, we find structured losses/metrics (\textit{e.g.} STFT) that consider temporal and/or spatial context complement the most commonly used point-wise losses (\textit{e.g.} PCK), resulting in better motion dynamics and more nuanced motion details. Finally, we demonstrate that our method can be readily used to generate motion sequences with user-specified motion clips on the timeline.

cs.CV↗

GRB 200829A: External Shock Origin of the Very Early Prompt Emission?

Long-duration GRB~200829A was detected by Fermi-GBM and Swift-BAT/XRT, and then rapidly observed by other ground-based telescopes. It has a weak $γ$-ray emission in the very early phase and followed by a bright spiky $γ$-ray emission pulse. The radiation spectrum of the very early emission is best fitted by a power-law function with index $\sim -1.7$. However, the bright spiky $γ$-ray pulse, especially the time around the peak, exhibits a distinct two-component radiation spectra, i.e., Band function combined with a blackbody radiation spectrum. We infer the photospheric properties and reveal a medium magnetization at photospheric position by adopting the initial size of the outflow as $r_0=10^9$~cm. It implies that Band component in this pulse may be formed during the dissipation of magnetic field. The power-law radiation spectra found in the very early prompt emission may imply the external-shock origination of this phase. Then, we perform Markov Chain Monte Carlo method fitting on the light-curves of this burst, where the jet corresponding to the $γ$-ray pulses at around $20$~s is used to refresh the external-shock. It is shown that the light-curves of very early phase and X-ray afterglow after $40$~s, involving the X-ray bump at around $100$~s, can be well modelled in the external-shock scenario. For the obtained initial outflow, we estimate the minimum magnetization factor of the jet based on the fact that the photospheric emission of this jet is missed in the very early phase.

astro-ph.HE↗

Jets in a Gamma-Ray Burst During its Prompt Emission: Evolution of Lorentz Factor

Knowledge about the Lorentz factor and its evolution of relativistic jets in gamma-ray bursts (GRBs) is crucial to understand their physics. An exact value of bulk Lorentz factor can be estimated based on a high-energy spectral cutoff, which may appear in GRBs' prompt emission owing to the absorption of photon-photon pair production. In this work, we focus on the investigation of the bulk Lorentz factor evolution of jets in an individual burst. Based on \textsl{Fermi} observations, we search for the bursts with multiple $γ$-ray pulses characterized by a high-energy spectral cutoff, and nine GRBs are obtained. Together with the estimation of the pulse duration and radiation spectrum, the Lorentz factor of jets corresponding to different pulses in an individual GRB are estimated. It is shown that the Lorentz factor of jets in an individual GRB fluctuates within a certain range and without a general trend in these nine GRBs. In addition, the Lorentz factors of the jets in GRBs~130821A, 160509A and 160625B seem to increase with time. We also study the relations among $L_{\rm iso }$, $E_{\rm p,z}$, and $Γ$ for the pulses in our sample, which is found to be consistent with that found in previous works.

astro-ph.HE↗

A Paired Phase and Magnitude Reconstruction for Advanced Diffusion-Weighted Imaging

Objective: Multi-shot interleaved echo planer imaging can obtain diffusion-weighted images (DWI) with high spatial resolution and low distortion, but suffers from ghost artifacts introduced by phase variations between shots. In this work, we aim at solving the challenging reconstructions under inter-shot motions between shots and a low signal-to-noise ratio. Methods: An explicit phase model with paired phase and magnitude priors is proposed to regularize the reconstruction (PAIR). The former prior is derived from the smoothness of the shot phase and enforced with low-rankness in the k-space domain. The latter explores similar edges among multi-b-value and multi-direction DWI with weighted total variation in the image domain. Results: Extensive simulation and in vivo results show that PAIR can remove ghost artifacts very well under a high number of shots (8 shots) and significantly suppress the noise under the ultra-high b-value (4000 s/mm2). Conclusion: The explicit phase model PAIR with complementary priors has a good performance on challenging reconstructions under inter-shot motions between shots and a low signal-to-noise ratio. Significance: PAIR has great potential in advanced clinical DWI applications and brain function research.

eess.SP↗

The PHANGS-JWST Treasury Survey: Star Formation, Feedback, and Dust Physics at High Angular resolution in Nearby GalaxieS

The PHANGS collaboration has been building a reference dataset for the multi-scale, multi-phase study of star formation and the interstellar medium in nearby galaxies. With the successful launch and commissioning of JWST, we can now obtain high-resolution infrared imaging to probe the youngest stellar populations and dust emission on the scales of star clusters and molecular clouds ($\sim$5-50 pc). In Cycle 1, PHANGS is conducting an 8-band imaging survey from 2-21$μ$m of 19 nearby spiral galaxies. CO(2-1) mapping, optical integral field spectroscopy, and UV-optical imaging for all 19 galaxies have been obtained through large programs with ALMA, VLT/MUSE, and Hubble. PHANGS-JWST enables a full inventory of star formation, accurate measurement of the mass and age of star clusters, identification of the youngest embedded stellar populations, and characterization of the physical state of small dust grains. When combined with Hubble catalogs of $\sim$10,000 star clusters, MUSE spectroscopic mapping of $\sim$20,000 HII regions, and $\sim$12,000 ALMA-identified molecular clouds, it becomes possible to measure the timescales and efficiencies of the earliest phases of star formation and feedback, build an empirical model of the dependence of small dust grain properties on local ISM conditions, and test our understanding of how dust-reprocessed starlight traces star formation activity, all across a diversity of galactic environments. Here we describe the PHANGS-JWST Treasury survey, present the remarkable imaging obtained in the first few months of science operations, and provide context for the initial results presented in the first series of PHANGS-JWST publications.

astro-ph.GA↗

A Fine-grained Chinese Software Privacy Policy Dataset for Sequence Labeling and Regulation Compliant Identification

Privacy protection raises great attention on both legal levels and user awareness. To protect user privacy, countries enact laws and regulations requiring software privacy policies to regulate their behavior. However, privacy policies are written in natural languages with many legal terms and software jargon that prevent users from understanding and even reading them. It is desirable to use NLP techniques to analyze privacy policies for helping users understand them. Furthermore, existing datasets ignore law requirements and are limited to English. In this paper, we construct the first Chinese privacy policy dataset, namely CA4P-483, to facilitate the sequence labeling tasks and regulation compliance identification between privacy policies and software. Our dataset includes 483 Chinese Android application privacy policies, over 11K sentences, and 52K fine-grained annotations. We evaluate families of robust and representative baseline models on our dataset. Based on baseline performance, we provide findings and potential research directions on our dataset. Finally, we investigate the potential applications of CA4P-483 combing regulation requirements and program analysis.

cs.CR↗

Path Planning Considering Time-Varying and Uncertain Movement Speed in Multi-Robot Automatic Warehouses: Problem Formulation and Algorithm

Path planning in the multi-robot system refers to calculating a set of actions for each robot, which will move each robot to its goal without conflicting with other robots. Lately, the research topic has received significant attention for its extensive applications, such as airport ground, drone swarms, and automatic warehouses. Despite these available research results, most of the existing investigations are concerned with the cases of robots with a fixed movement speed without considering uncertainty. Therefore, in this work, we study the problem of path-planning in the multi-robot automatic warehouse context, which considers the time-varying and uncertain robots' movement speed. Specifically, the path-planning module searches a path with as few conflicts as possible for a single agent by calculating traffic cost based on customarily distributed conflict probability and combining it with the classic A* algorithm. However, this probability-based method cannot eliminate all conflicts, and speed's uncertainty will constantly cause new conflicts. As a supplement, we propose the other two modules. The conflict detection and re-planning module chooses objects requiring re-planning paths from the agents involved in different types of conflicts periodically by our designed rules. Also, at each step, the scheduling module fills up the agent's preserved queue and decides who has a higher priority when the same element is assigned to two agents simultaneously. Finally, we compare the proposed algorithm with other algorithms from academia and industry, and the results show that the proposed method is validated as the best performance.

cs.RO↗

PHANGS-JWST First Results: Multi-wavelength view of feedback-driven bubbles (The Phantom Voids) across NGC 628

We present a high-resolution view of bubbles within The Phantom Galaxy (NGC 628); a nearby (~10Mpc), star-forming (~2Msun/yr), face-on (i~9deg) grand-design spiral galaxy. With new data obtained as part of the PHANGS-JWST treasury program, we perform a detailed case-study of two regions of interest, one of which contains the largest and most prominent bubble in the galaxy (The Phantom Void; over 1kpc in diameter), and the other being a smaller region that may be the precursor to such a large bubble (The Precursor Phantom Void). When comparing to matched resolution Halpha observations from the Hubble Space Telescope (HST), we see that the ionized gas is brightest in the shells of both bubbles, and is coincident with the youngest (~1Myr) and most massive (~100,000Msun) stellar associations. We also find an older generation (~20Myr) of stellar associations is present within the bubble of The Phantom Void. From our kinematic analysis of the HI, H2 (CO) and HII gas across The Phantom Void, we infer a high expansion speed of around 15 to 50km/s. The large size and high expansion speed of The Phantom Void suggest that the driving mechanism is sustained stellar feedback due to multiple mechanisms, where early feedback first cleared a bubble (as we observe now in The Precursor Phantom Void), and since then SNe have been exploding within the cavity, and have accelerated the shell. Finally, comparison to simulations shows a striking resemblance to our JWST observations, and suggests that such large-scale stellar feedback-driven bubbles should be common within other galaxies.

astro-ph.GA↗

Exploiting Spatial-temporal Correlations for Video Anomaly Detection

Video anomaly detection (VAD) remains a challenging task in the pattern recognition community due to the ambiguity and diversity of abnormal events. Existing deep learning-based VAD methods usually leverage proxy tasks to learn the normal patterns and discriminate the instances that deviate from such patterns as abnormal. However, most of them do not take full advantage of spatial-temporal correlations among video frames, which is critical for understanding normal patterns. In this paper, we address unsupervised VAD by learning the evolution regularity of appearance and motion in the long and short-term and exploit the spatial-temporal correlations among consecutive frames in normal videos more adequately. Specifically, we proposed to utilize the spatiotemporal long short-term memory (ST-LSTM) to extract and memorize spatial appearances and temporal variations in a unified memory cell. In addition, inspired by the generative adversarial network, we introduce a discriminator to perform adversarial learning with the ST-LSTM to enhance the learning capability. Experimental results on standard benchmarks demonstrate the effectiveness of spatial-temporal correlations for unsupervised VAD. Our method achieves competitive performance compared to the state-of-the-art methods with AUCs of 96.7%, 87.8%, and 73.1% on the UCSD Ped2, CUHK Avenue, and ShanghaiTech, respectively.

cs.CV↗

2D and 3D CT Radiomic Features Performance Comparison in Characterization of Gastric Cancer: A Multi-center Study

Objective: Radiomics, an emerging tool for medical image analysis, is potential towards precisely characterizing gastric cancer (GC). Whether using one-slice 2D annotation or whole-volume 3D annotation remains a long-time debate, especially for heterogeneous GC. We comprehensively compared 2D and 3D radiomic features' representation and discrimination capacity regarding GC, via three tasks. Methods: Four-center 539 GC patients were retrospectively enrolled and divided into the training and validation cohorts. From 2D or 3D regions of interest (ROIs) annotated by radiologists, radiomic features were extracted respectively. Feature selection and model construction procedures were customed for each combination of two modalities (2D or 3D) and three tasks. Subsequently, six machine learning models (Model_2D^LNM, Model_3D^LNM; Model_2D^LVI, Model_3D^LVI; Model_2D^pT, Model_3D^pT) were derived and evaluated to reflect modalities' performances in characterizing GC. Furthermore, we performed an auxiliary experiment to assess modalities' performances when resampling spacing is different. Results: Regarding three tasks, the yielded areas under the curve (AUCs) were: Model_2D^LNM's 0.712 (95% confidence interval, 0.613-0.811), Model_3D^LNM's 0.680 (0.584-0.775); Model_2D^LVI's 0.677 (0.595-0.761), Model_3D^LVI's 0.615 (0.528-0.703); Model_2D^pT's 0.840 (0.779-0.901), Model_3D^pT's 0.813 (0.747-0.879). Moreover, the auxiliary experiment indicated that Models_2D are statistically more advantageous than Models3D with different resampling spacings. Conclusion: Models constructed with 2D radiomic features revealed comparable performances with those constructed with 3D features in characterizing GC. Significance: Our work indicated that time-saving 2D annotation would be the better choice in GC, and provided a related reference to further radiomics-based researches.

eess.IV↗

An Attention-Guided and Wavelet-Constrained Generative Adversarial Network for Infrared and Visible Image Fusion

The GAN-based infrared and visible image fusion methods have gained ever-increasing attention due to its effectiveness and superiority. However, the existing methods adopt the global pixel distribution of source images as the basis for discrimination, which fails to focus on the key modality information. Moreover, the dual-discriminator based methods suffer from the confrontation between the discriminators. To this end, we propose an attention-guided and wavelet-constrained GAN for infrared and visible image fusion (AWFGAN). In this method, two unique discrimination strategies are designed to improve the fusion performance. Specifically, we introduce the spatial attention modules (SAM) into the generator to obtain the spatial attention maps, and then the attention maps are utilized to force the discrimination of infrared images to focus on the target regions. In addition, we extend the discrimination range of visible information to the wavelet subspace, which can force the generator to restore the high-frequency details of visible images. Ablation experiments demonstrate the effectiveness of our method in eliminating the confrontation between discriminators. And the comparison experiments on public datasets demonstrate the effectiveness and superiority of the proposed method.

cs.CV↗

EncT5: A Framework for Fine-tuning T5 as Non-autoregressive Models

Pre-trained encoder-decoder transformer architectures have become increasingly popular recently with the advent of T5 models. T5 has also become more favorable over other architectures like BERT due to the amount of data that it is pre-trained on, increased scale of model parameter sizes and easy applicability to a diverse set of tasks due to the generative nature of the model. While being able to generalize to a wide variety of tasks, it is not clear that encoder-decoder architectures are the most efficient for fine-tuning tasks that don't require auto-regressive decoding. In this work, we study fine-tuning pre-trained encoder-decoder models for tasks such as classification, multi-label classification, and structured prediction. We propose \textbf{EncT5}, a framework for these problems, and illustrate instantiations for these tasks. Our experiment results show that EncT5 has advantages over T5 such as efficiency and usability out performs BERT when evaluated on publicly available pre-trained checkpoints.

cs.CL↗

MBTI Personality Prediction for Fictional Characters Using Movie Scripts

An NLP model that understands stories should be able to understand the characters in them. To support the development of neural models for this purpose, we construct a benchmark, Story2Personality. The task is to predict a movie character's MBTI or Big 5 personality types based on the narratives of the character. Experiments show that our task is challenging for the existing text classification models, as none is able to largely outperform random guesses. We further proposed a multi-view model for personality prediction using both verbal and non-verbal descriptions, which gives improvement compared to using only verbal descriptions. The uniqueness and challenges in our dataset call for the development of narrative comprehension techniques from the perspective of understanding characters.

cs.AI↗