Searcharxiv⌕ Search

arXiv subjects

Dong Liu

Publications and source records attributed to Dong Liu.

At least 199 records · Page 11Linked to original sources

Irreducible Modules for Super-Virasoro Algebras from Algebraic D-Modules

In this paper, we introduce a new family of functors from the category of modules for the Weyl algebra to the category of modules for the super-Virasoro algebras. The properties of these functors are investigated, with an emphasis on irreducibility preservation and natural isomorphisms. By utilizing these functors, we recover some old irreducible super-Virasoro modules, including those from the irreducible intermediate series as well as irreducible $U(\mathfrak{h})$-free modules. Additionally, we provide several families of new irreducible super-Virasoro modules via our constructed functors.

math.RT↗

Mask-Based Modeling for Neural Radiance Fields

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply condition the model on image features. These methods still struggle to learn precise global representations over diverse scenes since they lack an effective mechanism for interacting among different points and views. In this work, we unveil that 3D implicit representation learning can be significantly improved by mask-based modeling. Specifically, we propose masked ray and view modeling for generalizable NeRF (MRVM-NeRF), which is a self-supervised pretraining target to predict complete scene representations from partially masked features along each ray. With this pretraining target, MRVM-NeRF enables better use of correlations across different points and views as the geometry priors, which thereby strengthens the capability of capturing intricate details within the scenes and boosts the generalization capability across different scenes. Extensive experiments demonstrate the effectiveness of our proposed MRVM-NeRF on both synthetic and real-world datasets, qualitatively and quantitatively. Besides, we also conduct experiments to show the compatibility of our proposed method with various backbones and its superiority under few-shot cases.

cs.CV↗

Irreducible modules over N=2 superconformal algebras from algebraic D-modules

In this paper, we introduce a family of functors denoted $\mathscr{F}_b$ that act on algebraic D-modules and generate modules over N=2 superconformal algebras. We prove these functors preserve irreducibility for all values of $b$, with a few clear exceptions described. We also establish necessary and sufficient conditions to determine when two such functors are naturally isomorphic. Applying $\mathscr{F}_b$ to N=1 super-Virasoro algebras recovers the functors previously introduced in \cite{CDLP}. Our new functors also facilitate the recovery of specific irreducible modules over N=2 superconformal algebras, including intermediate series and $U(\mathfrak{h})$-free modules. Additionally, our constructed functors produce several new irreducible modules for N=2 superconformal algebras.

math.RT↗

Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting

Transformers have been widely used for video processing owing to the multi-head self attention (MHSA) mechanism. However, the MHSA mechanism encounters an intrinsic difficulty for video inpainting, since the features associated with the corrupted regions are degraded and incur inaccurate self attention. This problem, termed query degradation, may be mitigated by first completing optical flows and then using the flows to guide the self attention, which was verified in our previous work - flow-guided transformer (FGT). We further exploit the flow guidance and propose FGT++ to pursue more effective and efficient video inpainting. First, we design a lightweight flow completion network by using local aggregation and edge loss. Second, to address the query degradation, we propose a flow guidance feature integration module, which uses the motion discrepancy to enhance the features, together with a flow-guided feature propagation module that warps the features according to the flows. Third, we decouple the transformer along the temporal and spatial dimensions, where flows are used to select the tokens through a temporally deformable MHSA mechanism, and global tokens are combined with the inner-window local tokens through a dual perspective MHSA mechanism. FGT++ is experimentally evaluated to be outperforming the existing video inpainting networks qualitatively and quantitatively.

cs.CV↗

MEDPNet: Achieving High-Precision Adaptive Registration for Complex Die Castings

Due to their complex spatial structure and diverse geometric features, achieving high-precision and robust point cloud registration for complex Die Castings has been a significant challenge in the die-casting industry. Existing point cloud registration methods primarily optimize network models using well-established high-quality datasets, often neglecting practical application in real scenarios. To address this gap, this paper proposes a high-precision adaptive registration method called Multiscale Efficient Deep Closest Point (MEDPNet) and introduces a die-casting point cloud dataset, DieCastCloud, specifically designed to tackle the challenges of point cloud registration in the die-casting industry. The MEDPNet method performs coarse die-casting point cloud data registration using the Efficient-DCP method, followed by precision registration using the Multiscale feature fusion dual-channel registration (MDR) method. We enhance the modeling capability and computational efficiency of the model by replacing the attention mechanism of the Transformer in DCP with Efficient Attention and implementing a collaborative scale mechanism through the combination of serial and parallel blocks. Additionally, we propose the MDR method, which utilizes multilayer perceptrons (MLP), Normal Distributions Transform (NDT), and Iterative Closest Point (ICP) to achieve learnable adaptive fusion, enabling high-precision, scalable, and noise-resistant global point cloud registration. Our proposed method demonstrates excellent performance compared to state-of-the-art geometric and learning-based registration methods when applied to complex die-casting point cloud data.

cs.CV↗

Wavelet-Like Transform-Based Technology in Response to the Call for Proposals on Neural Network-Based Image Coding

Neural network-based image coding has been developing rapidly since its birth. Until 2022, its performance has surpassed that of the best-performing traditional image coding framework -- H.266/VVC. Witnessing such success, the IEEE 1857.11 working subgroup initializes a neural network-based image coding standard project and issues a corresponding call for proposals (CfP). In response to the CfP, this paper introduces a novel wavelet-like transform-based end-to-end image coding framework -- iWaveV3. iWaveV3 incorporates many new features such as affine wavelet-like transform, perceptual-friendly quality metric, and more advanced training and online optimization strategies into our previous wavelet-like transform-based framework iWave++. While preserving the features of supporting lossy and lossless compression simultaneously, iWaveV3 also achieves state-of-the-art compression efficiency for objective quality and is very competitive for perceptual quality. As a result, iWaveV3 is adopted as a candidate scheme for developing the IEEE Standard for neural-network-based image coding.

cs.CV↗

Complete Interband Transitions for Non-Hermitian Spin-Orbit-Coupled Cold-Atom Systems

Recently, synthetic spin-orbit coupling has been introduced into cold-atom systems for more flexible control of the Hamiltonian, which was further made time-varying through two-photon detuning to achieve dynamic control of the cold-atom state. While an intraband transition can be adiabatically obtained, a complete interband transition, rather than a superposition of different bands, obtained through fast sweeping is usually guaranteed by having the positions of the initial and final states be far away from any band gap in the quasimomentum space. Here, by introducing an additional non-Hermitian parameter through an atom-loss contrast together with two-photon detuning as two controllable external parameters, both intraband and complete interband transitions can be achieved independent of the positions of the initial and final states. In addition, a point-source diagram approach in the 2D external parameter space is developed to visualize and predict the locations of any nonadiabatic transitions. This control protocol can have potential applications in quantum state control and quantum simulations using cold-atom systems.

quant-ph↗

Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

Recently deep learning-based image compression methods have achieved significant achievements and gradually outperformed traditional approaches including the latest standard Versatile Video Coding (VVC) in both PSNR and MS-SSIM metrics. Two key components of learned image compression are the entropy model of the latent representations and the encoding/decoding network architectures. Various models have been proposed, such as autoregressive, softmax, logistic mixture, Gaussian mixture, and Laplacian. Existing schemes only use one of these models. However, due to the vast diversity of images, it is not optimal to use one model for all images, even different regions within one image. In this paper, we propose a more flexible discretized Gaussian-Laplacian-Logistic mixture model (GLLMM) for the latent representations, which can adapt to different contents in different images and different regions of one image more accurately and efficiently, given the same complexity. Besides, in the encoding/decoding network design part, we propose a concatenated residual blocks (CRB), where multiple residual blocks are serially connected with additional shortcut connections. The CRB can improve the learning ability of the network, which can further improve the compression performance. Experimental results using the Kodak, Tecnick-100 and Tecnick-40 datasets show that the proposed scheme outperforms all the leading learning-based methods and existing compression standards including VVC intra coding (4:4:4 and 4:2:0) in terms of the PSNR and MS-SSIM. The source code is available at \url{https://github.com/fengyurenpingsheng}

eess.IV↗

Modeling the black holes surrounded by a dark matter halo in the galactic center of M87

In this paper, the structure of a dark matter halo can be well described by the mass model of M87 and the Einasto profile for the cold dark matter model, i.e., $ρ_{\text{eina}} (r)=ρ_\text{e} \exp ( -2 α^{-1} ((r/r_\text{e})^α-1 ) )$ (Wang et al. in Nature 585:39-42, 2020). Under these conditions, we construct a solution of a static spherically symmetric black hole in a dark matter halo. Then, using the Newman-janis algorithm, we extend this static solution to the case of rotation, and obtain a solution for the Kerr-like black hole. We prove that this solution of the Kerr-like black hole is indeed a solution to the Einstein field equations. Finally, taking M87 as an example, we study and analyze some physical properties of this Kerr-like black hole, and then compare them with the Kerr black hole. Particularly, from the perspective of the black hole shadow and the fact that the Kerr-like black hole and the Kerr black hole is distinguishable, we give the upper limit of the shape parameter of the Einasto density profile, that is approximately $α<0.22$, which may provide a new method to further improve and perfect the density profile of dark matter model. These research results for the black hole in a dark matter halo may indirectly provide an effective method for detecting the existence of dark matter.

gr-qc↗

Object-Centric Instruction Augmentation for Robotic Manipulation

Humans interpret scenes by recognizing both the identities and positions of objects in their observations. For a robot to perform tasks such as \enquote{pick and place}, understanding both what the objects are and where they are located is crucial. While the former has been extensively discussed in the literature that uses the large language model to enrich the text descriptions, the latter remains underexplored. In this work, we introduce the \textit{Object-Centric Instruction Augmentation (OCI)} framework to augment highly semantic and information-dense language instruction with position cues. We utilize a Multi-modal Large Language Model (MLLM) to weave knowledge of object locations into natural language instruction, thus aiding the policy network in mastering actions for versatile manipulation. Additionally, we present a feature reuse mechanism to integrate the vision-language features from off-the-shelf pre-trained MLLM into policy networks. Through a series of simulated and real-world robotic tasks, we demonstrate that robotic manipulator imitation policies trained with our enhanced instructions outperform those relying solely on traditional language instructions.

cs.RO↗

Language-Conditioned Robotic Manipulation with Fast and Slow Thinking

The language-conditioned robotic manipulation aims to transfer natural language instructions into executable actions, from simple pick-and-place to tasks requiring intent recognition and visual reasoning. Inspired by the dual process theory in cognitive science, which suggests two parallel systems of fast and slow thinking in human decision-making, we introduce Robotics with Fast and Slow Thinking (RFST), a framework that mimics human cognitive architecture to classify tasks and makes decisions on two systems based on instruction types. Our RFST consists of two key components: 1) an instruction discriminator to determine which system should be activated based on the current user instruction, and 2) a slow-thinking system that is comprised of a fine-tuned vision language model aligned with the policy networks, which allows the robot to recognize user intention or perform reasoning tasks. To assess our methodology, we built a dataset featuring real-world trajectories, capturing actions ranging from spontaneous impulses to tasks requiring deliberate contemplation. Our results, both in simulation and real-world scenarios, confirm that our approach adeptly manages intricate tasks that demand intent recognition and reasoning. The project is available at https://jlm-z.github.io/RSFT/

cs.RO↗

Spatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compression

Video compression performance is closely related to the accuracy of inter prediction. It tends to be difficult to obtain accurate inter prediction for the local video regions with inconsistent motion and occlusion. Traditional video coding standards propose various technologies to handle motion inconsistency and occlusion, such as recursive partitions, geometric partitions, and long-term references. However, existing learned video compression schemes focus on obtaining an overall minimized prediction error averaged over all regions while ignoring the motion inconsistency and occlusion in local regions. In this paper, we propose a spatial decomposition and temporal fusion based inter prediction for learned video compression. To handle motion inconsistency, we propose to decompose the video into structure and detail (SDD) components first. Then we perform SDD-based motion estimation and SDD-based temporal context mining for the structure and detail components to generate short-term temporal contexts. To handle occlusion, we propose to propagate long-term temporal contexts by recurrently accumulating the temporal information of each historical reference feature and fuse them with short-term temporal contexts. With the SDD-based motion model and long short-term temporal contexts fusion, our proposed learned video codec can obtain more accurate inter prediction. Comprehensive experimental results demonstrate that our codec outperforms the reference software of H.266/VVC on all common test datasets for both PSNR and MS-SSIM.

cs.CV↗

Opposite variations for pore pressure on and off the fault during simulated earthquakes in the laboratory

We measured the spatiotemporal evolution of pore pressure on- and off-fault during failure and slip in initially intact Westerly granite under triaxial conditions. The pore pressure perturbations in the fault zone and the surrounding bulk presented opposite signs upon shear failure, resulting in large pore pressure gradients over small distances (up to 10 MPa/cm). The on-fault pore pressure dropped due to localised fault dilation associated with fracture coalescence and fault slip, and the off-fault pore pressure increased due to bulk compaction resulting from the closure of dilatant microcracks mostly parallel to the maximum compression axis. Using a simplified analytical pore pressure diffusion model, we were able to capture our observations qualitatively. A quantitative fit could not be achieved, likely due to model simplifications and experimental variability. We show that a reduction in bulk porosity and relatively undrained conditions during failure are necessary for the presence of the off-fault pore pressure elevation. Considering this phenomenon as a consequence of a main shock, we further show that off-fault pore pressure increase have the potential to trigger neighbouring fault instabilities. In nature, we expect the phenomenon of off-fault pore pressure increase to be most relevant to misoriented faults, where the pre-rupture stresses can be large enough to reach the dilatancy threshold in the wall rocks.

physics.geo-ph↗

Black hole surrounded by the pseudo-isothermal dark matter halo

The abundance of dark matter in the actual universe motivates us to construct the black hole spacetime enveloped by dark matter. In this paper, we derive a new spherically symmetric black hole surrounded by the pseudo-isothermal dark matter halo, and then explore the effects of the pseudo-isothermal halo profile on a rotating black hole at the M87 galactic center, aiming to achieve a black hole solution that aligns with those found in the real universe. Using the Newman-Janis method, we derive a rotating black hole solution encompassed by the pseudo-isothermal halo, which is consistent with observations of actual black holes that are believed to possess spin. Our investigation focuses on the impact of the pseudo-isothermal halo on the black hole event horizon, time-like and null orbits, as well as the black hole shadow. We find that as the spin parameter $a$ increases, the interval between the inner event horizon and the outer event horizon of the rotating black hole surrounded by the pseudo-isothermal halo in M87 diminishes. This leads to the formation of an extreme black hole. The presence of dark matter, however, has minimal effect on the event horizon. Moreover, in the M87 as the spin parameter $a$ increases, the black hole shadow deviates increasingly from a standard circle, with larger spin parameters causing more pronounced distortion relative to the standard circle. Surprisingly, we observe that the dark matter density has very little influence on the shadow of the black hole surrounded by the pseudo-isothermal halo in the M87. This study contributes to a deeper understanding of black hole structures and the role of dark matter in the universe.

gr-qc↗

Visual Robotic Manipulation with Depth-Aware Pretraining

Recent work on visual representation learning has shown to be efficient for robotic manipulation tasks. However, most existing works pretrained the visual backbone solely on 2D images or egocentric videos, ignoring the fact that robots learn to act in 3D space, which is hard to learn from 2D observation. In this paper, we examine the effectiveness of pretraining for vision backbone with public-available large-scale 3D data to improve manipulation policy learning. Our method, namely Depth-aware Pretraining for Robotics (DPR), enables an RGB-only backbone to learn 3D scene representations from self-supervised contrastive learning, where depth information serves as auxiliary knowledge. No 3D information is necessary during manipulation policy learning and inference, making our model enjoy both efficiency and effectiveness in 3D space manipulation. Furthermore, we introduce a new way to inject robots' proprioception into the policy networks that makes the manipulation model robust and generalizable. We demonstrate in experiments that our proposed framework improves performance on unseen objects and visual environments for various robotics tasks on both simulated and real robots.

cs.RO↗

Local derivations and local automorphisms on the super Virasoro algebras

This paper aims to study the local derivations, 2-local automorphisms and local automorphisms on the super-Virasoro algebras. The primary focus is to establish that every local derivation of the super-Virasoro algebras is indeed a derivation, and to demonstrate that every local or 2-local automorphism of the super-Virasoro algebras is an automorphism.

math.RA↗

Rotating black hole mimicker surrounded by the string cloud

Traversable wormholes and regular black holes usually represent completely different scenarios. But in the black bounce spacetime they can be described by a same line element, which is very attractive. Furthermore, the black hole photos taken by EHT show that black holes have spin, so spin is an indispensable intrinsic property of black holes in the actual universe. In this work, we derive a rotating black hole mimicker surrounded by the string cloud (SC), which can be interpolated to represent regular black hole spacetime and traversable wormhole spacetime. We investigate the effect of the spin $a$ and SC parameter $L$ on the observables (shadow radius $R_s$ and distortion $δ_s$) and energy emission rate of the black hole mimicker surrounded by the SC. We find that shadow for this spacetime is very sensitive to the $L$, i.e., the SC parameter can significantly increase the boundary of the shadow.

gr-qc↗

Enhancing CT Image synthesis from multi-modal MRI data based on a multi-task neural network framework

Image segmentation, real-value prediction, and cross-modal translation are critical challenges in medical imaging. In this study, we propose a versatile multi-task neural network framework, based on an enhanced Transformer U-Net architecture, capable of simultaneously, selectively, and adaptively addressing these medical image tasks. Validation is performed on a public repository of human brain MR and CT images. We decompose the traditional problem of synthesizing CT images into distinct subtasks, which include skull segmentation, Hounsfield unit (HU) value prediction, and image sequential reconstruction. To enhance the framework's versatility in handling multi-modal data, we expand the model with multiple image channels. Comparisons between synthesized CT images derived from T1-weighted and T2-Flair images were conducted, evaluating the model's capability to integrate multi-modal information from both morphological and pixel value perspectives.

eess.IV↗