Searcharxiv⌕ Search

arXiv subjects

Jian Song

Publications and source records attributed to Jian Song.

At least 55 records · Page 3Linked to original sources

Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correction

Monocular height estimation (MHE) from very-high-resolution (VHR) optical imagery remains challenging due to limited structural cues and the high cost and geographic constraints of conventional elevation data such as airborne LiDAR and multi-view stereo. Although recent MHE and monocular depth estimation (MDE) models show strong performance, their robustness under varied illumination and scene conditions is still limited. We introduce a fully automated correction pipeline that integrates sparse, imperfect global LiDAR measurements from ICESat-2 with deep learning predictions to enhance accuracy and stability. The workflow relies entirely on publicly available models and data and requires only a single georeferenced optical image to produce corrected height maps, enabling low-cost and globally scalable deployment. We also establish the first benchmark for this task, evaluating two random forest based approaches, four parameter efficient fine tuning methods, and full fine tuning. Experiments across six diverse regions at 0.5 m resolution (297 km2), covering the urban cores of Tokyo, Paris, and Sao Paulo as well as suburban and forested areas, show substantial gains. The best method reduces the MHE model's mean absolute error (MAE) by 30.9 percent and improves its F1HE score by 44.2 percent. For the MDE model, MAE improves by 24.1 percent and the F1HE score by 25.1 percent. These results validate the effectiveness of our correction pipeline and demonstrate how sparse global LiDAR can systematically strengthen both MHE and MDE models, enabling scalable and widely accessible 3D height mapping.

cs.CV↗

Anticipated backward stochastic evolution equations and maximum principle for path-dependent systems in infinite dimensions

For a class of path-dependent stochastic evolution equations driven by cylindrical $Q$-Wiener process, we study the Pontryagin's maximum principle for the stochastic recursive optimal control problem. In this infinite-dimensional control system, the state process depends on its past trajectory, the control is delayed via an integral with respect to a general finite measure, and the final cost relies on the delayed state.To obtain the maximum principle, we introduce a functional adjoint operator for the non-anticipative path derivative and establish the well-posedness of an anticipated backward stochastic evolution equation in the path-dependent form, which serves as the adjoint equation.

math.OC↗

DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Response

Large vision-language models (VLMs) have made great achievements in Earth vision. However, complex disaster scenes with diverse disaster types, geographic regions, and satellite sensors have posed new challenges for VLM applications. To fill this gap, we curate a remote sensing vision-language dataset (DisasterM3) for global-scale disaster assessment and response. DisasterM3 includes 26,988 bi-temporal satellite images and 123k instruction pairs across 5 continents, with three characteristics: 1) Multi-hazard: DisasterM3 involves 36 historical disaster events with significant impacts, which are categorized into 10 common natural and man-made disasters. 2)Multi-sensor: Extreme weather during disasters often hinders optical sensor imaging, making it necessary to combine Synthetic Aperture Radar (SAR) imagery for post-disaster scenes. 3) Multi-task: Based on real-world scenarios, DisasterM3 includes 9 disaster-related visual perception and reasoning tasks, harnessing the full potential of VLM's reasoning ability with progressing from disaster-bearing body recognition to structural damage assessment and object relational reasoning, culminating in the generation of long-form disaster reports. We extensively evaluated 14 generic and remote sensing VLMs on our benchmark, revealing that state-of-the-art models struggle with the disaster tasks, largely due to the lack of a disaster-specific corpus, cross-sensor gap, and damage object counting insensitivity. Focusing on these issues, we fine-tune four VLMs using our dataset and achieve stable improvements across all tasks, with robust cross-sensor and cross-disaster generalization capabilities. The code and data are available at: https://github.com/Junjue-Wang/DisasterM3.

cs.CV↗

Channel Capacity for FMCW-based Optical Wireless Integrated Sensing and Communication: Asymptotic Analysis and Envelope Design

Optical wireless integrated sensing and communication (OW-ISAC) is rapidly burgeoning as a complement and augmentation to its radio-frequency counterpart. In this paper, the channel capacity is analyzed to guide the design of a coherent OW-ISAC system based on frequency-modulated continuous wave (FMCW). Firstly, the system model of FMCW-based OW-ISAC is recast into an information-theoretic formulation, where an additional harmonic-mean constraint is imposed to ensure the sensing performance. Subsequently, both lower and upper bounds for channel capacity are derived under the imposed sensing constraint, based on which asymptotic expressions for channel capacity are presented for both low and high signal-to-noise-ratio regions. Moreover, the analysis of channel capacity provides guidance for the envelope design based on pulse amplitude modulation, whose capacity-achieving capabilities are demonstrated by numerical results. Furthermore, simulations reveal the trade-off between communication and sensing functionalities. In summary, the analysis of channel capacity under the sensing constraint provides insights into both the optimality and the practicality of OW-ISAC design.

cs.IT↗

BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response

Disaster events occur around the world and cause significant damage to human life and property. Earth observation (EO) data enables rapid and comprehensive building damage assessment (BDA), an essential capability in the aftermath of a disaster to reduce human casualties and to inform disaster relief efforts. Recent research focuses on the development of AI models to achieve accurate mapping of unseen disaster events, mostly using optical EO data. However, solutions based on optical data are limited to clear skies and daylight hours, preventing a prompt response to disasters. Integrating multimodal (MM) EO data, particularly the combination of optical and SAR imagery, makes it possible to provide all-weather, day-and-night disaster responses. Despite this potential, the development of robust multimodal AI models has been constrained by the lack of suitable benchmark datasets. In this paper, we present a BDA dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response. To the best of our knowledge, BRIGHT is the first open-access, globally distributed, event-diverse MM dataset specifically curated to support AI-based disaster response. It covers five types of natural disasters and two types of man-made disasters across 14 regions worldwide, with a particular focus on developing countries where external assistance is most needed. The optical and SAR imagery in BRIGHT, with a spatial resolution between 0.3-1 meters, provides detailed representations of individual buildings, making it ideal for precise BDA. In our experiments, we have tested seven advanced AI models trained with our BRIGHT to validate the transferability and robustness. The dataset and code are available at https://github.com/ChenHongruixuan/BRIGHT. BRIGHT also serves as the official dataset for the 2025 IEEE GRSS Data Fusion Contest.

cs.CV↗

CSIYOLO: An Intelligent CSI-based Scatter Sensing Framework for Integrated Sensing and Communication Systems

ISAC is regarded as a promising technology for next-generation communication systems, enabling simultaneous data transmission and target sensing. Among various tasks in ISAC, scatter sensing plays a crucial role in exploiting the full potential of ISAC and supporting applications such as autonomous driving and low-altitude economy. However, most existing methods rely on either waveform and hardware modifications or traditional signal processing schemes, leading to poor compatibility with current communication systems and limited sensing accuracy. To address these challenges, we propose CSIYOLO, a framework that performs scatter localization only using estimated CSI from a single base station-user equipment pair. This framework comprises two main components: anchor-based scatter parameter detection and CSI-based scatter localization. First, by formulating scatter parameter extraction as an image detection problem, we propose an anchor-based scatter parameter detection method inspired by You Only Look Once architectures. After that, a CSI-based localization algorithm is derived to determine scatter locations with extracted parameters. Moreover, to improve localization accuracy and implementation efficiency, we design an extendable network structure with task-oriented optimizations, enabling multi-scale anchor detection and better adaptation to CSI characteristics. A noise injection training strategy is further designed to enhance robustness against channel estimation errors. Since the proposed framework operates solely on estimated CSI without modifying waveforms or signal processing pipelines, it can be seamlessly integrated into existing communication systems as a plugin. Experiments show that our proposed method can significantly outperform existing methods in scatter localization accuracy with relatively low complexities under varying numbers of scatters and estimation errors.

eess.SP↗

Motion Estimation for Multi-Object Tracking using KalmanNet with Semantic-Independent Encoding

Motion estimation is a crucial component in multi-object tracking (MOT). It predicts the trajectory of objects by analyzing the changes in their positions in consecutive frames of images, reducing tracking failures and identity switches. The Kalman filter (KF) based on the linear constant-velocity model is one of the most commonly used methods in MOT. However, it may yield unsatisfactory results when KF's parameters are mismatched and objects move in non-stationary. In this work, we utilize the learning-aided filter to handle the motion estimation of MOT. In particular, we propose a novel method named Semantic-Independent KalmanNet (SIKNet), which encodes the state vector (the input feature) using a Semantic-Independent Encoder (SIE) by two steps. First, the SIE uses a 1D convolution with a kernel size of 1, which convolves along the dimension of homogeneous-semantic elements across different state vectors to encode independent semantic information. Then it employs a fully-connected layer and a nonlinear activation layer to encode nonlinear and cross-dependency information between heterogeneous-semantic elements. To independently evaluate the performance of the motion estimation module in MOT, we constructed a large-scale semi-simulated dataset from several open-source MOT datasets. Experimental results demonstrate that the proposed SIKNet outperforms the traditional KF and achieves superior robustness and accuracy than existing learning-aided filters. The code is available at (https://github.com/SongJgit/filternet and https://github.com/SongJgit/TBDTracker).

cs.CV↗

Backward stochastic differential equations with nonlinear Young drivers II

This paper continues our previous work (Part I, arXiv:2504.18632v3) on the well-posedness of backward stochastic differential equations (BSDEs) involving a nonlinear Young integral of the form $\int_{t}^{T}g(Y_{r})η(dr,X_{r})$, with particular focus on the case where the driver $η(t,x)$ is unbounded. To address this setting, we develop a new localization method that extends solvability from BSDEs with bounded drivers to those with unbounded ones. As a direct application, we derive a nonlinear Feynman-Kac formula for a class of partial differential equations driven by Young signals (Young PDEs). Moreover, employing the proposed localization method, we obtain error estimates that compare Cauchy-Dirichlet problems on bounded domains with their whole-space Cauchy counterparts, with special attention to non-Lipschitz PDEs.

math.PR↗

Hölder estimates for degenerate complex Monge-Ampère equations

Uniform $L^\infty$ and Hölder estimates were proved by the Kolodziej for complex Monge-Ampère equations on compact Kähler manifolds with $L^p$ volume measure with $p>1$. On the other hand, establishing Hölder estimates on singular Kähler varieties has remained open. In this paper, we establish uniform Hölder continuity for a family of complex Monge-Ampère equations on Kähler varieties, by developing a geometric regularization based on the partial $C^0$ estimate, i.e., quantitive Kodaira embeddings. As an application, we prove that local potentials of smoothable Kähler-Einstein varieties are Hölder continuous.

math.CV↗

Flexible orbital torque device with ultralow switching current

Orbital torque (OT) offers a highly efficient way for electrical magnetization manipulation. However, its potential in the emerging field of flexible spintronics remains largely unexplored. Here, we demonstrate a flexible and robust OT device based on a mica/SrRuO3(SRO)/CoPt heterostructure. We measure a large torque efficiency of -0.31, which originates from the significant orbital Hall effect in the SRO layer. Leveraging the low thermal conductivity of the mica substrate, a thermally-assisted switching mechanism is activated, enabling an ultralow threshold current density of 9.2x109 A/m2. This value represents a 90% reduction compared to conventional spin-torque devices and a 52% reduction against its rigid counterpart on a SrTiO3 substrate. The superior performances is well-maintained after 103 bending cycles, conforming its exceptional flexibility and durability. Our work pioneers the development of flexible OT devices, showcasing a viable path toward next-generation, low-power wearable spintronic applications.

cond-mat.mtrl-sci↗

Video Demoireing using Focused-Defocused Dual-Camera System

Moire patterns, unwanted color artifacts in images and videos, arise from the interference between spatially high-frequency scene contents and the spatial discrete sampling of digital cameras. Existing demoireing methods primarily rely on single-camera image/video processing, which faces two critical challenges: 1) distinguishing moire patterns from visually similar real textures, and 2) preserving tonal consistency and temporal coherence while removing moire artifacts. To address these issues, we propose a dual-camera framework that captures synchronized videos of the same scene: one in focus (retaining high-quality textures but may exhibit moire patterns) and one defocused (with significantly reduced moire patterns but blurred textures). We use the defocused video to help distinguish moire patterns from real texture, so as to guide the demoireing of the focused video. We propose a frame-wise demoireing pipeline, which begins with an optical flow based alignment step to address any discrepancies in displacement and occlusion between the focused and defocused frames. Then, we leverage the aligned defocused frame to guide the demoireing of the focused frame using a multi-scale CNN and a multi-dimensional training loss. To maintain tonal and temporal consistency, our final step involves a joint bilateral filter to leverage the demoireing result from the CNN as the guide to filter the input focused frame to obtain the final output. Experimental results demonstrate that our proposed framework largely outperforms state-of-the-art image and video demoireing methods.

cs.CV↗

Towards High-Precision Depth Sensing via Monocular-Aided iToF and RGB Integration

This paper presents a novel iToF-RGB fusion framework designed to address the inherent limitations of indirect Time-of-Flight (iToF) depth sensing, such as low spatial resolution, limited field-of-view (FoV), and structural distortion in complex scenes. The proposed method first reprojects the narrow-FoV iToF depth map onto the wide-FoV RGB coordinate system through a precise geometric calibration and alignment module, ensuring pixel-level correspondence between modalities. A dual-encoder fusion network is then employed to jointly extract complementary features from the reprojected iToF depth and RGB image, guided by monocular depth priors to recover fine-grained structural details and perform depth super-resolution. By integrating cross-modal structural cues and depth consistency constraints, our approach achieves enhanced depth accuracy, improved edge sharpness, and seamless FoV expansion. Extensive experiments on both synthetic and real-world datasets demonstrate that the proposed framework significantly outperforms state-of-the-art methods in terms of accuracy, structural consistency, and visual quality.

cs.CV↗

Backward stochastic differential equations with nonlinear Young drivers I

This paper (alongside its companion, Part II \cite{BSDEYoung-II}) investigates backward stochastic differential equations (BSDEs) involving a nonlinear Young integral of the form $\int_{t}^{T}g(Y_{r})η(dr,X_{r})$, where the driver $η(t,x)$ is a space-time Hölder continuous function and $X$ is a diffusion process. Solutions to such equations provide a probabilistic interpretation of the solutions to stochastic partial differential equations (SPDEs) driven by space-time noise. Assuming the driver $η(t,x)$ is bounded, we establish the existence and uniqueness of the solutions to these BSDEs via a modified Picard iteration method. We then derive a comparison principle by analyzing the associated linear BSDEs and establish regularity properties of the solutions. As an application, we obtain Feynman-Kac formulae for a class of linear stochastic heat equations subject to Neumann boundary conditions.

math.PR↗

Analysis of Deep Learning-Based Colorization and Super-Resolution Techniques for Lidar Imagery

Modern lidar systems can produce not only dense point clouds but also 360 degrees low-resolution images. This advancement facilitates the application of deep learning (DL) techniques initially developed for conventional RGB cameras and simplifies fusion of point cloud data and images without complex processes like lidar-camera calibration. Compared to RGB images from traditional cameras, lidar-generated images show greater robustness under low-light and harsh conditions, such as foggy weather. However, these images typically have lower resolution and often appear overly dark. While various studies have explored DL-based computer vision tasks such as object detection, segmentation, and keypoint detection on lidar imagery, other potentially valuable techniques remain underexplored. This paper provides a comprehensive review and qualitative analysis of DL-based colorization and super-resolution methods applied to lidar imagery. Additionally, we assess the computational performance of these approaches, offering insights into their suitability for downstream robotic and autonomous system applications like odometry and 3D reconstruction.

cs.RO↗

Path Loss Modeling for NLoS Ultraviolet Channels Incorporating Scattering and Reflection Effects

This paper tackles limitations in existing non-line-of-sight (NLoS) ultraviolet (UV) channel models, where conventional approaches assume obstacle-free propagation or uniform radiation intensity. In this paper, we develop a path loss model incorporating scattering and reflection, and then propose an obstacle-boundary approximation method to achieve computational tractability. Our framework systematically incorporates spatial obstacle properties, including dimensions, coordinates, contours, and orientation angles, while employing the Lambertian radiation pattern for source modeling. Additionally, the proposed path loss model is validated by comparing it with the Monte-Carlo photon-tracing model and analytical integral model via numerical results, which indicate that when obstacle reflection is prominent, an approximation treatment of obstacle boundaries has a negligible influence on the path loss estimation of NLoS UV communication channels.

eess.SP↗

Age of Synchronization Minimization in Wireless Networks with Random Updates and Time-Varying Timeliness Requirement

This study considers a wireless network where multiple nodes transmit status updates to a base station (BS) via a shared, error-free channel with limited bandwidth. The status updates arrive at each node randomly. We use the Age of Synchronization (AoS) as a metric to measure the information freshness of the updates. The AoS of each node has a timely-varying importance which follows a Markov chain. Our objective is to minimize the weighted sum AoS of the system. The optimization problem is relaxed and formulated as a constrained Markov decision process (CMDP). Solving the relaxed CMDP by a linear programming algorithm yields a stationary policy, which helps us propose a near-stationary policy for the original problem. Numerical simulations show that in most configurations, the AoS performance of our policy outperforms the policy choosing the maximum AoS regardless of weight variations.

cs.IT↗

RCD structures on singular Kahler spaces of complex dimension three

Let X be a projective variety of complex dimension 3 with log terminal singularities. We prove that every singular Kahler metric on X with bounded Nash entropy and Ricci curvature bounded below induces a compact RCD space homeomorphic to the projective variety X itself. In particular, singular Kahler-Einstein spaces of complex dimension 3 with bounded Nash entropy are compact RCD spaces topologically and holomorphically equivalent to the underlying projective variety. Various compactness theorems are also obtained for 3-dimensional projective varieties with bounded Ricci curvature. Such results establish connections among algebraic, geometric and analytic structures of klt singularities from birational geometry and provide abundant examples of RCD spaces from algebraic geometry via complex Monge-Ampere equations.

math.DG↗

Age Optimal Sampling for Unreliable Channels under Unknown Channel Statistics

In this paper, we study a system in which a sensor forwards status updates to a receiver through an error-prone channel, while the receiver sends the transmission results back to the sensor via a reliable channel. Both channels are subject to random delays. To evaluate the timeliness of the status information at the receiver, we use the Age of Information (AoI) metric. The objective is to design a sampling policy that minimizes the expected time-average AoI, even when the channel statistics (e.g., delay distributions) are unknown. We first review the threshold structure of the optimal offline policy under known channel statistics and then reformulate the design of the online algorithm as a stochastic approximation problem. We propose a Robbins-Monro algorithm to solve this problem and demonstrate that the optimal threshold can be approximated almost surely. Moreover, we prove that the cumulative AoI regret of the online algorithm increases with rate $\mathcal{O}(\ln K)$, where $K$ is the number of successful transmissions. In addition, our algorithm is shown to be minimax order optimal, in the sense that for any online learning algorithm, the cumulative AoI regret up to the $K$-th successful transmissions grows with the rate at least $Ω(\ln K)$ in the worst case delay distribution. Finally, we improve the stability of the proposed online learning algorithm through a momentum-based stochastic gradient descent algorithm. Simulation results validate the performance of our proposed algorithm.

cs.IT↗