SearcharxivSearch

arXiv subjects

Ning Jin

Publications and source records attributed to Ning Jin.

10 recordsLinked to original sources

LightGTS-Cov: Covariate-Enhanced Time Series Forecasting

Time series foundation models are typically pre-trained on large, multi-source datasets; however, they often ignore exogenous covariates or incorporate them via simple concatenation with the target series, which limits their effectiveness in covariate-rich applications such as electricity price forecasting and renewable energy forecasting. We introduce LightGTS-Cov, a covariate-enhanced extension of LightGTS that preserves its lightweight, period-aware backbone while explicitly incorporating both past and future-known covariates. Built on a $\sim$1M-parameter LightGTS backbone, LightGTS-Cov adds only a $\sim$0.1M-parameter MLP plug-in that integrates time-aligned covariates into the target forecasts by residually refining the outputs of the decoding process. Across covariate-aware benchmarks on electricity price and energy generation datasets, LightGTS-Cov consistently outperforms LightGTS and achieves superior performance over other covariate-aware baselines under both settings, regardless of whether future-known covariates are provided. We further demonstrate its practical value in two real-world energy case applications: long-term photovoltaic power forecasting with future weather forecasts and day-ahead electricity price forecasting with weather and dispatch-plan covariates. Across both applications, LightGTS-Cov achieves strong forecasting accuracy and stable operational performance after deployment, validating its effectiveness in real-world industrial settings.

cs.LG

CrossAD: Time Series Anomaly Detection with Cross-scale Associations and Cross-window Modeling

Time series anomaly detection plays a crucial role in a wide range of real-world applications. Given that time series data can exhibit different patterns at different sampling granularities, multi-scale modeling has proven beneficial for uncovering latent anomaly patterns that may not be apparent at a single scale. However, existing methods often model multi-scale information independently or rely on simple feature fusion strategies, neglecting the dynamic changes in cross-scale associations that occur during anomalies. Moreover, most approaches perform multi-scale modeling based on fixed sliding windows, which limits their ability to capture comprehensive contextual information. In this work, we propose CrossAD, a novel framework for time series Anomaly Detection that takes Cross-scale associations and Cross-window modeling into account. We propose a cross-scale reconstruction that reconstructs fine-grained series from coarser series, explicitly capturing cross-scale associations. Furthermore, we design a query library and incorporate global multi-scale context to overcome the limitations imposed by fixed window sizes. Extensive experiments conducted on multiple real-world datasets using nine evaluation metrics validate the effectiveness of CrossAD, demonstrating state-of-the-art performance in anomaly detection.

cs.LG

Cardiac and respiratory motion extraction for MRI using Pilot Tone-a patient study

Background: Several studies have shown that both respiratory and cardiac motion can be extracted from the Pilot Tone (PT) signal successfully. However, most of these studies were performed in healthy volunteers. In addition, validating PT using ECG as a reference can be problematic because both PT and ECG tend to be unreliable in patients with arrhythmias. Purpose: We seek to evaluate the accuracy and reliability of the cardiac and respiratory signals extracted from PT in patients clinically referred for cardiovascular MRI with the image-derived signals as the reference. Methods: Twenty-three patients were scanned on a 1.5 T scanner using balanced steady-state free-precession real-time (RT) cine sequence. The PT signal was generated by a built-in PT transmitter integrated within the body array coil. For comparison, commercial ECG and BioMatrix (BM) respiratory sensor signals were synchronously recorded. Results: The respiratory motion extracted from PT correlated positively with the image-derived respiratory signal in all cases and showed a stronger correlation (absolute coefficient: 0.95+-0.09) than BM (0.72+-0.24). For the cardiac signal, PT trigger jitter (standard deviation of PT trigger locations relative to ECG triggers) ranged from 6.6 to 83.3 ms, with a median of 21.8 ms. The mean absolute difference between the PT and corresponding ECG cardiac cycle duration was less than 5% of the averaged ECG RR interval for 21 out of 23 patients. Overall, the performance of PT-based trigger extraction was comparable to that of ECG. We did not observe significant linear dependence (p>0.28) of PT delay and PT jitter on the patients' BMI or cardiac cycle duration. Conclusions: This study demonstrates the potential of PT to monitor both respiratory and cardiac motion in patients clinically referred for cardiovascular MRI.

eess.SP

Influence of portal vein occlusion on portal flow and liver elasticity in an animal model

Hepatic fibrosis causes an increase in liver stiffness, a parameter measured by elastography and widely used as a diagnosis method. The concomitant presence of portal vein thrombosis (PVT) implies a change in hepatic portal inflow that could also affect liver elasticity. The main objective of this study is to determine the extent to which the presence of portal occlusion can affect the mechanical properties of the liver and potentially lead to misdiagnosis of fibrosis and hepatic cirrhosis by elastography. Portal vein occlusion was generated by insertion and inflation of a balloon catheter in the portal vein of four swines. The portal flow parameters peak flow (PF) and peak velocity magnitude (PVM) and liver mechanical properties (shear modulus) were then investigated using 4D-flow MRI and MR elastography, respectively, for progressive obstructions of the portal vein. Experimental results indicate that the reduction of the intrahepatic venous blood flow (PF/PVM decreases of 29.3%/8.5%, 51.0%/32.3% and 83.3%/53.6%, respectively) measured with 50%, 80% and 100% obstruction of the portal vein section results in a decrease of liver stiffness by $0.8\%\pm0.1\%$, $7.7\%\pm0.4\%$ and $12.3\%\pm0.9\%$, respectively. While this vascular mechanism does not have sufficient influence on the elasticity of the liver to modify the diagnosis of severe fibrosis or cirrhosis (F4 METAVIR grade), it may be sufficient to attenuate the increase in stiffness due to moderate fibrosis (F2-F3 METAVIR grades) and consequently lead to false-negative diagnoses with elastography in the presence of PVT.

physics.med-ph

Magnetic Resonance Elastography and Portal Hypertension: Influence of the Portal Venous Flow on the Liver Stiffness

The invasive measurement of the hepatic venous pressure gradient is still considered as the reference method to assess the severity of portal hypertension. Even though previous studies have shown that the liver stiffness measured by elastography could predict portal hypertension in patients with chronic liver disease, the mechanisms behind remain today poorly understood. The main reason is that the liver stiffness is not specific to portal hypertension and is also influenced by concomitant pathologies, such as cirrhosis. Portal hypertension is also source of a vascular incidence, with a substantial diversion of portal venous blood to the systemic circulation, bypassing the liver. This study focuses on this vascular effect of portal hypertension. We propose to generate and control the portal venous flow (to isolate the modifications in the portal venous flow as single effect of portal hypertension) in an anesthetized pig and then to quantify its implications on liver stiffness by an original combination of MRE and 4D-Flow Magnetic Resonance Imaging (MRI). A catheter balloon is progressively inflated in the portal vein and the peak flow, peak velocity magnitude and liver stiffness are quantified in a 1.5T MRI scanner (AREA, Siemens Healthcare, Erlangen, Germany). A strong correlation is observed between the portal peak velocity magnitude, the portal peak flow or the liver stiffness and the portal vein intraluminal obstruction. Moreover, the comparison of mechanical and flow parameters highlights a correlation with the possibility of identifying linear relationships. These results give preliminary indications about how liver stiffness can be affected by portal venous flow and, by extension, by hypertension.

physics.med-ph

Self-Supervised Learning of State Estimation for Manipulating Deformable Linear Objects

We demonstrate model-based, visual robot manipulation of linear deformable objects. Our approach is based on a state-space representation of the physical system that the robot aims to control. This choice has multiple advantages, including the ease of incorporating physics priors in the dynamics model and perception model, and the ease of planning manipulation actions. In addition, physical states can naturally represent object instances of different appearances. Therefore, dynamics in the state space can be learned in one setting and directly used in other visually different settings. This is in contrast to dynamics learned in pixel space or latent space, where generalization to visual differences are not guaranteed. Challenges in taking the state-space approach are the estimation of the high-dimensional state of a deformable object from raw images, where annotations are very expensive on real data, and finding a dynamics model that is both accurate, generalizable, and efficient to compute. We are the first to demonstrate self-supervised training of rope state estimation on real images, without requiring expensive annotations. This is achieved by our novel self-supervising learning objective, which is generalizable across a wide range of visual appearances. With estimated rope states, we train a fast and differentiable neural network dynamics model that encodes the physics of mass-spring systems. Our method has a higher accuracy in predicting future states compared to models that do not involve explicit state estimation and do not use any physics prior, while only using 3\% of training data. We also show that our approach achieves more efficient manipulation, both in simulation and on a real robot, when used within a model predictive controller.

cs.RO

Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation

Neural models that independently project questions and answers into a shared embedding space allow for efficient continuous space retrieval from large corpora. Independently computing embeddings for questions and answers results in late fusion of information related to matching questions to their answers. While critical for efficient retrieval, late fusion underperforms models that make use of early fusion (e.g., a BERT based classifier with cross-attention between question-answer pairs). We present a supervised data mining method using an accurate early fusion model to improve the training of an efficient late fusion retrieval model. We first train an accurate classification model with cross-attention between questions and answers. The accurate cross-attention model is then used to annotate additional passages in order to generate weighted training examples for a neural retrieval model. The resulting retrieval model with additional data significantly outperforms retrieval models directly trained with gold annotations on Precision at $N$ (P@N) and Mean Reciprocal Rank (MRR).

cs.CL

Fully Self-Gated Whole-Heart 4D Flow Imaging from a Five-Minute Scan

Purpose: To develop and validate an acquisition and processing technique that enables fully self-gated 4D flow imaging with whole-heart coverage in a fixed five-minute scan. Theory and Methods: The data are acquired continuously using Cartesian sampling and sorted into respiratory and cardiac bins using the self-gating signal. The reconstruction is performed using a recently proposed Bayesian method called ReVEAL4D. ReVEAL4D is validated using data from eight healthy volunteers and two patients and compared with a compressed sensing technique, L1-SENSE. Results: Healthy subjects -- Compared to 2D phase-contrast MRI (2D-PC), flow quantification from ReVEAL4D shows no significant bias. In contrast, the peak velocity and peak flow rate for L1-SENSE are significantly underestimated. Compared to traditional parallel MRI-based 4D flow imaging, ReVEAL4D demonstrates small but significant biases in net flow and peak flow rate, with no significant bias in peak velocity. All three indices are significantly and more markedly underestimated by L1-SENSE. Patients -- Flow quantification from ReVEAL4D agrees well with the 2D-PC reference. In contrast, L1-SENSE markedly underestimated peak velocity. Conclusions: The combination of highly accelerated five-minute Cartesian acquisition, self-gating, and ReVEAL4D enables whole-heart 4D flow imaging with accurate flow quantification.

eess.IV

A Pixel-Based Framework for Data-Driven Clothing

With the aim of creating virtual cloth deformations more similar to real world clothing, we propose a new computational framework that recasts three dimensional cloth deformation as an RGB image in a two dimensional pattern space. Then a three dimensional animation of cloth is equivalent to a sequence of two dimensional RGB images, which in turn are driven/choreographed via animation parameters such as joint angles. This allows us to leverage popular CNNs to learn cloth deformations in image space. The two dimensional cloth pixels are extended into the real world via standard body skinning techniques, after which the RGB values are interpreted as texture offsets and displacement maps. Notably, we illustrate that our approach does not require accurate unclothed body shapes or robust skinning techniques. Additionally, we discuss how standard image based techniques such as image partitioning for higher resolution, GANs for merging partitioned image regions back together, etc., can readily be incorporated into our framework.

cs.CV

Every Moment Counts: Dense Detailed Labeling of Actions in Complex Videos

Every moment counts in action recognition. A comprehensive understanding of human activity in video requires labeling every frame according to the actions occurring, placing multiple labels densely over a video sequence. To study this problem we extend the existing THUMOS dataset and introduce MultiTHUMOS, a new dataset of dense labels over unconstrained internet videos. Modeling multiple, dense labels benefits from temporal relations within and across classes. We define a novel variant of long short-term memory (LSTM) deep networks for modeling these temporal relations via multiple input and output connections. We show that this model improves action labeling accuracy and further enables deeper understanding tasks ranging from structured retrieval to action prediction.

cs.CV