arXiv subjects

Nishant Sinha

Publications and source records attributed to Nishant Sinha.

At least 19 recordsLinked to original sources

arXiv2026

BLUE: Semantics-Preserving Video Compression for Efficient Vision-Language Surveillance Analytics

Continuous surveillance video creates a growing storage, transmission, and inference burden for enterprise video analytics systems. While modern codecs such as H.265 reduce bitrate for human-viewable video, aggressive compression can degrade downstream computer-vision performance and does not necessarily reduce the number of vision-language model (VLM) inference calls required for semantic video understanding. This paper evaluates BLUE, a fixed-camera surveillance compression approach that suppresses static-background redundancy while preserving foreground activity, for its effect on VLM-based event and anomaly understanding. We compare raw H.265 and BLUE-compressed H.265 video on two surveillance datasets: VIRAT, comprising 227 paired event samples from 106 clips, and CHAD, comprising 54 human-activity anomaly clips. For each pair, the same frame index is evaluated using a VLM captioning pipeline, and outputs are scored against annotation-derived ground truth using a blind judging protocol. The results show no measurable degradation in semantic inference quality. On VIRAT, the mean VLM score remains effectively unchanged between raw H.265 and BLUE, with a mean difference of approximately -0.01 on a 0-10 scale. On CHAD, raw H.265 and BLUE obtain near-equivalent mean scores of 4.31 and 4.26, respectively. Compression saving is also uncorrelated with VLM score change on VIRAT (r = 0.004), indicating that higher BLUE compression does not predict semantic quality loss. Beyond storage reduction, BLUE increases the share of skip-heavy P-frames on CHAD from 1.4% to 53.2%, enabling an estimated 53% reduction in VLM calls through packet-size-based frame skipping. These findings suggest that BLUE functions as a machine-centric compression layer for surveillance video, reducing bandwidth and inference cost while preserving VLM semantic performance.

eess.IV↗

arXiv2026

ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning

Long-video question answering requires a model to preserve visual evidence over time without repeatedly reprocessing the same video. A practical approach is to store the vision-language model's internal key-value (KV) cache for each video chunk and retrieve that state at query time. However, independently cached video chunks do not compose correctly: every chunk is prefilled from local rotary position zero, so naive concatenation collides temporal phases and removes the global order required for questions about what happened first, how often events occurred, or what changed across the video. This paper presents ChronoStitch, a training-free method for composing independently stored visual KV memories. The method first re-bases stored post-rotary keys onto a global three-axis multimodal RoPE coordinate system that preserves time, height, and width structure. We show why a one-dimensional scalar re-indexing is geometrically inconsistent for visual tokens because it turns spatial order within a frame into false temporal displacement. We then address the residual content gap left by positional repair: later chunks were originally encoded without attending to earlier chunks. ChronoStitch therefore selectively recomputes a small fraction of high-deviation later-chunk visual tokens while allowing them to attend over the composed cache. On Qwen2.5-VL-3B and the temporal split of TempCompass, ChronoStitch outperforms naive composition and position-only variants, improving event-ordering accuracy while running 3.3x faster than full joint re-prefilling.

cs.CV↗

arXiv2026

BLUE: A Stale-Pixel Optical-Flow Compositor for Entropy-Efficient Surveillance Video Encoding

Continuous-recording surveillance systems face a storage problem that codec tuning alone cannot fully solve: even at aggressive CRF settings, a static-camera scene spends most of its bits re-encoding a background that has not changed. We present BLUE, a pre-encode compositor that exploits this structure by maintaining a persistent seed frame of the background and substituting background pixels with seed pixels before the encoder runs. The encoder then emits near-free SKIP macroblocks for the frozen background, while live pixels in foreground regions are carried unchanged at full quality. We evaluate BLUE on all 308 annotated short subclips from the VIRAT Ground Surveillance Release 2.0 dataset using a six-point CRF sweep with both x264 and x265. At CRF 28, BLUE reduces file size by a mean of 34.6% (x264) / 39.4% (x265) on 95.8% / 99.4% of clips respectively. Foreground-region PSNR, computed only over VIRAT object-annotation bounding boxes, is preserved or improved on 60.7% of clips (+0.36 dB mean, +5.48 dB maximum). Full-frame perceptual quality (VMAF) drops by a median of 6.75-8.59 points; we quantify and disclose this trade-off explicitly. A lightweight deployment gate measuring the compositor's own VMAF on a 2-second prefix identifies the 40% of clips where even full-frame quality degradation is near-imperceptible (Delta VMAF <= -2.9), enabling a selective-activation strategy that retains both the storage benefit and acceptable perceptual fidelity.

eess.IV↗

arXiv2026

$μ$-FlowNet: A Deep Learning Approach for Mapping Flow Fields in Irregular Microchannels Using an Attention-based U-Net Encoder-Decoder Architecture

In the complex domain of microfluidics systems, analysing fluid flow patterns through random-shaped circular microchannels is significantly challenging task. Conventional approach of solving such problems using computational fluid dynamics often incapable due to their intensive computational requirements and high simulation times. In this study, addressing these limitations, we introduce $μ$-FlowNet, a deep learning framework based on the adaptable U-Net autoencoders. This model provides a data-driven approach that enhances the prediction and mapping of random-shaped circular microchannels and their corresponding fluid flow patterns. The datasets required for the training of the model is generated by performing extensive simulations using conventional approach of computational fluid dynamics methods. The datasets are then pre-processed and accessed the required spatial and temporal features that are essential for the training. We have trained three different models based on U-Net framework namely, standard U-Net, T-Net, and U-Net with attention mechanism to compare the prediction accuracy and loss. The accuracy of the $μ$-FlowNet is compared using metrics of dice score and intersection over union and it shows that U-Net with attention mechanism shows the highest dice score and IoU of 0.9317 and 0.8731, respectively and shows the highest structural similarity as compared to standard U-Net and T-Net. This show that U-Net with attention mechanism serves best model to map the fluid flow pattern with random datasets on testing.

cs.CE↗

arXiv2024

Pennsieve: A Collaborative Platform for Translational Neuroscience and Beyond

The exponential growth of neuroscientific data necessitates platforms that facilitate data management and multidisciplinary collaboration. In this paper, we introduce Pennsieve - an open-source, cloud-based scientific data management platform built to meet these needs. Pennsieve supports complex multimodal datasets and provides tools for data visualization and analyses. It takes a comprehensive approach to data integration, enabling researchers to define custom metadata schemas and utilize advanced tools to filter and query their data. Pennsieve's modular architecture allows external applications to extend its capabilities, and collaborative workspaces with peer-reviewed data publishing mechanisms promote high-quality datasets optimized for downstream analysis, both in the cloud and on-premises. Pennsieve forms the core for major neuroscience research programs including NIH SPARC Initiative, NIH HEAL Initiative's PRECISION Human Pain Network, and NIH HEAL RE-JOIN Initiative. It serves more than 80 research groups worldwide, along with several large-scale, inter-institutional projects at clinical sites through the University of Pennsylvania. Underpinning the SPARC.Science, Epilepsy.Science, and Pennsieve Discover portals, Pennsieve stores over 125 TB of scientific data, with 35 TB of data publicly available across more than 350 high-impact datasets. It adheres to the findable, accessible, interoperable, and reusable (FAIR) principles of data sharing and is recognized as one of the NIH-approved Data Repositories. By facilitating scientific data management, discovery, and analysis, Pennsieve fosters a robust and collaborative research ecosystem for neuroscience and beyond.

cs.CY↗

arXiv2023

Quantifying interictal intracranial EEG to predict focal epilepsy

Intracranial EEG (IEEG) is used for 2 main purposes, to determine: (1) if epileptic networks are amenable to focal treatment and (2) where to intervene. Currently these questions are answered qualitatively and sometimes differently across centers. There is a need for objective, standardized methods to guide surgical decision making and to enable large scale data analysis across centers and prospective clinical trials. We analyzed interictal data from 101 patients with drug resistant epilepsy who underwent presurgical evaluation with IEEG. We chose interictal data because of its potential to reduce the morbidity and cost associated with ictal recording. 65 patients had unifocal seizure onset on IEEG, and 36 were non-focal or multi-focal. We quantified the spatial dispersion of implanted electrodes and interictal IEEG abnormalities for each patient. We compared these measures against the 5 Sense Score (5SS), a pre-implant estimate of the likelihood of focal seizure onset, and assessed their ability to predict the clinicians choice of therapeutic intervention and the patient outcome. The spatial dispersion of IEEG electrodes predicted network focality with precision similar to the 5SS (AUC = 0.67), indicating that electrode placement accurately reflected pre-implant information. A cross-validated model combining the 5SS and the spatial dispersion of interictal IEEG abnormalities significantly improved this prediction (AUC = 0.79; p<0.05). The combined model predicted ultimate treatment strategy (surgery vs. device) with an AUC of 0.81 and post-surgical outcome at 2 years with an AUC of 0.70. The 5SS, interictal IEEG, and electrode placement were not correlated and provided complementary information. Quantitative, interictal IEEG significantly improved upon pre-implant estimates of network focality and predicted treatment with precision approaching that of clinical experts.

q-bio.NC↗

arXiv2022

Longitudinal abnormalities in white matter extracellular free water volume fraction and neuropsychological functioning in patients with traumatic brain injury

Traumatic brain injury is a global public health problem associated with chronic neurological complications and long-term disability. Biomarkers that map onto the underlying brain pathology driving these complications are urgently needed to identify individuals at risk for poor recovery and to inform design of clinical trials of neuroprotective therapies. Neuroinflammation and neurodegeneration are two endophenotypes associated with increases in brain extracellular water content after trauma. The objective of this study was to describe the relationship between a neuroimaging biomarker of extracellular free water content and the clinical features of patients with traumatic brain injury. We analyzed a cohort of 64 adult patients requiring hospitalization for non-penetrating traumatic brain injury of all severities as well as 32 healthy controls. Patients underwent brain MRI and clinical neuropsychological assessment in the subacute (2-weeks) and chronic (6-months) post-injury period, and controls underwent a single MRI. For each subject, we derived a summary score representing deviations in whole brain white matter (1) extracellular free water volume fraction (VF) and (2) free water-corrected fractional anisotropy (fw-FA). The summary specific anomaly score (SAS) for VF was significantly higher in TBI patients in the subacute and chronic post-injury period relative to controls. SAS for VF significantly correlated with neuropsychological functioning in the subacute, but not chronic post-injury period. These findings indicate abnormalities in whole brain white matter extracellular water fraction in patients with TBI and are an important step toward identifying and validating noninvasive biomarkers that map onto the pathology driving disability after TBI.

q-bio.NC↗

arXiv2022

Change in structural brain network abnormalities after traumatic brain injury determines post-injury recovery

The trajectory of an individual's recovery after traumatic brain injury (TBI) is heterogeneous, with complete recovery in some cases but persistent disability in others. We hypothesized that changes in structural brain network abnormalities guide the trajectory of an individual's recovery post-injury. Our objective was to characterize the variability in recovery post-TBI by identifying a putative neuroimaging biomarker of traumatic axonal injury (TAI) in individuals with mild TBI. We analyzed 70 T1-weighted and diffusion MRIs longitudinally collected from 35 individuals during the subacute and chronic post-injury periods. Each individual underwent longitudinal blood work to characterize blood protein biomarkers of axonal and glial injury and assessment of post-injury recovery in the subacute and chronic periods. By comparing the MRI data of individual cases with 35 controls, we estimated the longitudinal change in structural brain network abnormalities. We validated this proxy measure of TAI with independent measures of acute intracranial injury estimated from head CT and blood protein biomarkers. Post-injury structural network abnormality was significantly higher than controls in both subacute and chronic periods, associated with an acute CT lesion and subacute blood levels of glial fibrillary acid protein (r=0.5, p=0.008) and neurofilament light (r=0.41, p=0.02). Longitudinal change in abnormality associated with change in functional outcome status (r=-0.51, p=0.003) and post-concussive symptoms (BSI: r=0.46, p=0.03; RPQ:r = 0.46, p=0.02). Brain regions that most closely mapped onto symptom change over time corresponded to structural network hubs or areas susceptible to neurotrauma. Structural network abnormalities might be a biomarker of TAI. Assessing changes in brain network abnormality might enable better patient stratification for monitoring recovery after neurotrauma.

q-bio.NC↗

arXiv2022

Intracranial EEG structure-function coupling predicts surgical outcomes in focal epilepsy

Alterations to structural and functional brain networks have been reported across many neurological conditions. However, the relationship between structure and function -- their coupling -- is relatively unexplored, particularly in the context of an intervention. Epilepsy surgery alters the brain structure and networks to control the functional abnormality of seizures. Given that surgery is a structural modification aiming to alter the function, we hypothesized that stronger structure-function coupling preoperatively is associated with a greater chance of post-operative seizure control. We constructed structural and functional brain networks in 39 subjects with medication-resistant focal epilepsy using data from intracranial EEG (pre-surgery), structural MRI (pre-and post-surgery), and diffusion MRI (pre-surgery). We investigated pre-operative structure-function coupling at two spatial scales a) at the global iEEG network level and b) at the resolution of individual iEEG electrode contacts using virtual surgeries. At global network level, seizure-free individuals had stronger structure-function coupling pre-operatively than those that were not seizure-free regardless of the choice of interictal segment or frequency band. At the resolution of individual iEEG contacts, the virtual surgery approach provided complementary information to localize epileptogenic tissues. In predicting seizure outcomes, structure-function coupling measures were more important than clinical attributes, and together they predicted seizure outcomes with an accuracy of 85% and sensitivity of 87%. The underlying assumption that the structural changes induced by surgery translate to the functional level to control seizures is valid when the structure-functional coupling is strong. Mapping the regions that contribute to structure-functional coupling using virtual surgeries may help aid surgical planning.

q-bio.NC↗

arXiv2022

Probing TryOnGAN

TryOnGAN is a recent virtual try-on approach, which generates highly realistic images and outperforms most previous approaches. In this article, we reproduce the TryOnGAN implementation and probe it along diverse angles: impact of transfer learning, variants of conditioning image generation with poses and properties of latent space interpolation. Some of these facets have never been explored in literature earlier. We find that transfer helps training initially but gains are lost as models train longer and pose conditioning via concatenation performs better. The latent space self-disentangles the pose and the style features and enables style transfer across poses. Our code and models are available in open source.

cs.CV↗

arXiv2020

Learn to Bind and Grow Neural Structures

Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but struggle to grow optimally, without losing past knowledge. We present a new framework, Learn to Bind and Grow, which learns a neural architecture for a new task incrementally, either by binding with layers of a similar task or by expanding layers which are more likely to conflict between tasks. Central to our approach is a novel, interpretable, parameterization of the shared, multi-task architecture space, which then enables computing globally optimal architectures using Bayesian optimization. Experiments on continual learning benchmarks show that our framework performs comparably with earlier expansion based approaches and is able to flexibly compute multiple optimal solutions with performance-size trade-offs.

cs.LG↗

arXiv2020

Gestop : Customizable Gesture Control of Computer Systems

The established way of interfacing with most computer systems is a mouse and keyboard. Hand gestures are an intuitive and effective touchless way to interact with computer systems. However, hand gesture based systems have seen low adoption among end-users primarily due to numerous technical hurdles in detecting in-air gestures accurately. This paper presents Gestop, a framework developed to bridge this gap. The framework learns to detect gestures from demonstrations, is customizable by end-users and enables users to interact in real-time with computers having only RGB cameras, using gestures.

cs.HC↗

arXiv2020

Focal to bilateral tonic-clonic seizures are associated with widespread network abnormality in temporal lobe epilepsy

Objective: To identify if whole-brain structural network alterations in patients with temporal lobe epilepsy (TLE) and focal to bilateral tonic-clonic seizures (FBTCS) differ from alterations in patients without FBTCS. Methods: We dichotomized a cohort of 83 drug-resistant patients with TLE into those with and without FBTCS and compared each group to 29 healthy controls. For each subject, we used diffusion MRI to construct whole-brain structural networks. First, we measured the extent of alterations by performing FBTCS-negative (FBTCS-) versus control and FBTCS-positive (FBTCS+) versus control comparisons, thereby delineating altered sub-networks of the whole-brain structural network. Second, by standardising networks of each patient using control networks, we measured the subject-specific abnormality at every brain region in the network, thereby quantifying the spatial localisation and the amount of abnormality in every patient. Results: Both FBTCS+ and FBTCS- patient groups had altered sub-networks with reduced fractional anisotropy (FA) and increased mean diffusivity (MD) compared to controls. The altered subnetwork in FBTCS+ patients was more widespread than in FBTCS- patients (441 connections altered at t>3, p<0.001 in FBTCS+ compared to 21 connections altered at t>3, p=0.01 in FBTCS-). Significantly greater abnormalities-aggregated over the entire brain network as well as assessed at the resolution of individual brain areas-were present in FBTCS+ patients (p<0.001, d=0.82). In contrast, the fewer abnormalities present in FBTCS- patients were mainly localised to the temporal and frontal areas. Significance: The whole-brain structural network is altered to a greater and more widespread extent in patients with TLE and FBTCS. We suggest that these abnormal networks may serve as an underlying structural basis or consequence of the greater seizure spread observed in FBTCS.

q-bio.NC↗

arXiv2020

Formal Synthesis of Monitoring and Detection Systems for Secure CPS Implementations

We consider the problem of securing a given control loop implementation of a cyber-physical system (CPS) in the presence of Man-in-the-Middle attacks on data exchange between plant and controller over a compromised network. To this end, there exist various detection schemes that provide mathematical guarantees against such attacks for the theoretical control model. However, such guarantees may not hold for the actual control software implementation. In this article, we propose a formal approach towards synthesizing attack detectors with varying thresholds which can prevent performance degrading stealthy attacks while minimizing false alarms.

cs.CR↗

arXiv2019

Interictal intracranial EEG for predicting surgical success: the importance of space and time

Predicting post-operative seizure freedom using functional correlation networks derived from interictal intracranial EEG has shown some success. However, there are important challenges to consider. 1: electrodes physically closer to each other naturally tend to be more correlated causing a spatial bias. 2: implantation location and number of electrodes differ between patients, making cross-subject comparisons difficult. 3: functional correlation networks can vary over time but are currently assumed as static. In this study we address these three substantial challenges using intracranial EEG data from 55 patients with intractable focal epilepsy. Patients additionally underwent preoperative MR imaging, intra-operative CT, and post-operative MRI allowing accurate localisation of electrodes and delineation of removed tissue. We show that normalising for spatial proximity between nearby electrodes improves prediction of post-surgery seizure outcomes. Moreover, patients with more extensive electrode coverage were more likely to have their outcome predicted correctly (ROC-AUC >0.9, p<<0.05), but not necessarily more likely to have a better outcome. Finally, our predictions are robust regardless of the time segment. Future studies should account for the spatial proximity of electrodes in functional network construction to improve prediction of post-surgical seizure outcomes. Greater coverage of both removed and spared tissue allows for predictions with higher accuracy.

q-bio.NC↗

arXiv2019

Data-centric Dynamic Partial Order Reduction

We present a new dynamic partial-order reduction method for stateless model checking of concurrent programs. A common approach for exploring program behaviors relies on enumerating the traces of the program, without storing the visited states (aka stateless exploration). As the number of distinct traces grows exponentially, dynamic partial-order reduction (DPOR) techniques have been successfully used to partition the space of traces into equivalence classes (Mazurkiewicz partitioning), with the goal of exploring only few representative traces from each class. We introduce a new equivalence on traces under sequential consistency semantics, which we call the observation equivalence. Two traces are observationally equivalent if every read event observes the same write event in both traces. While the traditional Mazurkiewicz equivalence is control-centric, our new definition is data-centric. We show that our observation equivalence is coarser than the Mazurkiewicz equivalence, and in many cases even exponentially coarser. We devise a DPOR exploration of the trace space, called data-centric DPOR, based on the observation equivalence. For acyclic architectures, our algorithm is guaranteed to explore exactly one representative trace from each observation class, while spending polynomial time per class. Hence, our algorithm is optimal wrt the observation equivalence, and in several cases explores exponentially fewer traces than any enumerative method based on the Mazurkiewicz equivalence. For cyclic architectures, we consider an equivalence between traces which is finer than the observation equivalence; but coarser than the Mazurkiewicz equivalence, and in some cases is exponentially coarser. Our data-centric DPOR algorithm remains optimal under this trace equivalence.

cs.PL↗

arXiv2019

Personalised network modelling in epilepsy

Epilepsy is a disorder characterised by spontaneous, recurrent seizures. Both local and network abnormalities have been associated with epilepsy, and the exact processes generating seizures are thought to be heterogeneous and patient-specific. Due to the heterogeneity, treatments such as surgery and medication are not always effective in achieving full seizure control and choosing the best treatment for the individual patient can be challenging. Predictive models constrained by the patient's own data therefore offer the potential to assist in clinical decision making. In this chapter, we describe how personalised patient-derived networks from structural or functional connectivity can be incorporated into predictive models. We focus specifically on dynamical systems models which are composed of differential equations capable of simulating brain activity over time. Here we review recent studies which have used these models, constrained by patient data, to make personalised patient-specific predictions about seizure features (such as propagation patterns) or treatment outcomes (such as the success of surgical resection). Finally, we suggest future research directions for patient-specific network models in epilepsy, including their application to integrate information from multiple modalities, to predict long-term disease evolution, and to account for within-subject variability for treatment.

q-bio.NC↗

arXiv2018

Computer modelling of connectivity change suggests epileptogenesis mechanisms in idiopathic generalised epilepsy

Patients with idiopathic generalised epilepsy (IGE) typically have normal conventional magnetic resonance imaging (MRI), hence MRI based diagnosis is challenging. Anatomical abnormalities underlying brain dysfunctions in IGE are unclear and their relation to the pathomechanisms of epileptogenesis is poorly understood. In this study, we applied connectometry, an advanced quantitative neuroimaging technique for investigating localised changes in white-matter tissue. Analysing white matter structures of 32 subjects we incorporated our findings in a computational model of seizure dynamics to suggest a plausible mechanism of epileptogenesis. Patients with IGE have significant bilateral alterations in major white-matter fascicles. In the cingulum, fornix, and superior longitudinal fasciculus, tract integrity is compromised, whereas in specific parts of tracts between thalamus and the precentral gyrus, tract integrity is enhanced in patients. Combining these alterations in a logistic regression model, we computed the decision boundary that discriminated patients and controls. The computational model, informed with the findings on the tract abnormalities, specifically highlighted the importance of enhanced cortico-reticular connections along with impaired cortico-cortical connections in inducing pathological seizure-like dynamics. We emphasise taking directionality of brain connectivity into consideration towards understanding the pathological mechanisms; this is possible by combining neuroimaging and computational modelling. Our imaging evidence of structural alterations suggest the loss of cortico-cortical and enhancement of cortico-thalamic fibre integrity in IGE. We further suggest that impaired connectivity from cortical regions to the thalamic reticular nucleus offers a therapeutic target for selectively modifying the brain circuit for reversing the mechanisms leading to epileptogenesis.

q-bio.NC↗