SearcharxivSearch

arXiv subjects

Pankaj Yadav

Publications and source records attributed to Pankaj Yadav.

5 recordsLinked to original sources

Kolmogorov Arnold Networks (KANs) for Imbalanced Data -- An Empirical Perspective

Kolmogorov Arnold Networks (KANs) are recent architectural advancement in neural computation that offer a mathematically grounded alternative to standard neural networks. This study presents an empirical evaluation of KANs in context of class imbalanced classification, using ten benchmark datasets. We observe that KANs can inherently perform well on raw imbalanced data more effectively than Multi-Layer Perceptrons (MLPs) without any resampling strategy. However, conventional imbalance strategies fundamentally conflict with KANs mathematical structure as resampling and focal loss implementations significantly degrade KANs performance, while marginally benefiting MLPs. Crucially, KANs suffer from prohibitive computational costs without proportional performance gains. Statistical validation confirms that MLPs with imbalance techniques achieve equivalence with KANs (|d| < 0.08 across metrics) at minimal resource costs. These findings reveal that KANs represent a specialized solution for raw imbalanced data where resources permit. But their severe performance-resource tradeoffs and incompatibility with standard resampling techniques currently limits practical deployment. We identify critical research priorities as developing KAN specific architectural modifications for imbalance learning, optimizing computational efficiency, and theoretical reconciling their conflict with data augmentation. This work establishes foundational insights for next generation KAN architectures in imbalanced classification scenarios.

cs.LG

Rebalancing the Scales: A Systematic Mapping Study of Generative Adversarial Networks (GANs) in Addressing Data Imbalance

Machine learning algorithms are used in diverse domains, many of which face significant challenges due to data imbalance. Studies have explored various approaches to address the issue, like data preprocessing, cost-sensitive learning, and ensemble methods. Generative Adversarial Networks (GANs) showed immense potential as a data preprocessing technique that generates good quality synthetic data. This study employs a systematic mapping methodology to analyze 3041 papers on GAN-based sampling techniques for imbalanced data sourced from four digital libraries. A filtering process identified 100 key studies spanning domains such as healthcare, finance, and cybersecurity. Through comprehensive quantitative analysis, this research introduces three categorization mappings as application domains, GAN techniques, and GAN variants used to handle the imbalanced nature of the data. GAN-based over-sampling emerges as an effective preprocessing method. Advanced architectures and tailored frameworks helped GANs to improve further in the case of data imbalance. GAN variants like vanilla GAN, CTGAN, and CGAN show great adaptability in structured imbalanced data cases. Interest in GANs for imbalanced data has grown tremendously, touching a peak in recent years, with journals and conferences playing crucial roles in transmitting foundational theories and practical applications. While with these advances, none of the reviewed studies explicitly explore hybridized GAN frameworks with diffusion models or reinforcement learning techniques. This gap leads to a future research idea develop innovative approaches for effectively handling data imbalance.

cs.AI

Certified Interpolation Oversampling: Per-Instance Safety Guarantees for Imbalanced Learning

Synthetic minority oversampling is typically designed and evaluated against a predictive objective, generating samples that improve downstream classification. This paper pursues a second objective by generating samples that carry a stated safety property, established for each instance by construction rather than assumed. We introduce Certified Interpolation Safe Oversampling (CISO), a three-phase interpolation framework built for this objective. A safety-guided distribution selects where synthesis occurs, a locality-and clearance-weighted distribution selects with whom each anchor interpolates, and a q-Gaussian placement density determines how far along the resulting segment each instance is placed. The framework provides three guarantees. Each synthetic instance seeded by a sufficiently safe anchor carries a certified distance from the majority class; a signed temperature parameter provably and monotonically shifts synthesis between boundary-seeking and interior-seeking regimes; and selection weights are strictly positive by construction, so no degenerate case arises. Certification is obtained alongside competitive predictive performance rather than in place of it. Under a protocol preregistered before evaluation, across 45 datasets, four classifiers, and eleven competing methods, CISO is statistically equivalent to SMOTE on precision-recall AUC, ranks second of eleven under gradient boosting, and completes every one of 11,460 fold-level evaluations without failure. A parameter sweep further reveals a continuous fidelity-safety trade-off that competing methods occupy only as isolated points.

cs.LG

Action-based Early Autism Diagnosis Using Contrastive Feature Learning

Autism, also known as Autism Spectrum Disorder (or ASD), is a neurological disorder. Its main symptoms include difficulty in (verbal and/or non-verbal) communication, and rigid/repetitive behavior. These symptoms are often indistinguishable from a normal (control) individual, due to which this disorder remains undiagnosed in early childhood leading to delayed treatment. Since the learning curve is steep during the initial age, an early diagnosis of autism could allow to take adequate interventions at the right time, which might positively affect the growth of an autistic child. Further, the traditional methods of autism diagnosis require multiple visits to a specialized psychiatrist, however this process can be time-consuming. In this paper, we present a learning based approach to automate autism diagnosis using simple and small action video clips of subjects. This task is particularly challenging because the amount of annotated data available is small, and the variations among samples from the two categories (ASD and control) are generally indistinguishable. This is also evident from poor performance of a binary classifier learned using the cross-entropy loss on top of a baseline encoder. To address this, we adopt contrastive feature learning in both self supervised and supervised learning frameworks, and show that these can lead to a significant increase in the prediction accuracy of a binary classifier on this task. We further validate this by conducting thorough experimental analyses under different set-ups on two publicly available datasets.

cs.CV

Effect of time and thermo-mechanical couplings on polymers

Analysis of the thermo-mechanical behaviour of polymers has been and still is the subject of many rheological studies both experimentally and theoretically. For small deformations, the modelling framework retained by rheologists is often of linear visco-elasticity, which led to the definition of complex modules and used to identify the glass transition temperature as the so called rule of time-temperature superposition. In this context, the effects of time are almost unanimously associated with viscous effects. It has also been observed that the dissipative effects associated with viscous effects are often very small compared to the coupling of sources indicating a high sensitivity of polymeric materials to temperature variations. This work is mainly focused on establishing the exact role of coupling effects, which also induce the effect of time. Using traditional experimental methods of visco-analysis (DMTA) and via an energy analysis of the behaviour, the goal of the thesis is to try to restate the time-temperature equivalence rule under the Thermodynamics of Irreversible Processes, taking into account the dissipative effects and coupling induced process deformation.

cond-mat.soft