arXiv subjects

Shobhit Jain

Publications and source records attributed to Shobhit Jain.

At least 19 recordsLinked to original sources

arXiv2026

Nonlinear Model Reduction of Complex Networks via Spectral Submanifolds

Complex networked systems are prevalent in biology, engineering, and the social sciences, yet their high-dimensional, nonlinear dynamics pose major challenges for analysis and prediction. A mathematically rigorous route to simplification is to represent system behavior on a low-dimensional, smooth invariant manifold known as a spectral submanifold (SSM). Here we present a comprehensive SSM reduction framework and its globalized extension (gSSM) for dimensionality reduction in large-scale nonlinear networks. Our approach yields accurate global and node-level predictions across synthetic and real networks, including highly heterogeneous topologies and systems with higher-order interactions. Crucially, SSM is a robust tipping-point predictor: even at low truncation order (e.g., $O(2)$) it reliably identifies the onset of sustained activity, while higher orders and gSSM capture post-onset amplitudes and saturation. Consistently, the reduction collapses the full network dynamics to a one-dimensional system, offering clarity and efficiency. Across all the realizations, SSM/gSSM consistently outperform classical spectral and mean-field methods in modeling critical transitions at both microscopic and macroscopic scales, establishing SSM-based reduction as a robust, interpretable tool for nonlinear networked systems with broad applicability to epidemiology, ecology, and engineered networks.

physics.soc-ph↗

arXiv2026

Predicting Generalized Steady States in Aperiodically Forced Mechanical Systems

The existence of generalized steady states (GSSs) in nonlinear mechanical systems under moderate temporally aperiodic forcing has only been shown recently. Here we derive systematic expansions for such GSSs and construct a numerical algorithm that yields explicit and arbitrarily refinable approximations for GSSs without the need for an initial convergence period. This is to be contrasted with a direct numerical integration of the system, whose convergence is hard to assess or is even undefined for short, transient forcing. When at least the linear part of the equations of motion is known, our GSS algorithm outperforms available data-driven neural-network-based techniques for predicting forced response in structural dynamics problems. In a fully equation-driven setting, our GSS computations are shown to be faster than a direct numerical integration of forced nonlinear finite-element models of beams and shells.

math.DS↗

arXiv2025

Topology optimization of nonlinear forced response curves via reduction on spectral submanifolds

Forced response curves (FRCs) of nonlinear systems can exhibit complex behaviors, including hardening/softening behavior and bifurcations. Although topology optimization holds great potential for tuning these nonlinear dynamic responses, its use in high-dimensional systems is limited by the high cost of repeated response and sensitivity analyses. To address this challenge, we employ the spectral submanifolds (SSMs) reduction theory, which reformulates the periodic response as the equilibria of an associated reduced-order model (ROM). This enables efficient and analytic evaluation of both response amplitudes and their sensitivities. Based on the SSM-based ROM, we formulate optimization problems that optimize the peak amplitude, the hardening/softening behavior, and the distance between two saddle-node bifurcations for an FRC. The proposed method is applied to the design of nonlinear MEMS devices, achieving targeted performance optimization. This framework provides a practical and efficient strategy for incorporating nonlinear dynamic effects into the topology optimization of structures.

eess.SY↗

arXiv2025

Adjoint Sensitivities for the Optimization of Nonlinear Structural Dynamics via Spectral Submanifolds

This work presents an optimization framework for tailoring the nonlinear dynamic response of lightly damped mechanical systems using Spectral Submanifold (SSM) reduction. We derive the SSM-based backbone curve and its sensitivity with respect to parameters up to arbitrary polynomial orders, enabling efficient and accurate optimization of the nonlinear frequency-amplitude relation. We use the adjoint method to derive sensitivity expressions, which drastically reduces the computational cost compared to direct differentiation as the number of parameters increases. An important feature of this framework is the automatic adjustment of the expansion order of SSM-based ROMs using user-defined error tolerances during the optimization process. We demonstrate the effectiveness of the approach in optimizing the nonlinear response over several numerical examples of mechanical systems. Hence, the proposed framework extends the applicability of SSM-based optimization methods to practical engineering problems, offering a robust tool for the design and optimization of nonlinear mechanical structures.

math.OC↗

arXiv2024

Bifurcation analysis of quasi-periodic orbits of mechanical systems with 1:2 internal resonance via spectral submanifolds

A 1:2 internally resonant mechanical system can undergo secondary Hopf (Neimark-Sacker) bifurcations, resulting in a quasi-periodic response when the system is subject to harmonic excitation. While these quasi-periodic orbits have been observed in practice, their bifurcations are not well studied, especially in high-dimensional mechanical systems. This is mainly because of the challenges associated with the computation and bifurcation detection of these quasi-periodic motions. Here we present a computational framework to address these challenges via reductions on spectral submanifolds, which transforms quasi-periodic orbits of high-dimensional systems as limit cycles of four-dimensional reduced-order models. We apply the proposed framework to analyze bifurcations of quasi-periodic orbits in several mechanical systems exhibiting 1:2 internal resonance, including a finite element model of a shallow-curved shell. We uncover local bifurcations such as period-doubling and saddle-node, as well as global bifurcations such as homoclinic connections, isolas, and simple bifurcations of quasi-periodic orbits. We also observe cascades of period-doubling bifurcations of quasi-periodic orbits that eventually result in chaotic motions, as well as the coexistence of chaotic and quasi-periodic attractors. These findings elucidate the complex bifurcation mechanism of quasi-periodic orbits in 1:2 internally resonant systems.

nlin.CD↗

arXiv2024

Data-free Non-intrusive Model Reduction for Nonlinear Finite Element Models via Spectral Submanifolds

The theory of spectral submanifolds (SSMs) has emerged as a powerful tool for constructing rigorous, low-dimensional reduced-order models (ROMs) of high-dimensional nonlinear mechanical systems. A direct computation of SSMs requires explicit knowledge of nonlinear coefficients in the equations of motion, which limits their applicability to generic finite-element (FE) solvers. Here, we propose a non-intrusive algorithm for the computation of the SSMs and the associated ROMs up to arbitrary polynomial orders. This non-intrusive algorithm only requires system nonlinearity as a black box and hence, enables SSM-based model reduction via generic finite-element software. Our expressions and algorithms are valid for systems with up to cubic-order nonlinearities, including velocity-dependent nonlinear terms, asymmetric damping, and stiffness matrices, and hence work for a large class of mechanics problems. We demonstrate the effectiveness of the proposed non-intrusive approach over a variety of FE examples of increasing complexity, including a micro-resonator FE model containing more than a million degrees of freedom.

math.NA↗

arXiv2024

Nonlinear Model Reduction to Random Spectral Submanifolds in Random Vibrations

Dynamical systems in engineering and physics are often subject to irregular excitations that are best modeled as random. Monte Carlo simulations are routinely performed on such random models to obtain statistics on their long-term response. Such simulations, however, are prohibitively expensive and time consuming for high-dimensional nonlinear systems. Here we propose to decrease this numerical burden significantly by reducing the full system to very low-dimensional, attracting, random invariant manifolds in its phase space and performing the Monte Carlo simulations on that reduced dynamical system. The random spectral submanifolds (SSMs) we construct for this purpose generalize the concept of SSMs from deterministic systems under uniformly bounded random forcing. We illustrate the accuracy and speed of random SSM reduction by computing the SSM-reduced power spectral density of the randomly forced mechanical systems that range from simple oscillator chains to finite-element models of beams and plates.

math.DS↗

arXiv2023

Data-Assisted Non-Intrusive Model Reduction for Forced Nonlinear Finite Elements Models

Spectral submanifolds (SSMs) have emerged as accurate and predictive model reduction tools for dynamical systems defined either by equations or data sets. While finite-elements (FE) models belong to the equation-based class of problems, their implementations in commercial solvers do not generally provide information on the nonlinearities required for the analytical construction of SSMs. Here, we overcome this limitation by developing a data-driven construction of SSM-reduced models from a small number of unforced FE simulations. We then use these models to predict the forced response of the FE model without performing any costly forced simulation. This approach yields accurate forced response predictions even in the presence of internal resonances or quasi-periodic forcing, as we illustrate on several FE models. Our examples range from simple structures, such as beams and shells, to more complex geometries, such as a micro-resonator model containing more than a million degrees of freedom. In the latter case, our algorithm predicts accurate forced response curves in a small fraction of the time it takes to verify just a few points on those curves by simulating the full forced-response.

math.DS↗

arXiv2023

Fast computation and characterization of forced response surfaces via spectral submanifolds and parameter continuation

For mechanical systems subject to periodic excitation, forced response curves (FRCs) depict the relationship between the amplitude of the periodic response and the forcing frequency. For nonlinear systems, this functional relationship is different for different forcing amplitudes. Forced response surfaces (FRSs), which relate the response amplitude to both forcing frequency and forcing amplitude, are then required in such settings. Yet, FRSs have been rarely computed in the literature due to the higher numerical effort they require. Here, we use spectral submanifolds (SSMs) to construct reduced-order models (ROMs) for high-dimensional mechanical systems and then use multidimensional manifold continuation of fixed points of the SSM-based ROMs to efficiently extract the FRSs. Ridges and trenches in an FRS characterize the main features of the forced response. We show how to extract these ridges and trenches directly without computing the FRS via reduced optimization problems on the ROMs. We demonstrate the effectiveness and efficiency of the proposed approach by calculating the FRSs and their ridges and trenches for a plate with a 1:1 internal resonance and for a shallow shell with a 1:2 internal resonance.

math.DS↗

arXiv2023

Nonautonomous Spectral Submanifolds for Model Reduction of Nonlinear Mechanical Systems under Parametric Resonance

We use the recent theory of Spectral Submanifolds (SSM) for model reduction of nonlinear mechanical systems subject to parametric excitations. Specifically, we develop expressions for higher-order nonautonomous terms in the parameterization of SSMs and their reduced dynamics. We provide these results both for general first-order as well as second-order mechanical systems under periodic and quasiperiodic excitation using a multi-index based approach, thereby optimizing memory requirements and the computational procedure. We further provide theoretical results that simplify the SSM parametrization for general second-order dynamical systems. More practically, we show how the reduced dynamics on the SSM can be used to extract the resonance tongues and the forced response around the principal resonances in parametrically excited systems. In the case of two-dimensional SSMs, we formulate explicit expressions for computing the steady-state response as the zero-level set of a two-dimensional function for systems that are subject to external as well as parametric excitation. This allows us to parallelize the computation of the forced response over the range of excitation frequencies. We demonstrate our results on several examples of varying complexity, including finite-element type examples of mechanical systems. Furthermore, we provide an open-source implementation of all these results in the software package SSMTool.

math.DS↗

arXiv2022

Using Spectral Submanifolds for Nonlinear Periodic Control

Very high dimensional nonlinear systems arise in many engineering problems due to semi-discretization of the governing partial differential equations, e.g. through finite element methods. The complexity of these systems present computational challenges for direct application to automatic control. While model reduction has seen ubiquitous applications in control, the use of nonlinear model reduction methods in this setting remains difficult. The problem lies in preserving the structure of the nonlinear dynamics in the reduced order model for high-fidelity control. In this work, we leverage recent advances in Spectral Submanifold (SSM) theory to enable model reduction under well-defined assumptions for the purpose of efficiently synthesizing feedback controllers.

math.OC↗

arXiv2022

Model reduction for constrained mechanical systems via spectral submanifolds

Dynamical systems are often subject to algebraic constraints in conjunction to their governing ordinary differential equations. In particular, multibody systems are commonly subject to configuration constraints that define kinematic compatibility between the motion of different bodies. A full-scale numerical simulation of such constrained problems is challenging, making reduced-order models (ROMs) of paramount importance. In this work, we show how to use spectral submanifolds (SSMs) to construct rigorous ROMs for mechanical systems with configuration constraints. These SSM-based ROMs enable the direct extraction of backbone curves and forced response curves, and facilitate efficient bifurcation analysis. We demonstrate the effectiveness of this SSM-based reduction procedure on several examples of varying complexity, including nonlinear finite-element models of multi-body systems. We also provide an open-source implementation of the proposed method that also contains all details of our numerical examples.

math.DS↗

arXiv2022

Nonlinear analysis of forced mechanical systems with internal resonance using spectral submanifolds, Part I: Periodic response and forced response curve

We show how spectral submanifold theory can be used to construct reduced-order models for harmonically excited mechanical systems with internal resonances. Efficient calculations of periodic and quasi-periodic responses with the reduced-order models are discussed in this paper and its companion, Part II, respectively. The dimension of a reduced-order model is determined by the number of modes involved in the internal resonance, independently of the dimension of the full system. The periodic responses of the full system are obtained as equilibria of the reduced-order model on spectral submanifolds. The forced response curve of periodic orbits then becomes a manifold of equilibria, which can be easily extracted using parameter continuation. To demonstrate the effectiveness and efficiency of the reduction, we compute the forced response curves of several high-dimensional nonlinear mechanical systems, including the finite-element models of a von Kármán beam and a plate.

math.DS↗

arXiv2021

How to Compute Invariant Manifolds and their Reduced Dynamics in High-Dimensional Finite-Element Models

Invariant manifolds are important constructs for the quantitative and qualitative understanding of nonlinear phenomena in dynamical systems. In nonlinear damped mechanical systems, for instance, spectral submanifolds have emerged as useful tools for the computation of forced response curves, backbone curves, detached resonance curves (isolas) via exact reduced-order models. For conservative nonlinear mechanical systems, Lyapunov subcenter manifolds and their reduced dynamics provide a way to identify nonlinear amplitude-frequency relationships in the form of conservative backbone curves. Despite these powerful predictions offered by invariant manifolds, their use has largely been limited to low-dimensional academic examples. This is because several challenges render their computation unfeasible for realistic engineering structures described by finite-element models. In this work, we address these computational challenges and develop methods for computing invariant manifolds and their reduced dynamics in very high-dimensional nonlinear systems arising from spatial discretization of the governing partial differential equations. We illustrate our computational algorithms on finite-element models of mechanical structures that range from a simple beam containing tens of degrees of freedom to an aircraft wing containing more than a hundred-thousand degrees of freedom.

cs.CE↗

arXiv2020

An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain

With the growing amount of text in health data, there have been rapid advances in large pre-trained models that can be applied to a wide variety of biomedical tasks with minimal task-specific modifications. Emphasizing the cost of these models, which renders technical replication challenging, this paper summarizes experiments conducted in replicating BioBERT and further pre-training and careful fine-tuning in the biomedical domain. We also investigate the effectiveness of domain-specific and domain-agnostic pre-trained models across downstream biomedical NLP tasks. Our finding confirms that pre-trained models can be impactful in some downstream NLP tasks (QA and NER) in the biomedical domain; however, this improvement may not justify the high cost of domain-specific pre-training.

cs.CL↗

arXiv2020

Integral Equations & Model Reduction For Fast Computation of Nonlinear Periodic Response

We propose a reformulation for the integral equations approach of Jain, Breunung \& Haller [Nonlinear Dyn. 97, 313--341 (2019)] to steady-state response computation for periodically forced nonlinear mechanical systems. This reformulation results in additional speed-up and better convergence. We show that the solutions of the reformulated equations are in one-to-one correspondence with those of the original integral equations and derive conditions under which a collocation type approximation converges to the exact solution in the reformulated setting. Furthermore, we observe that model reduction using a selected set of vibration modes of the linearized system substantially enhances the computational performance. Finally, we discuss an open-source implementation of this approach and demonstrate the gains in computational performance using three examples that also include nonlinear finite-element models.

cs.CE↗

arXiv2020

Using Spectral Submanifolds for Optimal Mode Selection in Model Reduction

Model reduction of large nonlinear systems often involves the projection of the governing equations onto linear subspaces spanned by carefully-selected modes. The criteria to select the modes relevant for reduction are usually problem-specific and heuristic. In this work, we propose a rigorous mode-selection criterion based on the recent theory of Spectral Submanifolds (SSM), which facilitates a reliable projection of the governing nonlinear equations onto modal subspaces. SSMs are exact invariant manifolds in the phase space that act as nonlinear continuations of linear normal modes. Our criterion identifies critical linear normal modes whose associated SSMs have locally the largest curvature. These modes should then be included in any projection-based model reduction as they are the most sensitive to nonlinearities. To make this mode selection automatic, we develop explicit formulas for the scalar curvature of an SSM and provide an open-source numerical implementation of our mode-selection procedure. We illustrate the power of this procedure by accurately reproducing the forced-response curves on three examples of varying complexity, including high-dimensional finite element models.

math.DS↗

arXiv2020

Multi Sense Embeddings from Topic Models

Distributed word embeddings have yielded state-of-the-art performance in many NLP tasks, mainly due to their success in capturing useful semantic information. These representations assign only a single vector to each word whereas a large number of words are polysemous (i.e., have multiple meanings). In this work, we approach this critical problem in lexical semantics, namely that of representing various senses of polysemous words in vector spaces. We propose a topic modeling based skip-gram approach for learning multi-prototype word embeddings. We also introduce a method to prune the embeddings determined by the probabilistic representation of the word in each topic. We use our embeddings to show that they can capture the context and word similarity strongly and outperform various state-of-the-art implementations.

cs.LG↗