SearcharxivSearch

arXiv subjects

Sean Warnick

Publications and source records attributed to Sean Warnick.

12 recordsLinked to original sources

A Nonlinear Singular Value Theory for Neural Networks

Recently Brown et al. [2025] established a singular value decomposition (SVD) for maps (especially nonlinear) satisfying certain norm conditions. We prove that most modern neural architectures admit this nonlinear SVD (NLSVD) representation---with no change in input--output behavior---and enumerate the classes covered. In this factorization the network is a left-invertible nonlinear map followed by a final linear layer. Moreover, the left-invertible factor is norm-preserving, so distances in the embedding (activations before the final linear layer) calibrate directly to distances in input space. We introduce a flexible architecture that yields an explicit decomposition at training time, a data-driven algorithm for estimating the representation from trained models, and the mathematical foundations for nonlinear analogues of row and null spaces in neural networks. Empirical case studies illustrate uses of the theory for latent-space pullback (visualization and data generation), bias detection, and membership-inference robustness under training. Altogether, these foundations support new approaches to core problems in neural-network analysis.

cs.LG

Machine-Learning Driven Load Shedding to Mitigate Instability Attacks in Power Grids

Critical infrastructures are becoming increasingly complex as our society becomes increasingly dependent on them. This complexity opens the door to new possibilities for attacks and a need for new defense strategies. Our work focuses on instability attacks on the power grid, wherein an attacker causes cascading outages by introducing unstable dynamics into the system. When stress is place on the power grid, a standard mitigation approach is load-shedding: the system operator chooses a set of loads to shut off until the situation is resolved. While this technique is standard, there is no systematic approach to choosing which loads will stop an instability attack. This paper addresses this problem using a data-driven methodology for load shedding decisions. We show a proof of concept on the IEEE 14 Bus System using the Achilles Heel Technologies Power Grid Analyzer, and show through an implementation of modified Prony analysis (MPA) that MPA is a viable method for detecting instability attacks and triggering defense mechanisms.

cs.LG

LLM Generated Distribution-Based Prediction of US Electoral Results, Part I

This paper introduces distribution-based prediction, a novel approach to using Large Language Models (LLMs) as predictive tools by interpreting output token probabilities as distributions representing the models' learned representation of the world. This distribution-based nature offers an alternative perspective for analyzing algorithmic fidelity, complementing the approach used in silicon sampling. We demonstrate the use of distribution-based prediction in the context of recent United States presidential election, showing that this method can be used to determine task specific bias, prompt noise, and algorithmic fidelity. This approach has significant implications for assessing the reliability and increasing transparency of LLM-based predictions across various domains.

cs.AI

An SVD-like Decomposition of Bounded-Input Bounded-Output Functions

The Singular Value Decomposition (SVD) of linear functions facilitates the calculation of their 2-induced norm and row and null spaces, hallmarks of linear control theory. In this work, we present a function representation that, similar to SVD, provides an upper bound on the 2-induced norm of bounded-input bounded-output functions, as well as facilitates the computation of generalizations of the notions of row and null spaces. Borrowing from the notion of "lifting" in Koopman operator theory, we construct a finite-dimensional lifting of inputs that relaxes the unitary property of the right-most matrix in traditional SVD, $V^*$, to be an injective, norm-preserving mapping to a slightly higher-dimensional space.

math.OC

A Study of Three Influencer Archetypes for the Control of Opinion Spread in Time-Varying Social Networks

In this work we consider the impact of information spread in time-varying social networks, where agents request to follow other agents with aligned opinions while dropping ties to neighbors whose posts are too dissimilar to their own views. Opinion control and rhetorical influence has a very long history, employing various methods including education, persuasion, propaganda, marketing, and manipulation through mis-, dis-, and mal-information. The automation of opinion controllers, however, has only recently become easily deployable at a wide scale, with the advent of large language models (LLMs) and generative AI that can translate the quantified commands from opinion controllers into actual content with the appropriate nuance. Automated agents in social networks can be deployed for various purposes, such as breaking up echo chambers, bridging valuable new connections between agents, or shaping the opinions of a target population -- and all of these raise important ethical concerns that deserve serious attention and thoughtful discussion and debate. This paper attempts to contribute to this discussion by considering three archetypal influencing styles observed by human drivers in these settings, comparing and contrasting the impact of these different control methods on the opinions of agents in the network. We will demonstrate the efficacy of current generative AI for generating nuanced content consistent with the command signal from automatic opinion controllers like these, and we will report on frameworks for approaching the relevant ethical considerations.

cs.SI

Model Boundary Approximation Method as a Unifying Framework for Balanced Truncation and Singular Perturbation Approximation

We show that two widely accepted model reduction techniques, Balanced Truncation and Balanced Singular Perturbation Approximation, can be derived as limiting approximations of a carefully constructed parameterization of Linear Time Invariant (LTI) systems by employing the Model Boundary Approximation Method (MBAM), a recent development in the Physics literature. This unifying framework of these popular model reduction techniques shows that Balanced Truncation and Balanced Singular Perturbation Approximation each correspond to a particular boundary point on a manifold, the "model manifold," which is associated with the specific choice of model parameterization and initial condition, and is embedded in a sample space of measured outputs, which can be chosen arbitrarily, provided that the number of samples exceeds the number of parameters. We also show that MBAM provides a novel way to interpolate between Balanced Truncation and Balanced Singular Perturbation Approximation, by exploring the set of approximations on the boundary of the manifold between the elements that correspond to the two model reduction techniques; this allows for alternative approximations of a given system to be found that may be better under certain conditions. The work herein suggests similar types of approximations may be obtainable in topologically similar places (i.e. on certain boundaries) on the model manifold of nonlinear systems if analogous parameterizations can be achieved, therefore extending these widely accepted model reduction techniques to nonlinear systems.

math.OC

Optimal distributed control for platooning via sparse coprime factorizations

We introduce a novel distributed control architecture for heterogeneous platoons of linear time--invariant autonomous vehicles. Our approach is based on a generalization of the concept of {\em leader--follower} controllers for which we provide a Youla--like parameterization while the sparsity constraints are imposed on the controller's left coprime factors, outlying a new concept of structural constraints in distributed control. The proposed scheme is amenable to optimal controller design via norm based costs, it guarantees string stability and eliminates the accordion effect from the behavior of the platoon. We also introduce a synchronization mechanism for the exact compensation of the time delays induced by the wireless broadcasting of information.

eess.SY

Meanings and Applications of Structure in Networks of Dynamic Systems

This chapter reviews four notions of system structure, three of which are contextual and classic (i.e. the complete computational structure linked to a state space model, the sparsity pattern of a transfer function, and the interconnection of subsystems) and one which is relatively new (i.e. the signal structure of a system's dynamical structure function). Although each of these structural concepts apply to the nonlinear and stochastic setting, this work will focus on linear time invariant systems to distill the key concepts and make their relationships clear. We then discusses three applications of the newest structural form (the signal structure of a system's dynamical structure function): network reconstruction, vulnerability analysis, and a recent result in distributed control that guarantees the synthesis of a stabilizing controller with a specified structure or proves that no such controller exists.

eess.SY

A Novel Description of Linear Time--Invariant Networks via Structured Coprime Factorizations

In this paper we study state-space realizations of Linear and Time-Invariant (LTI) systems. Motivated by biochemical reaction networks, Gonçalves and Warnick have recently introduced the notion of a {\em Dynamical Structure Functions} (DSF), a particular factorization of the system's transfer function matrix that elucidates the interconnection structure in dependencies between manifest variables. We build onto this work by showing an intrinsic connection between a DSF and certain sparse left coprime factorizations. By establishing this link, we provide an interesting systems theoretic interpretation of sparsity patterns of coprime factors. In particular we show how the sparsity of these coprime factors allows for a given LTI system to be implemented as a network of LTI sub-systems. We examine possible applications in distributed control such as the design of a LTI controller that can be implemented over a network with a pre-specified topology.

math.OC

Minimal realization of the dynamical structure function and its application to network reconstruction

Network reconstruction, i.e., obtaining network structure from data, is a central theme in systems biology, economics and engineering. In some previous work, we introduced dynamical structure functions as a tool for posing and solving the problem of network reconstruction between measured states. While recovering the network structure between hidden states is not possible since they are not measured, in many situations it is important to estimate the minimal number of hidden states in order to understand the complexity of the network under investigation and help identify potential targets for measurements. Estimating the minimal number of hidden states is also crucial to obtain the simplest state-space model that captures the network structure and is coherent with the measured data. This paper characterizes minimal order state-space realizations that are consistent with a given dynamical structure function by exploring properties of dynamical structure functions and developing an algorithm to explicitly obtain such a minimal realization.

eess.SY

A Technique for Designing Stabilizing Distributed Controllers with Arbitrary Signal Structure Constraints

This paper presents a new approach to distributed controller design that exploits a partial-structure representation of linear time invariant systems to characterize the structure of a system. This partial-structure representation, called the dynamical structure function, characterizes the {\em signal structure}, or open-loop causal dependencies among manifest variables, capturing a significantly richer notion of structure than the sparsity pattern of the transfer function. The design technique sequentially constructs each link in an arbitrary controller signal structure, and the main result proves that the resulting controller is either stabilizing or no controller with the desired structure can stabilize the system.

math.OC

Dynamical Structure Functions for the Estimation of LTI Networks with Limited Information

This research explores the role and representation of network structure for LTI Systems. We demonstrate that transfer functions contain no structural information without more assumptions being made about the system, assumptions that we believe are unreasonable when dealing with truly complex systems. We then introduce Dynamical Structure Functions as an alternative, graphical-model based representation of LTI systems that contain both dynamical and structural information of the system. We use Dynamical Structure to prove necessary and sufficient conditions for estimating structure from data, and demonstrate, for example, the danger of attempting to use steady-state information to estimate network structure.

q-bio.MN