Path homologies of deep feedforward networks

Samir Chowdhury; Thomas Gebhart; Steve Huntsman; Matvey Yutin

doi:10.1109/icmla.2019.00181

Home/Archive/arXiv

arXiv · 1910.07617

Path homologies of deep feedforward networks

Samir Chowdhury·Thomas Gebhart·Steve Huntsman·Matvey Yutin

View original source ↗Read source document ↗Export metadata ↓

Abstract

We provide a characterization of two types of directed homology for fully-connected, feedforward neural network architectures. These exact characterizations of the directed homology structure of a neural network architecture are the first of their kind. We show that the directed flag homology of deep networks reduces to computing the simplicial homology of the underlying undirected graph, which is explicitly given by Euler characteristic computations. We also show that the path homology of these networks is non-trivial in higher dimensions and depends on the number and size of the layers within the network. These results provide a foundation for investigating homological differences between neural network architectures and their realized structure as implied by their parameters.

Explore related subjects

math.AT cs.LG stat.ML

Keep this discovery

BibTeX RIS

Samir Chowdhury, Thomas Gebhart, Steve Huntsman, Matvey Yutin. 2019-10-16. Path homologies of deep feedforward networks. https://doi.org/10.1109/icmla.2019.00181

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Homogeneous Milnor fibers and Kato--Matsumoto bounds via simplicial multiwedges

For every $n\geq 3$ and $s\geq 2$, we construct a homogeneous polynomial of degree $n(n+1)/2$ whose Milnor fiber is exactly $2s$-connected and whose rational cohomology contains a strictly defined nontrivial $n$-fold Massey product on classes of degree $2s+1$, implying that the Milnor fiber is non-formal, while attaining the Kato--Matsumoto connectivity bound. Our construction is based on the simplicial multiwedges of the nerve complexes of simple polytopes introduced by Limonchenko, combined with Suciu's realization of weighted homogeneous Milnor fibers. We thereby answer two problems posed by Suciu.

math.AT↗

arXiv2026

The homotopy types of directed path and trace spaces

We construct a saturated directed space with a Hausdorff $\Delta$-generated underlying space and two distinct points such that the trace space between them is homeomorphic to a square, whereas the directed path space has a nontrivial fundamental group. In particular, the canonical quotient map is not a weak homotopy equivalence. The same conclusion holds for regular directed paths modulo increasing homeomorphisms.

math.AT↗

arXiv2026

Moduli spaces of geometric functorial field theories

We develop tools to compute moduli spaces of geometric functorial field theories as mapping spaces of equivariant simplicial presheaves. Given a d-dimensional geometric structure F, presented as a presheaf on the site of smooth families of d-manifolds, we define its Cartesian realization, which is an O(d)-equivariant simplicial presheaf on the site of Cartesian spaces. We use Cartesian realizations to present the moduli space of functorial field theories with geometric structure F as a mapping space between O(d)-equivariant simplicial presheaves. In a companion paper, we use this result to compute the moduli space of smooth one-dimensional oriented Riemannian functorial field theories valued in an arbitrary smooth symmetric monoidal infinity-category.

math.AT↗