Searcharxiv⌕ Search

arXiv subjects

Yuichi Ike

Publications and source records attributed to Yuichi Ike.

32 records · Page 2Linked to original sources

Vanishing Component Analysis with Contrastive Normalization

Vanishing component analysis (VCA) computes approximate generators of vanishing ideals of samples, which are further used for extracting nonlinear features of the samples. Recent studies have shown that normalization of approximate generators plays an important role and different normalization leads to generators of different properties. In this paper, inspired by recent self-supervised frameworks, we propose a contrastive normalization method for VCA, where we impose the generators to vanish on the target samples and to be normalized on the transformed samples. We theoretically show that a contrastive normalization enhances the discriminative power of VCA, and provide the algebraic interpretation of VCA under our normalization. Numerical experiments demonstrate the effectiveness of our method. This is the first study to tailor the normalization of approximate generators of vanishing ideals to obtain discriminative features.

cs.LG↗

RipsNet: a general architecture for fast and robust estimation of the persistent homology of point clouds

The use of topological descriptors in modern machine learning applications, such as Persistence Diagrams (PDs) arising from Topological Data Analysis (TDA), has shown great potential in various domains. However, their practical use in applications is often hindered by two major limitations: the computational complexity required to compute such descriptors exactly, and their sensitivity to even low-level proportions of outliers. In this work, we propose to bypass these two burdens in a data-driven setting by entrusting the estimation of (vectorization of) PDs built on top of point clouds to a neural network architecture that we call RipsNet. Once trained on a given data set, RipsNet can estimate topological descriptors on test data very efficiently with generalization capacity. Furthermore, we prove that RipsNet is robust to input perturbations in terms of the 1-Wasserstein distance, a major improvement over the standard computation of PDs that only enjoys Hausdorff stability, yielding RipsNet to substantially outperform exactly-computed PDs in noisy settings. We showcase the use of RipsNet on both synthetic and real-world data. Our open-source implementation is publicly available at https://github.com/hensel-f/ripsnet and will be included in the Gudhi library.

cs.CG↗

Curvature of point clouds through principal component analysis

In this article, we study curvature-like feature value of data sets in Euclidean spaces. First, we formulate such curvature functions with desirable properties under the manifold hypothesis. Then we make a test property for the validity of the curvature function by the law of large numbers, and check it for the function we construct by numerical experiments. These experiments also suggest the conjecture that the mean of the curvature of sample manifolds coincides with the curvature of the mean manifold. Our construction is based on the dimension estimation by the principal component analysis and the Gaussian curvature of hypersurfaces. Our function depends on provisional parameters $\varepsilon, δ$, and we suggest dealing with the resulting functions as a function of these parameters to get some robustness. As an application, we propose a method to decompose data sets into some parts reflecting local structure. For this, we embed the data sets into higher dimensional Euclidean space using curvature values and cluster them in the embedding space. We also give some computational experiments that support the effectiveness of our methods.

cs.CG↗

Topological Uncertainty: Monitoring trained neural networks through persistence of activation graphs

Although neural networks are capable of reaching astonishing performances on a wide variety of contexts, properly training networks on complicated tasks requires expertise and can be expensive from a computational perspective. In industrial applications, data coming from an open-world setting might widely differ from the benchmark datasets on which a network was trained. Being able to monitor the presence of such variations without retraining the network is of crucial importance. In this article, we develop a method to monitor trained neural networks based on the topological properties of their activation graphs. To each new observation, we assign a Topological Uncertainty, a score that aims to assess the reliability of the predictions by investigating the whole network instead of its final layer only, as typically done by practitioners. Our approach entirely works at a post-training level and does not require any assumption on the network architecture, optimization scheme, nor the use of data augmentation or auxiliary datasets; and can be faithfully applied on a large range of network architectures and data types. We showcase experimentally the potential of Topological Uncertainty in the context of trained network selection, Out-Of-Distribution detection, and shift-detection, both on synthetic and real datasets of images and graphs.

stat.ML↗

Algebraic stability theorem for derived categories of zigzag persistence modules

We study distances on zigzag persistence modules from the viewpoint of derived categories and Auslander--Reiten quivers. The derived category of ordinary persistence modules is derived equivalent to that of arbitrary zigzag persistence modules, depending on a classical tilting module. Through this derived equivalence, we define and compute distances on the derived category of arbitrary zigzag persistence modules and prove an algebraic stability theorem. We also compare our distance with the distance for purely zigzag persistence modules introduced by Botnan--Lesnick and the sheaf-theoretic convolution distance due to Kashiwara--Schapira.

math.RT↗

Ordered Counterfactual Explanation by Mixed-Integer Linear Optimization

Post-hoc explanation methods for machine learning models have been widely used to support decision-making. One of the popular methods is Counterfactual Explanation (CE), also known as Actionable Recourse, which provides a user with a perturbation vector of features that alters the prediction result. Given a perturbation vector, a user can interpret it as an "action" for obtaining one's desired decision result. In practice, however, showing only a perturbation vector is often insufficient for users to execute the action. The reason is that if there is an asymmetric interaction among features, such as causality, the total cost of the action is expected to depend on the order of changing features. Therefore, practical CE methods are required to provide an appropriate order of changing features in addition to a perturbation vector. For this purpose, we propose a new framework called Ordered Counterfactual Explanation (OrdCE). We introduce a new objective function that evaluates a pair of an action and an order based on feature interaction. To extract an optimal pair, we propose a mixed-integer linear optimization approach with our objective function. Numerical experiments on real datasets demonstrated the effectiveness of our OrdCE in comparison with unordered CE methods.

cs.LG↗

Optimizing persistent homology based functions

Solving optimization tasks based on functions and losses with a topological flavor is a very active, growing field of research in data science and Topological Data Analysis, with applications in non-convex optimization, statistics and machine learning. However, the approaches proposed in the literature are usually anchored to a specific application and/or topological construction, and do not come with theoretical guarantees. To address this issue, we study the differentiability of a general map associated with the most common topological construction, that is, the persistence map. Building on real analytic geometry arguments, we propose a general framework that allows us to define and compute gradients for persistence-based functions in a very simple way. We also provide a simple, explicit and sufficient condition for convergence of stochastic subgradient methods for such functions. This result encompasses all the constructions and applications of topological optimization in the literature. Finally, we provide associated code, that is easy to handle and to mix with other non-topological methods and constraints, as well as some experiments showcasing the versatility of our approach.

cs.CG↗

Persistence-like distance on Tamarkin's category and symplectic displacement energy

We introduce a persistence-like pseudo-distance on Tamarkin's category and prove that the distance between an object and its Hamiltonian deformation is at most the Hofer norm of the Hamiltonian function. Using the distance, we show a quantitative version of Tamarkin's non-displaceability theorem, which gives a lower bound of the displacement energy of compact subsets of cotangent bundles.

math.SG↗

DTM-based Filtrations

Despite strong stability properties, the persistent homology of filtrations classically used in Topological Data Analysis, such as, e.g. the Cech or Vietoris-Rips filtrations, are very sensitive to the presence of outliers in the data from which they are computed. In this paper, we introduce and study a new family of filtrations, the DTM-filtrations, built on top of point clouds in the Euclidean space which are more robust to noise and outliers. The approach adopted in this work relies on the notion of distance-to-measure functions, and extends some previous work on the approximation of such functions.

cs.CG↗

PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signatures

Persistence diagrams, the most common descriptors of Topological Data Analysis, encode topological properties of data and have already proved pivotal in many different applications of data science. However, since the (metric) space of persistence diagrams is not Hilbert, they end up being difficult inputs for most Machine Learning techniques. To address this concern, several vectorization methods have been put forward that embed persistence diagrams into either finite-dimensional Euclidean space or (implicit) infinite dimensional Hilbert space with kernels. In this work, we focus on persistence diagrams built on top of graphs. Relying on extended persistence theory and the so-called heat kernel signature, we show how graphs can be encoded by (extended) persistence diagrams in a provably stable way. We then propose a general and versatile framework for learning vectorizations of persistence diagrams, which encompasses most of the vectorization techniques used in the literature. We finally showcase the experimental strength of our setup by achieving competitive scores on classification tasks on real-life graph datasets.

stat.ML↗

Hyperbolic localization via shrinking subbundles

We study the Lefschetz fixed point formula for constructible sheaves with higher-dimensional fixed point sets. We give another proof to the explicit description of Lefschetz cycles in our previous paper. For this purpose, we introduce a new notion of shrinking subbundles and describe Lefschetz cycles by using hyperbolic localization with respect to shrinking subbundles.

math.AG↗

Microlocal Lefschetz classes of graph trace kernels

In this paper, we define the notion of graph trace kernels as a generalization of trace kernels. We associate a microlocal Lefschetz class with a graph trace kernel and prove that this class is functorial with respect to the composition of kernels. We apply graph trace kernels to the microlocal Lefschetz fixed point formula for constructible sheaves.

math.AG↗

Hyperbolic localization and Lefschetz fixed point formulas for higher-dimensional fixed point sets

We study Lefschetz fixed point formulas for constructible sheaves with higher-dimensional fixed point sets. Under fairly weak assumptions, we prove that the local contributions from them are expressed by some constructible functions associated to hyperbolic localizations. This gives an affirmative answer to a conjecture of Goresky-MacPherson in particular for smooth fixed point components. In the course of the proof, the new Lagrangian cycles introduced in our previous paper will be effectively used. Moreover we show various examples for which local contributions can be explicitly determined by our method.

math.AG↗