SearcharxivSearch

arXiv subjects

Yves van Gennip

Publications and source records attributed to Yves van Gennip.

At least 19 recordsLinked to original sources

Uniform Sobolev inequalities on geometric graphs

There is significant interest in the study of calculus on graphs, especially regarding the use of gradient-based methods for applications in data driven problems such as classification, clustering and regularisation for inverse problems. Geometric graphs, whose vertices are take from from a Euclidean domain and whose edge structure is determined by the distance between the nodes in the domain, have been central in theoretical studies. Typical approaches for analysis, such as studying consistency and the existence of continuum limits, rely on $Γ$-convergence. This technique has some limitations, as it requires the typical length scale which determines the connectivity structure of the graph to be much larger than the scales frequently used for applications. Moreover, it may fail to provide quantitative results. This paper provides necessary and sufficient conditions on the asymptotic behaviour of this length scale for the existence of a uniform collection of Sobolev inequalities on a sequence of geometric graphs. Furthermore, these inequalities hold when the length scales are much smaller than what is typically assumed for $Γ$-convergence results and within the range of what is used for data-driven problems. The Sobolev inequalities provide a quantitative estimate on the $L^q$-regularisation effect of discrete gradients.

math.AP

Super-Gaussian approximations for optimum far-field irradiance in intersatellite optical communications: coherent and incoherent beam shaping

Intersatellite optical communication links are strongly affected by transmitter pointing jitter, which stochastically modulates the received optical power and degrades communication performance. While adjusting the divergence of a conventional Gaussian beams can partially mitigate this effect, the optimum far-field irradiance distribution for maximizing link performance has not been formally derived. In this work, we introduce a variational formalism to determine the optimum far-field irradiance for an intersatellite link affected by pointing jitter. The flat-top beam is found to be the optimum beam shape for minimizing outage probability. In particular, it requires $\sim37,8\%$ of the power needed by a conventional Gaussian beam to achieve the same outage probability. However, the flat-top profile is discontinuous and physically unrealizable. To address this, we analyze a continuous family of super-Gaussian beam shapes that approximate the flat-top as the order increases. In addition, several coherent and incoherent beam shaping techniques are evaluated to assess their ability to reproduce the optimum irradiance distribution. The results show that these techniques can reduce the required transmitted power by up to $\sim50\%$ compared with conventional Gaussian beams.

physics.optics

An extension to Banach stackings of the Brezis--Pazy semigroup-convergence theorem, with applications to $λ$-convex gradient flows

A 1972 theorem by Brezis and Pazy establishes the uniform convergence of nonlinear semigroups generated by $ω$-accretive operators on a Banach space. Our goal is to expand the setting of this theorem to include nonlinear semigroups that are acting on different Banach spaces. This is useful, for example, to prove discrete-to-continuum convergence for graph-based gradient flows. We name the general setting in which our theorem holds a Banach stacking. We give three main applications of the extended theorem that are of independent interest. The first establishes uniform convergence of semigroups in a Banach stacking if the generators of the semigroups converge pointwise. The second is a proof of uniform convergence for gradient flows of $Γ$-converging $λ$-convex functions on a Banach stacking of Hilbert spaces; the third a proof of uniform convergence for gradient flows of $Γ$-converging functions that satisfy a convexity condition that was formulated by Bénilan and Crandall in a 1991 publication (and which we term `$P_0$-convexity') on a Banach stacking of $L^p$ spaces, corresponding to the $TL^p$ space introduced by García Trillos and Slepčev in a 2016 paper.

math.AP

Discrete-to-continuum limits of semilinear stochastic evolution equations in Banach spaces

We study the convergence of semilinear parabolic stochastic evolution equations, posed on a sequence of Banach spaces approximating a limiting space and driven by additive white noise projected onto the former spaces. Under appropriate uniformity and convergence conditions on the linear operators, nonlinear drifts and initial data, we establish convergence of the associated mild solution processes when lifted to a common state space. Our framework is applied to the case where the limiting problem is a stochastic partial differential equation whose linear part is a generalized Whittle-Matérn operator on a manifold $\mathcal{M}$, discretized by a sequence of graphs constructed from a (random) point cloud. In this setting we obtain various discrete-to-continuum convergence results for solutions lifted to $L^q(\mathcal{M})$ for $q \in [2,\infty]$, one of which recovers the $L^\infty$-convergence of a finite-difference discretization of certain (fractional) stochastic Allen-Cahn equations.

math.PR

Joint reconstruction-segmentation on graphs

Practical image segmentation tasks concern images which must be reconstructed from noisy, distorted, and/or incomplete observations. A recent approach for solving such tasks is to perform this reconstruction jointly with the segmentation, using each to guide the other. However, this work has so far employed relatively simple segmentation methods, such as the Chan--Vese algorithm. In this paper, we present a method for joint reconstruction-segmentation using graph-based segmentation methods, which have been seeing increasing recent interest. Complications arise due to the large size of the matrices involved, and we show how these complications can be managed. We then analyse the convergence properties of our scheme. Finally, we apply this scheme to distorted versions of ``two cows'' images familiar from previous graph-based segmentation literature, first to a highly noised version and second to a blurred version, achieving highly accurate segmentations in both cases. We compare these results to those obtained by sequential reconstruction-segmentation approaches, finding that our method competes with, or even outperforms, those approaches in terms of reconstruction and segmentation accuracy.

cs.CV

Deep Limits of Residual Neural Networks

Neural networks have been very successful in many applications; we often, however, lack a theoretical understanding of what the neural networks are actually learning. This problem emerges when trying to generalise to new data sets. The contribution of this paper is to show that, for the residual neural network model, the deep layer limit coincides with a parameter estimation problem for a nonlinear ordinary differential equation. In particular, whilst it is known that the residual neural network model is a discretisation of an ordinary differential equation, we show convergence in a variational sense. This implies that optimal parameters converge in the deep layer limit. This is a stronger statement than saying for a fixed parameter the residual neural network model converges (the latter does not in general imply the former). Our variational analysis provides a discrete-to-continuum $Γ$-convergence result for the objective function of the residual neural network training step to a variational problem constrained by a system of ordinary differential equations; this rigorously connects the discrete setting to a continuum problem.

math.CA

Graph gradient flows : from discrete to continuum

This paper gives a framework to study a continuum limit of a gradient flow on a graph where the number of vertices increases in an appropriate way. As examples we prove the convergence of a discrete total variation flow and a discrete Allen--Cahn flow on discretised tori to their respective continuum limits.

math.AP

Classification and image processing with a semi-discrete scheme for fidelity forced Allen--Cahn on graphs

This paper introduces a semi-discrete implicit Euler (SDIE) scheme for the Allen-Cahn equation (ACE) with fidelity forcing on graphs. Bertozzi and Flenner (2012) pioneered the use of this differential equation as a method for graph classification problems, such as semi-supervised learning and image segmentation. In Merkurjev, Kostić, and Bertozzi (2013), a Merriman-Bence-Osher (MBO) scheme with fidelity forcing was used instead, as the MBO scheme is heuristically similar to the ACE. This paper rigorously establishes the graph MBO scheme with fidelity forcing as a special case of an SDIE scheme for the graph ACE with fidelity forcing. This connection requires using the double-obstacle potential in the ACE, as was shown in Budd and Van Gennip (2020) for ACE without fidelity forcing. We also prove that solutions of the SDIE scheme converge to solutions of the graph ACE with fidelity forcing as the SDIE time step tends to zero. Next, we develop the SDIE scheme as a classification algorithm. We also introduce some innovations into the algorithms for the SDIE and MBO schemes. For large graphs, we use a QR decomposition method to compute an eigendecomposition from a Nyström extension, which outperforms the method used in e.g. Bertozzi and Flenner (2012) in accuracy, stability, and speed. Moreover, we replace the Euler discretisation for the scheme's diffusion step by a computation based on the Strang formula for matrix exponentials. We apply this algorithm to a number of image segmentation problems, and compare the performance of the SDIE and MBO schemes. We find that whilst the general SDIE scheme does not perform better than the MBO special case at this task, our other innovations lead to a significantly better segmentation than that from previous literature. We also empirically quantify the uncertainty that this segmentation inherits from the randomness in the Nyström extension.

math.NA

Graph MBO as a semi-discrete implicit Euler scheme for graph Allen-Cahn flow

In recent years there has been an emerging interest in PDE-like flows defined on finite graphs, with applications in clustering and image segmentation. In particular for image segmentation and semi-supervised learning Bertozzi and Flenner (2012) developed an algorithm based on the Allen-Cahn gradient flow of a graph Ginzburg-Landau functional, and Merkurjev, Kostić and Bertozzi (2013) devised a variant algorithm based instead on graph Merriman-Bence-Osher (MBO) dynamics. This work offers rigorous justification for this use of the MBO scheme in place of Allen-Cahn flow. First, we choose the double-obstacle potential for the Ginzburg-Landau functional, and derive well-posedness and regularity results for the resulting graph Allen-Cahn flow. Next, we exhibit a "semi-discrete" time-discretisation scheme for Allen-Cahn flow of which the MBO scheme is a special case. We investigate the long-time behaviour of this scheme, and prove its convergence to the Allen-Cahn trajectory as the time-step vanishes. Finally, following a question raised by Van Gennip, Guillen, Osting and Bertozzi (2014), we exhibit results towards proving a link between double-obstacle Allen-Cahn flow and mean curvature flow on graphs. We show some promising $Γ$-convergence results, and translate to the graph setting two comparison principles used by Chen and Elliott (1994) to prove the analogous link in the continuum.

math.AP

Mass-conserving diffusion-based dynamics on graphs

An emerging technique in image segmentation, semi-supervised learning, and general classification problems concerns the use of phase-separating flows defined on finite graphs. This technique was pioneered in Bertozzi and Flenner (2012), which used the Allen-Cahn flow on a graph, and was then extended in Merkurjev, Kostic and Bertozzi (2013) using instead the Merriman-Bence-Osher (MBO) scheme on a graph. In previous work by the authors, Budd and Van Gennip (2019), we gave a theoretical justification for this use of the MBO scheme in place of Allen-Cahn flow, showing that the MBO scheme is a special case of a "semi-discrete" numerical scheme for Allen-Cahn flow. In this paper, we extend this earlier work, showing that this link via the semi-discrete scheme is robust to passing to the mass-conserving case. Inspired by Rubinstein and Sternberg (1992), we define a mass-conserving Allen-Cahn equation on a graph. Then, with the help of the tools of convex optimisation, we show that our earlier machinery can be applied to derive the mass-conserving MBO scheme on a graph as a special case of a semi-discrete scheme for mass-conserving Allen-Cahn. We give a theoretical analysis of this flow and scheme, proving various desired properties like existence and uniqueness of the flow and convergence of the scheme, and also show that the semi-discrete scheme yields a choice function for solutions to the mass-conserving MBO scheme. Finally, we exhibit initial work towards extending to the multi-class case, which in future work we seek to connect to recent work on multi-class MBO in Jacobs, Merkurjev and Esedoglu (2018).

math.AP

An MBO scheme for clustering and semi-supervised clustering of signed networks

We introduce a principled method for the signed clustering problem, where the goal is to partition a graph whose edge weights take both positive and negative values, such that edges within the same cluster are mostly positive, while edges spanning across clusters are mostly negative. Our method relies on a graph-based diffuse interface model formulation utilizing the Ginzburg-Landau functional, based on an adaptation of the classic numerical Merriman-Bence-Osher (MBO) scheme for minimizing such graph-based functionals. The proposed objective function aims to minimize the total weight of inter-cluster positively-weighted edges, while maximizing the total weight of the inter-cluster negatively-weighted edges. Our method scales to large sparse networks, and can be easily adjusted to incorporate labelled data information, as is often the case in the context of semi-supervised learning. We tested our method on a number of both synthetic stochastic block models and real-world data sets (including financial correlation matrices), and obtained promising results that compare favourably against a number of state-of-the-art approaches from the recent literature.

cs.SI

A Max-Cut approximation using a graph based MBO scheme

The Max-Cut problem is a well known combinatorial optimization problem. In this paper we describe a fast approximation method. Given a graph G, we want to find a cut whose size is maximal among all possible cuts. A cut is a partition of the vertex set of G into two disjoint subsets. For an unweighted graph, the size of the cut is the number of edges that have one vertex on either side of the partition; we also consider a weighted version of the problem where each edge contributes a nonnegative weight to the cut. We introduce the signless Ginzburg-Landau functional and prove that this functional Gamma-converges to a Max-Cut objective functional. We approximately minimize this functional using a graph based signless Merriman-Bence-Osher scheme, which uses a signless Laplacian. We show experimentally that on some classes of graphs the resulting algorithm produces more accurate maximum cut approximations than the current state-of-the-art approximation algorithm. One of our methods of minimizing the functional results in an algorithm with a time complexity of O(|E|), where |E| is the total number of edges on G.

math.AP

Gamma-convergence of graph Ginzburg-Landau functionals

We study Gamma-convergence of graph based Ginzburg-Landau functionals, both the limit for zero diffusive interface parameter epsilon->0 and the limit for infinite nodes in the graph m -> infinity. For general graphs we prove that in the limit epsilon -> 0 the graph cut objective function is recovered. We show that the continuum limit of this objective function on 4-regular graphs is related to the total variation seminorm and compare it with the limit of the discretized Ginzburg-Landau functional. For both functionals we also study the simultaneous limit epsilon -> 0 and m -> infinity, by expressing epsilon as a power of m and taking m -> infinity. Finally we investigate the continuum limit for a nonlocal means type functional on a completely connected graph.

math.AP

Unsupervised record matching with noisy and incomplete data

We consider the problem of duplicate detection in noisy and incomplete data: given a large data set in which each record has multiple entries (attributes), detect which distinct records refer to the same real world entity. This task is complicated by noise (such as misspellings) and missing data, which can lead to records being different, despite referring to the same entity. Our method consists of three main steps: creating a similarity score between records, grouping records together into "unique entities", and refining the groups. We compare various methods for creating similarity scores between noisy records, considering different combinations of string matching, term frequency-inverse document frequency methods, and n-gram techniques. In particular, we introduce a vectorized soft term frequency-inverse document frequency method, with an optional refinement step. We also discuss two methods to deal with missing data in computing similarity scores. We test our method on the Los Angeles Police Department Field Interview Card data set, the Cora Citation Matching data set, and two sets of restaurant review data. The results show that the methods that use words as the basic units are preferable to those that use 3-grams. Moreover, in some (but certainly not all) parameter ranges soft term frequency-inverse document frequency methods can outperform the standard term frequency-inverse document frequency method. The results also confirm that our method for automatically determining the number of groups typically works well in many cases and allows for accurate results in the absence of a priori knowledge of the number of unique entities in the data set.

cs.DB

An MBO scheme for minimizing the graph Ohta-Kawasaki functional

We study a graph based version of the Ohta-Kawasaki functional, which was originally introduced in a continuum setting to model pattern formation in diblock copolymer melts and has been studied extensively as a paradigmatic example of a variational model for pattern formation. Graph based problems inspired by partial differential equations (PDEs) and varational methods have been the subject of many recent papers in the mathematical literature, because of their applications in areas such as image processing and data classification. This paper extends the area of PDE inspired graph based problems to pattern forming models, while continuing in the tradition of recent papers in the field. We introduce a mass conserving Merriman-Bence-Osher (MBO) scheme for minimizing the graph Ohta-Kawasaki functional with a mass constraint. We present three main results: (1) the Lyapunov functionals associated with this MBO scheme $Γ$-converge to the Ohta-Kawasaki functional (which includes the standard graph based MBO scheme and total variation as a special case); (2) there is a class of graphs on which the Ohta-Kawasaki MBO scheme corresponds to a standard MBO scheme on a transformed graph and for which generalized comparison principles hold; (3) this MBO scheme allows for the numerical computation of (approximate) minimizers of the graph Ohta-Kawasaki functional with a mass constraint.

math.AP

Anisotropic Total Variation Regularized L^1-Approximation and Denoising/Deblurring of 2D Bar Codes

We consider variations of the Rudin-Osher-Fatemi functional which are particularly well-suited to denoising and deblurring of 2D bar codes. These functionals consist of an anisotropic total variation favoring rectangles and a fidelity term which measure the L^1 distance to the signal, both with and without the presence of a deconvolution operator. Based upon the existence of a certain associated vector field, we find necessary and sufficient conditions for a function to be a minimizer. We apply these results to 2D bar codes to find explicit regimes ---in terms of the fidelity parameter and smallest length scale of the bar codes--- for which a perfect bar code is recoverable via minimization of the functionals. Via a discretization reformulated as a linear program, we perform numerical experiments for all functionals demonstrating their denoising and deblurring capabilities.

math.OC

A Regularization Approach to Blind Deblurring and Denoising of QR Barcodes

QR bar codes are prototypical images for which part of the image is a priori known (required patterns). Open source bar code readers, such as ZBar, are readily available. We exploit both these facts to provide and assess purely regularization-based methods for blind deblurring of QR bar codes in the presence of noise.

cs.CV

Graph clustering, variational image segmentation methods and Hough transform scale detection for object measurement in images

We consider the problem of scale detection in images where a region of interest is present together with a measurement tool (e.g. a ruler). For the segmentation part, we focus on the graph based method by Flenner and Bertozzi which reinterprets classical continuous Ginzburg-Landau minimisation models in a totally discrete framework. To overcome the numerical difficulties due to the large size of the images considered we use matrix completion and splitting techniques. The scale on the measurement tool is detected via a Hough transform based algorithm. The method is then applied to some measurement tasks arising in real-world applications such as zoology, medicine and archaeology.

math.AP