SearcharxivSearch

arXiv subjects

Allen Gehret

Publications and source records attributed to Allen Gehret.

10 recordsLinked to original sources

When Can One Obtain Certificates of Optimality Using Positivstellensaetze?

We study certificates of positivity and optimality for learning problems whose objectives and constraints need not be polynomial. We isolate an axiomatic core of Fischer's constructive strict and weak Positivstellens\"{a}tze and prove the resulting theorems for abstract function algebras over ordered fields. The framework separates two roles that can otherwise be conflated: objective and constraint functions may be built from broad classes of continuous or definable operations, while the auxiliary primitives used to construct a certificate satisfy explicit scalar and closure axioms. We give instances over continuous and definable function algebras, including ordered fields not closed under square roots, derive lower-bound and global-optimality certificates, and analyze both expanded term length and shared computation-graph complexity.

cs.AI

Deep Learning as the Disciplined Construction of Tame Objects

One can see deep-learning models as compositions of functions within the so-called tame geometry. In this expository note, we give an overview of some topics at the interface of tame geometry (also known as o-minimality), optimization theory, and deep learning theory and practice. To do so, we gradually introduce the concepts and tools used to build convergence guarantees for stochastic gradient descent in a general nonsmooth nonconvex, but tame, setting. This illustrates some ways in which tame geometry is a natural mathematical framework for the study of AI systems, especially within Deep Learning.

math.OC

Stochastic Sample Approximations of (Local) Moduli of Continuity

Modulus of local continuity is used to evaluate the robustness of neural networks and fairness of their repeated uses in closed-loop models. Here, we revisit a connection between generalized derivatives and moduli of local continuity, and present a non-uniform stochastic sample approximation for moduli of local continuity. This is of importance in studying robustness of neural networks and fairness of their repeated uses.

cs.LG

Dimension theory for the asymptotic couple of the field of logarithmic transseries

In this paper we completely characterize all dimension functions on all models of the theory $T_{\log}$ of the asymptotic couple of the field of logarithmic transseries (Dimension Theorem). This is done by characterizing the "small" $1$-variable definable sets (Small Sets Theorem). As a byproduct, we show that $T_{\log}$ is d-minimal and does not eliminate imaginaries. Separately, we provide an abstract criterion for d-minimality, which we use to observe some new examples of d-minimal expansions of valued fields.

math.LO

Distality in valued fields and related structures

We investigate distality and existence of distal expansions in valued fields and related structures. In particular, we characterize distality in a large class of ordered abelian groups, provide an AKE-style characterization for henselian valued fields, and demonstrate that certain expansions of fields, e.g., the differential field of logarithmic-exponential transseries, are distal. As a new tool for analyzing valued fields we employ a relative quantifier elimination for pure short exact sequences of abelian groups.

math.LO

Hamel Spaces and Distal Expansions

In this note, we construct a distal expansion for the structure $(\mathbb{R}; +,<,H)$, where $H\subseteq \mathbb{R}$ is a dense $\mathbb{Q}$-vector space basis of $\mathbb{R}$ (a so-called Hamel basis). Our construction is also an expansion of the dense pair $(\mathbb{R}; +,<,\mathbb{Q})$ and has full quantifier elimination in a natural language.

math.LO

Distality for the asymptotic couple of the field of logarithmic transseries

We show that the theory $T_{\log}$ of the asymptotic couple of the field of logarithmic transseries is distal. As distal theories are NIP (= the non-independence property), this provides a new proof that $T_{\log}$ is NIP. Finally, we show that $T_{\log}$ is not strongly dependent, and in particular, it is not $\operatorname{dp}$-minimal and it does not have finite $\operatorname{dp}$-rank.

math.LO

A tale of two Liouville closures

An $H$-field is a type of ordered valued differential field with a natural interaction between ordering, valuation, and derivation. The main examples are Hardy fields and fields of transseries. Aschenbrenner and van den Dries proved in~\cite{MZ} that every $H$-field $K$ has either exactly one or exactly two Liouville closures up to isomorphism over $K$, but the precise dividing line between these two cases was unknown. We prove here that this dividing line is determined by $\uplambda$-freeness, a property of $H$-fields that prevents certain deviant behavior. In particular, we show that under certain types of extensions related to adjoining integrals and exponential integrals, the property of $\uplambda$-freeness is preserved. In the proofs we introduce a new technique for studying $H$-fields, the \emph{yardstick argument} which involves the rate of growth of pseudoconvergence.

math.LO

NIP for the Asymptotic Couple of the Field of Logarithmic Transseries

The derivation on the differential-valued field $\mathbb{T}_{\log}$ of logarithmic transseries induces on its value group $\Gamma_{\log}$ a certain map $\psi$. The structure $\Gamma = (\Gamma_{\log},\psi)$ is a divisible asymptotic couple. In~\cite{gehret} we began a study of the first-order theory of $(\Gamma_{\log},\psi)$ where, among other things, we proved that the theory $T_{\log} = \operatorname{Th}(\Gamma_{\log},\psi)$ has a universal axiomatization, is model complete and admits elimination of quantifiers (QE) in a natural first-order language. In that paper we posed the question whether $T_{\log}$ has NIP (i.e., the Non-Independence Property). In this paper, we answer that question in the affirmative: $T_{\log}$ does have NIP. Our method of proof relies on a complete survey of the $1$-types of $T_{\log}$, which, in the presence of QE, is equivalent to a characterization of all simple extensions $\Gamma\langle\alpha\rangle$ of $\Gamma$. We also show that $T_{\log}$ does not have the Steinitz exchange property and we weigh in on the relationship between models of $T_{\log}$ and the so-called \emph{precontraction groups} of~\cite{kuhlmann1}.

math.LO

The Asymptotic Couple of the Field of Logarithmic Transseries

The derivation on the differential-valued field $\mathbb{T}_{\log}$ of logarithmic transseries induces on its value group $\Gamma_{\log}$ a certain map $\psi$. The structure $(\Gamma_{\log},\psi)$ is a divisible asymptotic couple. We prove that the theory $T_{\log} = {\rm Th}(\Gamma_{\log},\psi)$ admits elimination of quantifiers in a natural first-order language. All models $(\Gamma,\psi)$ of $T_{\log}$ have an important discrete subset $\Psi:=\psi(\Gamma\setminus\{0\})$. We give explicit descriptions of all definable functions on $\Psi$ and prove that $\Psi$ is stably embedded in $\Gamma$.

math.LO