SearcharxivSearch

arXiv subjects

Oleksandr Manzyuk

Publications and source records attributed to Oleksandr Manzyuk.

9 recordsLinked to original sources

Confusion of Tagged Perturbations in Forward Automatic Differentiation of Higher-Order Functions

Forward Automatic Differentiation (AD) is a technique for augmenting programs to compute derivatives. The essence of Forward AD is to attach perturbations to each number, and propagate these through the computation. When derivatives are nested, the distinct derivative calculations, and their associated perturbations, must be distinguished. This is typically accomplished by creating a unique tag for each derivative calculation, tagging the perturbations, and overloading the arithmetic operators. We exhibit a subtle bug, present in fielded implementations, in which perturbations are confused despite the tagging machinery. The essence of the bug is this: each invocation of a derivative creates a unique tag but a unique tag is needed for each derivative calculation. When taking derivatives of higher-order functions, these need not correspond! The derivative of a higher-order function $f$ that returns a function $g$ will be a function $f'$ that returns a function $\bar{g}$ that performs a derivative calculation. A single invocation of $f'$ will create a single fresh tag but that same tag will be used for each derivative calculation resulting from an invocation of $\bar{g}$. This situation arises when taking derivatives of curried functions. Two potential solutions are presented, and their serious deficiencies discussed. One requires eta expansion to delay the creation of fresh tags from the invocation of $f'$ to the invocation of $\bar{g}$, which can be difficult or even impossible in some circumstances. The other requires $f'$ to wrap $\bar{g}$ with tag renaming, which is difficult to implement without violating the desirable complexity properties of forward AD.

cs.SC

Tangent bundles in differential lambda-categories

Differential lambda-categories were introduced by Bucciarelli et al. as models for the simply typed version of the differential lambda-calculus of Ehrhard and Regnier. A differential lambda-category is a cartesian closed differential category of Blute et al. in which the differential operator is compatible with the closed structure. We prove that any differential lambda-category is equipped with a canonical strong commutative monad whose construction resembles that of the tangent bundle in the category of smooth manifolds. Most of the results of this note remain valid in an arbitrary cartesian differential category. Our emphasis on differential lambda-categories is motivated by the anticipated application of the theory developed in this note to the design and semantics of a lambda-calculus extended by the pushforward operator.

math.CT

Unital ${A}_\infty$-categories

We prove that three definitions of unitality for A-infinity-categories suggested by the first author, by Kontsevich and Soibelman, and by Fukaya are equivalent.

math.CT

Quotients of unital ${A}_\infty$-categories

For a full subcategory B of a unital A_infinity-category C a quotient unital A_infinity-category `C/B' is defined. For differential graded categories such quotient is constructed by V.Drinfeld. Our construction is explicit and uses freely generated A_infinity-categories. The quotient D=`C/B' represents the A_infinity-2-functor A \mapsto A_\infty^u(C,A)_{modulo B}, which associates with a given unital A_infinity-category A the A_infinity-category of unital A_infinity-functors C -> A, whose restriction to B is contractible.

math.CT

Free ${A}_\infty$-categories

For a differential graded k-quiver Q we define the free A-infinity-category FQ generated by Q. The main result is that for an arbitrary A-infinity-category A the restriction A-infinity-functor A_\infty(FQ,A) -> A_1(Q,A) is an equivalence, where objects of the last A-infinity-category are morphisms of differential graded k-quivers Q -> A.

math.CT

A-infinity-bimodules and Serre A-infinity-functors

We define A-infinity-bimodules similarly to Tradler and show that this notion is equivalent to an A-infinity-functor with two arguments which takes values in the differential graded category of complexes of k-modules, where k is a ground commutative ring. Serre A-infinity-functors are defined via A-infinity-bimodules likewise Kontsevich and Soibelman. We prove that a unital closed under shifts A-infinity-category A over a field k admits a Serre A-infinity-functor if and only if its homotopy category H^0(A) admits a Serre k-linear functor. The proof uses categories enriched in K, the homotopy category of complexes of k-modules, and Serre K-functors. Also we use a new A-infinity-version of the Yoneda Lemma generalizing the previously obtained result.

math.CT

Equalizers in the category of cocomplete cocategories

We prove existence of equalizers in certain categories of cocomplete cocategories. This allows us to complete the proof of the fact that A-infinity functor categories arise as internal Hom-objects in the category of differential graded cocomplete augmented cocategories.

math.CT