arXiv · 2110.00446
CHAD for Expressive Total Languages
Abstract
We show how to apply forward and reverse mode Combinatory Homomorphic Automatic Differentiation (CHAD) to total functional programming languages with expressive type systems featuring the combination of - tuple types; - sum types; - inductive types; - coinductive types; - function types. We achieve this by analysing the categorical semantics of such types in $\Sigma$-types (Grothendieck constructions) of suitable categories. Using a novel categorical logical relations technique for such expressive type systems, we give a correctness proof of CHAD in this setting by showing that it computes the usual mathematical derivative of the function that the original program implements. The result is a principled, purely functional and provably correct method for performing forward and reverse mode automatic differentiation (AD) on total functional programming languages with expressive type systems.
Explore related subjects
Keep this discovery
Fernando Lucatelli Nunes, Matthijs Vákár. 2021-10-01. CHAD for Expressive Total Languages. https://doi.org/10.1017/s096012952300018x
Cite the original work for its findings. Save a collection to share your selection of sources.