Searcharxiv⌕ Search

arXiv subjects

Przemek Witaszczyk

Publications and source records attributed to Przemek Witaszczyk.

3 recordsLinked to original sources

Complexity for deep neural networks and other characteristics of deep feature representations

We define a notion of complexity, which quantifies the nonlinearity of the computation of a neural network, as well as a complementary measure of the effective dimension of feature representations. We investigate these observables both for trained networks for various datasets as well as explore their dynamics during training, uncovering in particular power law scaling. These observables can be understood in a dual way as uncovering hidden internal structure of the datasets themselves as a function of scale or depth. The entropic character of the proposed notion of complexity should allow to transfer modes of analysis from neuroscience and statistical physics to the domain of artificial neural networks. The introduced observables can be applied without any change to the analysis of biological neuronal systems.

cs.LG↗

$p$-adic AdS/CFT

We construct a $p$-adic analog to AdS/CFT, where an unramified extension of the $p$-adic numbers replaces Euclidean space as the boundary and a version of the Bruhat-Tits tree replaces the bulk. Correlation functions are computed in the simple case of a single massive scalar in the bulk, with results that are strikingly similar to ordinary holographic correlation functions when expressed in terms of local zeta functions. We give some brief discussion of the geometry of $p$-adic chordal distance and of Wilson loops. Our presentation includes an introduction to $p$-adic numbers.

hep-th↗

Segmented strings and the McMillan map

We present new exact solutions describing motions of closed segmented strings in $AdS_3$ in terms of elliptic functions. The existence of analytic expressions is due to the integrability of the classical equations of motion, which in our examples reduce to instances of the McMillan map. We also obtain a discrete evolution rule for the motion in $AdS_3$ of arbitrary bound states of fundamental strings and D1-branes in the test approximation.

hep-th↗