Searcharxiv⌕ Search

arXiv subjects

Anton Makarov

Publications and source records attributed to Anton Makarov.

3 recordsLinked to original sources

Neural Classifiers as Error-Correcting Codes

A unified framework is proposed that characterizes supervised deep classification as the decoding of error-correcting codes in the Shannon sense. Cross-entropy optimization is shown to align softmax classifiers with maximum-likelihood decoding, where logits map to Hamming distances to class-specific codewords. This correspondence explains the emergence of standard divergence objectives (e.g., Kullback-Leibler, Jeffreys, Bregman) and provides a geometric basis for the stability of decision boundaries. Furthermore, the geometries of Neural Collapse and LeJEPA are identified as optimal constellations for decoding under isotropic noise. Unlike classical Error-Correcting Output Codes, deep networks are shown to learn effective codebooks in the feature space implicitly. This insight is leveraged to derive novel criteria for lossless quantization, improved knowledge distillation, and architectural regularization based on code redundancy. Finally, this perspective is extended to self-supervised encoders, offering a cohesive explanation for the geometry of latent representations in modern neural models.

cs.LG↗

Local Stability and Gaussian Smoothing of Quantized Neural Networks

We study Gaussian averaging as a smooth surrogate for quantized neural models. Under bounded local oscillation, we derive a local dimension-dependent bound on |f-g|, linking Gaussian smoothing to the stability analysis of discontinuous networks. We compute closed-form Gaussian averages of the rectified linear unit (ReLU) and sign activation functions, and illustrate the mechanism on a high-dimensional binary perceptron, where layer-preactivation aggregation under an explicit quantization-noise surrogate yields the Gaussian envelope used in inference-side smoothing and training-side smooth surrogate gradients.

cs.LG↗

All-optical atomic magnetometry using an elliptically polarized amplitude-modulated light wave

We study a resonant interaction of an elliptically polarized light wave with $^{87}$Rb vapor (D$_1$ line) exposed to a transverse magnetic field. A $5$$\times$$5$$\times$$5$~mm$^3$ glass vapor cell is used for the experiments. The wave intensity is modulated at the frequency $Ω_m$. By scanning $Ω_m$ near the Larmor frequency $Ω_L$, a magnetic resonance (MR) can be observed as a change in the ellipticity parameter of the wave polarization. This method for observing MR allows to significantly improve the signal-to-noise ratio compared to a classical Bell-Bloom scheme using a circularly polarized wave. The sensitivity of the magnetic field sensor is estimated to be $\approx\,$$130$~fT/$\surd$Hz in a $2$~kHz bandwidth, confidently competing with widely used Faraday-rotation Bell-Bloom schemes. The results can be used to develop a miniature all-optical magnetic field sensor for medicine and geophysics.

physics.atom-ph↗