arXiv subjects

M. Baity-Jesi

Publications and source records attributed to M. Baity-Jesi.

At least 19 recordsLinked to original sources

arXiv2025

Class Imbalance in Anomaly Detection: Learning from an Exactly Solvable Model

Class imbalance (CI) is a longstanding problem in machine learning, slowing down training and reducing performances. Although empirical remedies exist, it is often unclear which ones work best and when, due to the lack of an overarching theory. We address a common case of imbalance, that of anomaly (or outlier) detection. We provide a theoretical framework to analyze, interpret and address CI. It is based on an exact solution of the teacher-student perceptron model, through replica theory. Within this framework, one can distinguish several sources of CI: either intrinsic, train or test imbalance. Our analysis reveals that the optimal train imbalance is generally different from 50%, with a non trivial dependence on the intrinsic imbalance, the abundance of data and on the noise in the learning. Moreover, there is a crossover between a small noise training regime where results are independent of the noise level to a high noise regime where performances quickly degrade with noise. Our results challenge some of the conventional wisdom on CI and offer practical guidelines to address it.

cs.LG↗

arXiv2025

Quantifying memory in spin glasses

Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A third coefficient has been recently presented by Freedberg et al. We show that these coefficients are physically equivalent by studying their temperature and waiting-time dependence.

cond-mat.dis-nn↗

arXiv2024

Multifractality in spin glasses

We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the computation of the singularity spectrum and its corresponding Legendre transform. A comparatively small number of site pairs controls the average correlation that governs the response to a magnetic field. We explain how this scenario of dramatic fluctuations (at length scales smaller than the coherence length) can be reconciled with the smooth, self-averaging behavior that has long been considered to describe spin-glass dynamics.

cond-mat.dis-nn↗

arXiv2023

On the superposition principle and non-linear response in spin glasses

The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure from linear response which they ascribe to the development of non-linear dynamics. The thrust of this paper is to develop a microscopic origin for this behavior by focusing on the time development of the spin glass correlation length, $ξ(t,t_\mathrm{w};H)$. Here, $t$ is the time after $H$ changes, and $t_\mathrm{w}$ is the time from the quench for $T>T_\mathrm{g}$ to the working temperature $T$ until $H$ changes. We connect the growth of $ξ(t,t_\mathrm{w};H)$ to the barrier heights $Δ(t_\mathrm{w})$ that set the dynamics. The effect of $H$ on the magnitude of $Δ(t_\mathrm{w})$ is responsible for affecting differently the two dynamical protocols associated with turning $H$ off (TRM, or thermoremanent magnetization) or on (ZFC, or zero field-cooled magnetization). In this paper, we display the difference between the zero-field cooled $ξ_{\text {ZFC}}(t,t_\mathrm{w};H)$ and the thermoremanent magnetization $ξ_{\text {TRM}}(t,t_\mathrm{w};H)$ correlation lengths as $H$ increases, both experimentally and through numerical simulations, corresponding to the violation of the extended principle of superposition in line with the finding of the Uppsala Group.

cond-mat.dis-nn↗

arXiv2022

Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology

Monitoring biodiversity is paramount to manage and protect natural resources. Collecting images of organisms over large temporal or spatial scales is a promising practice to monitor the biodiversity of natural ecosystems, providing large amounts of data with minimal interference with the environment. Deep learning models are currently used to automate classification of organisms into taxonomic units. However, imprecision in these classifiers introduces a measurement noise that is difficult to control and can significantly hinder the analysis and interpretation of data. {We overcome this limitation through ensembles of Data-efficient image Transformers (DeiTs), which not only are easy to train and implement, but also significantly outperform} the previous state of the art (SOTA). We validate our results on ten ecological imaging datasets of diverse origin, ranging from plankton to birds. On all the datasets, we achieve a new SOTA, with a reduction of the error with respect to the previous SOTA ranging from 29.35% to 100.00%, and often achieving performances very close to perfect classification. Ensembles of DeiTs perform better not because of superior single-model performances but rather due to smaller overlaps in the predictions by independent models and lower top-1 probabilities. This increases the benefit of ensembling, especially when using geometric averages to combine individual learners. While we only test our approach on biodiversity image datasets, our approach is generic and can be applied to any kind of images.

cs.CV↗

arXiv2022

Memory and rejuvenation in spin glasses: aging systems are ruled by more than one length scale

Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenation, these effects have thus far been impossible to simulate reliably. Yet, three recent developments convinced us to accept this challenge: first, the custom-built Janus II supercomputer makes it possible to carry out "numerical experiments" in which the very same quantities that can be measured in single crystals of CuMn are computed from the simulation, allowing for parallel analysis of the simulation/experiment data. Second, Janus II simulations have taught us how numerical and experimental length scales should be compared. Third, we have recently understood how temperature chaos materializes in aging dynamics. All three aspects have proved crucial for reliably reproducing rejuvenation and memory effects on the computer. Our analysis shows that (at least) three different length scales play a key role in aging dynamics, while essentially all theoretical analyses of the aging dynamics emphasize the presence and the crucial role of a single glassy correlation length.

cond-mat.dis-nn↗

arXiv2021

Deep Learning Classification of Lake Zooplankton

Plankton are effective indicators of environmental change and ecosystem health in freshwater habitats, but collection of plankton data using manual microscopic methods is extremely labor-intensive and expensive. Automated plankton imaging offers a promising way forward to monitor plankton communities with high frequency and accuracy in real-time. Yet, manual annotation of millions of images proposes a serious challenge to taxonomists. Deep learning classifiers have been successfully applied in various fields and provided encouraging results when used to categorize marine plankton images. Here, we present a set of deep learning models developed for the identification of lake plankton, and study several strategies to obtain optimal performances,which lead to operational prescriptions for users. To this aim, we annotated into 35 classes over 17900 images of zooplankton and large phytoplankton colonies, detected in Lake Greifensee (Switzerland) with the Dual Scripps Plankton Camera. Our best models were based on transfer learning and ensembling, which classified plankton images with 98% accuracy and 93% F1 score. When tested on freely available plankton datasets produced by other automated imaging tools (ZooScan, FlowCytobot and ISIIS), our models performed better than previously used models. Our annotated data, code and classification models are freely available online.

cs.CV↗

arXiv2021

Temperature chaos is present in off-equilibrium spin-glass dynamics

We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of recent and forthcoming experiments. This work has been made possible thanks to the most massive simulation to date of non-equilibrium dynamics, carried out on the Janus~II custom-built supercomputer.

cond-mat.dis-nn↗

arXiv2021

Underwater dual-magnification imaging for automated lake plankton monitoring

We present an approach for automated in-situ monitoring of phytoplankton and zooplankton communities based on a dual magnification dark-field imaging microscope/camera. We describe the Dual Scripps Plankton Camera (DSPC) system and associated image processing, and assess its capabilities in detecting and characterizing plankton species of different size and taxonomic categories, and in measuring their abundances in both laboratory and field applications. In the laboratory, body size and abundance estimates by the DSPC significantly and robustly scale with the same measurements derived by traditional microscopy. In the field, a DSPC installed permanently at 3 m depth in Lake Greifensee (Switzerland), delivered images of plankton individuals, colonies, and heterospecific aggregates without disrupting natural arrangements of interacting organisms, their microenvironment or their behavior at hourly timescales. The DSPC was able to track the dynamics of taxa in the size range between ~10 $μ$m to ~ 1 cm, covering virtually all the components of the planktonic food web (including parasites and potentially toxic cyanobacteria). Comparing data from the field-deployed DSPC to traditional sampling and microscopy revealed a general overall agreement in estimates of plankton diversity and abundances, despite imaging limitations in detecting small phytoplankton species and rare and large zooplankton taxa (e.g. carnivorous zooplankton). The most significant disagreements between traditional methods and the DSPC resided in the measurements of community properties of zooplankton, organisms that are heterogeneously distributed spatially and temporally, and whose demography appeared to be better captured by automated imaging. Time series collected by the DSPC depicted ecological succession patterns, algal bloom dynamics and circadian fluctuations with a temporal frequency and morphological [continues...]

q-bio.PE↗

arXiv2021

Spin-glass dynamics in the presence of a magnetic field: exploration of microscopic properties

The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cooled down to a stabilised measuring temperature $T<T_\mathrm{g}$ and of the time $t$ after the magnetic field is changed. This correlation length is extracted experimentally for a CuMn 6 at. % single crystal, as well as for simulations on the Janus II special-purpose supercomputer, the latter with time and length scales comparable to experiment. The non-linear magnetic susceptibility is reported from experiment and simulations, using $ξ(t,t_\mathrm{w};T)$ as the scaling variable. Previous experiments are reanalysed, and disagreements about the nature of the Zeeman energy are resolved. The growth of the spin-glass magnetisation in zero-field magnetisation experiments, $M_\mathrm{ZFC}(t,t_\mathrm{w};T)$, is measured from simulations, verifying the scaling relationships in the dynamical or non-equilibrium regime. Our preliminary search for the de Almeida-Thouless line in $D=3$ is discussed.

cond-mat.dis-nn↗

arXiv2020

Scaling law describes the spin-glass response in theory, experiments and simulations

The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-glass correlation length. The scaling law is successfully tested against experimental measurements in a CuMn single crystal and against large-scale simulations on the Janus II dedicated computer.

cond-mat.stat-mech↗

arXiv2019

The Mpemba effect in spin glasses is a persistent memory effect

The Mpemba effect occurs when a hot system cools faster than an initially colder one, when both are refrigerated in the same thermal reservoir. Using the custom built supercomputer Janus II, we study the Mpemba effect in spin glasses and show that it is a non-equilibrium process, governed by the coherence length ξof the system. The effect occurs when the bath temperature lies in the glassy phase, but it is not necessary for the thermal protocol to cross the critical temperature. In fact, the Mpemba effect follows from a strong relationship between the internal energy and ξthat turns out to be a sure-tell sign of being in the glassy phase. Thus, the Mpemba effect presents itself as an intriguing new avenue for the experimental study of the coherence length in supercooled liquids and other glass formers.

cond-mat.dis-nn↗

arXiv2018

Aging rate of spin glasses from simulations matches experiments

Experiments on spin glasses can now make precise measurements of the exponent $z(T)$ governing the growth of glassy domains, while our computational capabilities allow us to make quantitative predictions for experimental scales. However, experimental and numerical values for $z(T)$ have differed. We use new simulations on the Janus II computer to resolve this discrepancy, finding a time-dependent $z(T, t_w)$, which leads to the experimental value through mild extrapolations. Furthermore, theoretical insight is gained by studying a crossover between the $T = T_c$ and $T = 0$ fixed points.

cond-mat.dis-nn↗

arXiv2018

Comparing Dynamics: Deep Neural Networks versus Glassy Systems

We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems. The two main issues we address are (1) the complexity of the loss landscape and of the dynamics within it, and (2) to what extent DNNs share similarities with glassy systems. Our findings, obtained for different architectures and datasets, suggest that during the training process the dynamics slows down because of an increasingly large number of flat directions. At large times, when the loss is approaching zero, the system diffuses at the bottom of the landscape. Despite some similarities with the dynamics of mean-field glassy systems, in particular, the absence of barrier crossing, we find distinctive dynamical behaviors in the two cases, showing that the statistical properties of the corresponding loss and energy landscapes are different. In contrast, when the network is under-parametrized we observe a typical glassy behavior, thus suggesting the existence of different phases depending on whether the network is under-parametrized or over-parametrized.

stat.ML↗

arXiv2017

Matching microscopic and macroscopic responses in glasses

We first reproduce on the Janus and Janus II computers a milestone experiment that measures the spin-glass coherence length through the lowering of free-energy barriers induced by the Zeeman effect. Secondly we determine the scaling behavior that allows a quantitative analysis of a new experiment reported in the companion Letter [S. Guchhait and R. Orbach, Phys. Rev. Lett. 118, 157203 (2017)]. The value of the coherence length estimated through the analysis of microscopic correlation functions turns out to be quantitatively consistent with its measurement through macroscopic response functions. Further, non-linear susceptibilities, recently measured in glass-forming liquids, scale as powers of the same microscopic length.

cond-mat.dis-nn↗

arXiv2017

A statics-dynamics equivalence through the fluctuation-dissipation ratio provides a window into the spin-glass phase from nonequilibrium measurements

The unifying feature of glass formers (such as polymers, supercooled liquids, colloids, granulars, spin glasses, superconductors, ...) is a sluggish dynamics at low temperatures. Indeed, their dynamics is so slow that thermal equilibrium is never reached in macroscopic samples: in analogy with living beings, glasses are said to age. Here, we show how to relate experimentally relevant quantities with the experimentally unreachable low-temperature equilibrium phase. We have performed a very accurate computation of the non-equilibrium fluctuation-dissipation ratio for the three-dimensional Edwards-Anderson Ising spin glass, by means of large-scale simulations on the special-purpose computers Janus and Janus II. This ratio (computed for finite times on very large, effectively infinite, systems) is compared with the equilibrium probability distribution of the spin overlap for finite sizes. The resulting quantitative statics-dynamics dictionary, based on observables that can be measured with current experimental methods, could allow the experimental exploration of important features of the spin-glass phase without uncontrollable extrapolations to infinite times or system sizes.

cond-mat.dis-nn↗

arXiv2015

Inherent Structures in m-component Spin Glasses

We observe numerically the properties of the infinite-temperature inherent structures of m-component vector spin glasses in three dimensions. An increase of m implies a decrease of the amount of minima of the free energy, down to the trivial presence of a unique minimum. For little m correlations are small and the dynamics are quickly arrested, while for larger m low-temperature correlations crop up and the convergence is slower, to a limit that appears to be related with the system size.

cond-mat.dis-nn↗

arXiv2014

The three dimensional Ising spin glass in an external magnetic field: the role of the silent majority

We perform equilibrium parallel-tempering simulations of the 3D Ising Edwards-Anderson spin glass in a field. A traditional analysis shows no signs of a phase transition. Yet, we encounter dramatic fluctuations in the behaviour of the model: Averages over all the data only describe the behaviour of a small fraction of it. Therefore we develop a new approach to study the equilibrium behaviour of the system, by classifying the measurements as a function of a conditioning variate. We propose a finite-size scaling analysis based on the probability distribution function of the conditioning variate, which may accelerate the convergence to the thermodynamic limit. In this way, we find a non-trivial spectrum of behaviours, where a part of the measurements behaves as the average, while the majority of them shows signs of scale invariance. As a result, we can estimate the temperature interval where the phase transition in a field ought to lie, if it exists. Although this would-be critical regime is unreachable with present resources, the numerical challenge is finally well posed.

cond-mat.dis-nn↗