arXiv subjects

Jonas Probst

Publications and source records attributed to Jonas Probst.

6 recordsLinked to original sources

arXiv2024

Ranking Generated Answers: On the Agreement of Retrieval Models with Humans on Consumer Health Questions

Evaluating the output of generative large language models (LLMs) is challenging and difficult to scale. Many evaluations of LLMs focus on tasks such as single-choice question-answering or text classification. These tasks are not suitable for assessing open-ended question-answering capabilities, which are critical in domains where expertise is required. One such domain is health, where misleading or incorrect answers can have a negative impact on a user's well-being. Using human experts to evaluate the quality of LLM answers is generally considered the gold standard, but expert annotation is costly and slow. We present a method for evaluating LLM answers that uses ranking models trained on annotated document collections as a substitute for explicit relevance judgements and apply it to the CLEF 2021 eHealth dataset. In a user study, our method correlates with the preferences of a human expert (Kendall's $\tau=0.64$). It is also consistent with previous findings in that the quality of generated answers improves with the size of the model and more sophisticated prompting strategies.

cs.IR↗

arXiv2016

A First Law of Entanglement Rates from Holography

For a perturbation of the state of a Conformal Field Theory (CFT), the response of the entanglement entropy is governed by the so-called "first law" of entanglement entropy, in which the change in entanglement entropy is proportional to the change in energy. Whether such a first law holds for other types of perturbations, such as a change to the CFT Lagrangian, remains an open question. We use holography to study the evolution in time $t$ of entanglement entropy for a CFT driven by a $t$-linear source for a conserved $U(1)$ current or marginal scalar operator. We find that although the usual first law of entanglement entropy may be violated, a first law for the rates of change of entanglement entropy and energy still holds. More generally, we prove that this first law for rates holds in holography for any asymptotically $(d+1)$-dimensional Anti-de Sitter metric perturbation whose $t$ dependence first appears at order $z^d$ in the Fefferman-Graham expansion about the boundary at $z=0$.

hep-th↗

arXiv2016

Two-point Functions in a Holographic Kondo Model

We develop the formalism of holographic renormalization to compute two-point functions in a holographic Kondo model. The model describes a $(0+1)$-dimensional impurity spin of a gauged $SU(N)$ interacting with a $(1+1)$-dimensional, large-$N$, strongly-coupled Conformal Field Theory (CFT). We describe the impurity using Abrikosov pseudo-fermions, and define an $SU(N)$-invariant scalar operator $\mathcal{O}$ built from a pseudo-fermion and a CFT fermion. At large $N$ the Kondo interaction is of the form $\mathcal{O}^{\dagger} \mathcal{O}$, which is marginally relevant, and generates a Renormalization Group (RG) flow at the impurity. A second-order mean-field phase transition occurs in which $\mathcal{O}$ condenses below a critical temperature, leading to the Kondo effect, including screening of the impurity. Via holography, the phase transition is dual to holographic superconductivity in $(1+1)$-dimensional Anti-de Sitter space. At all temperatures, spectral functions of $\mathcal{O}$ exhibit a Fano resonance, characteristic of a continuum of states interacting with an isolated resonance. In contrast to Fano resonances observed for example in quantum dots, our continuum and resonance arise from a $(0+1)$-dimensional UV fixed point and RG flow, respectively. In the low-temperature phase, the resonance comes from a pole in the Green's function of the form $-i \langle {\cal O} \rangle^2$, which is characteristic of a Kondo resonance.

hep-th↗

arXiv2016

Holographic Kondo and Fano Resonances

We use holography to study a $(1+1)$-dimensional Conformal Field Theory (CFT) coupled to an impurity. The CFT is an $SU(N)$ gauge theory at large $N$, with strong gauge interactions. The impurity is an $SU(N)$ spin. We trigger an impurity Renormalization Group (RG) flow via a Kondo coupling. The Kondo effect occurs only below the critical temperature of a large-$N$ mean-field transition. We show that at all temperatures $T$, impurity spectral functions exhibit a Fano resonance, which in the low-$T$ phase is a large-$N$ manifestation of the Kondo resonance. We thus provide an example in which the Kondo resonance survives strong correlations, and uncover a novel mechanism for generating Fano resonances, via RG flows between $(0 + 1)$-dimensional fixed points

hep-th↗

arXiv2016

Second-Order Hydrodynamics and Universality in Non-Conformal Holographic Fluids

We study second-order hydrodynamic transport in strongly coupled non-conformal field theories with holographic gravity duals in asymptotically anti-de Sitter space. We first derive new Kubo formulae for five second-order transport coefficients in non-conformal fluids in $(3+1)$ dimensions. We then apply them to holographic RG flows induced by scalar operators of dimension $\Delta=3$. For general background solutions of the dual bulk geometry, we find explicit expressions for the five transport coefficients at infinite coupling and show that a specific combination, $\tilde{H}=2\eta\tau_\pi-2(\kappa-\kappa^*)-\lambda_2$, always vanishes. We prove analytically that the Haack-Yarom identity $H=2\eta\tau_\pi-4\lambda_1-\lambda_2=0$, which is known to be true for conformal holographic fluids, also holds when taking into account leading non-conformal corrections. The numerical results we obtain for two specific families of RG flows suggest that $H$ vanishes regardless of conformal symmetry. Our work provides further evidence that the Haack-Yarom identity $H=0$ may be universally satisfied by strongly coupled fluids.

hep-th↗

arXiv2015

A Holographic Two-Impurity Kondo Model

We propose a model of a strongly-interacting two-impurity Kondo system based on the AdS/CFT correspondence, also known as holography. In a Landau Fermi Liquid, the single-impurity Kondo effect is the screening of an impurity spin at low temperature $T$. The two-impurity Kondo model then describes the competition between the Kondo interaction and the Heisenberg interaction between two impurity spins, also called the RKKY interaction. For spin-$1/2$ impurities, that competition leads to a quantum phase transition from a Kondo-screened phase to a phase in which the two impurity spins screen one another. Our holographic model is based on a $(1+1)$-dimensional CFT description of the two-impurity Kondo model, reliable for two impurities with negligible separation in space. We consider only impurity spins in a totally anti-symmetric representation of an $SU(N)$ spin symmetry. We employ a large-$N$ limit, in which both Kondo and RKKY couplings are double-trace, and both Kondo and inter-impurity screening appear as condensation of single-trace operators at the impurities' location. We perform the holographic renormalization of our model, which allows us to identify the Kondo and RKKY couplings as boundary conditions on fields in AdS. We numerically compute the phase diagram of our model in the plane of RKKY coupling versus $T$, finding evidence for a quantum phase transition from a trivial phase, with neither Kondo nor inter-impurity screening, to a non-trivial phase, with both Kondo and anti-ferromagnetic inter-impurity screening. More generally we show, just using $SU(N)$ representation theory, that ferromagnetic correlations must be absent at leading order in the large-$N$ limit. Our holographic model may be useful for studying many open problems involving strongly-interacting quantum impurities, including for example the Kondo lattice, relevant for describing the heavy fermion compounds.

hep-th↗