Searcharxiv⌕ Search

arXiv subjects

Naveen Balaji Umasankar

Publications and source records attributed to Naveen Balaji Umasankar.

5 recordsLinked to original sources

How Good Are Frontier Models at Physics? Expert Re-Grading Reveals Broken Evaluations and Near-Saturation of Leading Benchmarks

Low reported scores on leading physics benchmarks, including those featured in the Artificial Analysis Intelligence Index (2026), suggest that frontier language models still struggle with advanced physics, a demanding test of their scientific reasoning and quantitative problem-solving abilities. Yet this impression does not always align with domain experts' experiences using these models in their work. We revisit these reported findings by evaluating frontier models on six widely used physics benchmarks and auditing them with experts, focusing on text-only problems with verifiable final answers. For each subfield of physics, faculty and graduate researchers with relevant expertise carefully review problem statements, reference solutions, and model responses to distinguish genuine model errors from grader errors, incorrect reference solutions, and ambiguous or underspecified questions. Most audited cases initially evaluated as incorrect reflect these benchmarking issues rather than errors in the models' physics reasoning. We then ask experts to address these benchmarking issues by correcting erroneous reference solutions and repairing or excluding flawed questions. We find that GPT-5.6-Sol's measured mean@4 rises from 47.3% to 78.7% on HLE-Physics and from 61.0% to 87.2% on CMT-Benchmark, while its corrected pass@4 reaches 94.4% on the 54 retained CritPt challenges. Corrected scores are computed on the retained evaluation subsets following expert review. Scores on the audited subsets of UGPhysics, PRISM-Physics, and PHYBench also rise substantially after correction. These findings suggest that current benchmarks substantially understate frontier models' ability to solve well-posed physics problems. Near-saturation on these closed-ended tasks highlights the need for more demanding, expert-validated evaluations.

cs.AI↗

OPE and correlation functions in a generally covariant form

In this paper we consider some general aspects of Euclidean conformal field theories on curved spaces of dimension $D\ge 3$. We first look at the OPE of scalar primary fields on conformally flat spaces. Extending the results of \cite{Konechny:2026bqg}, we give a general construction of the descendants' contributions to the OPE in the scalar channel. We then discuss CFTs on non-conformally flat spaces in the ambient space formalism. We investigate the short-distance behaviour of three-point functions on such spaces using the general ansatz proposed by Parisini, Skenderis, and Withers \cite{Parisini:2022wkb, Parisini:2023nbd}. We find that some additional corrections need to be added to the ansatz to ensure the existence of a local covariant OPE.

hep-th↗

Verlinde lines, anyon permutations and commutant pairs inside $E_{8,1}$ CFT

We develop a defect-theoretic refinement of meromorphic 2d CFTs in which the ordinary torus partition function -- often just the vacuum character -- does not reveal how states organize under symmetry lines. Our central proposal is an \emph{equatorial projection} framework: from a commutant decomposition into commuting rational chiral algebras with categories $\mathcal{C}$ and $\widetilde{\mathcal{C}}$, we encode genus-one couplings by a non-negative integer matrix $M$ pairing characters and satisfying modular intertwiner relations. Invertible topological defect lines act directly on this gluing data (Verlinde lines diagonally via $S$-matrix eigenvalues, and anyon-permuting lines by braided-autoequivalence permutations), making modular covariance of defect amplitudes automatic and sharply distinguishing insertions that yield genuine modular invariants from those defining consistent non-holomorphic interfaces. We further show that the \emph{replacement rules} of \cite{Hegde:2021sdm, Lin:2019hks} arise as equatorial projections of defect actions, and we extend these constructions beyond two-character examples by systematically treating three-character commutant pairs in the $E_{8,1}$ theory. The unique $c=8$ meromorphic CFT $E_{8,1}$ serves as a universal testbed, producing new defect partition functions and clarifying the roles of $\mathrm{Pic}(\mathcal{C})$ and $\mathrm{Aut}^{\mathrm{br}}(\mathcal{C})$. Finally, we outline extensions to higher central charges (e.g.\ $c=32,40$), yielding modular-invariant non-meromorphic theories beyond the $c=24$ Schellekens landscape \cite{Schellekens:1992db} as defect/interface descendants of meromorphic parents.

hep-th↗

Two- & Three-character solutions to MLDEs and Ramanujan-Eisenstein Identities for Fricke Groups

In this work we extend the study of arXiv:2210.07186 by investigating two- and three-character MLDEs for Fricke groups at prime levels. We have constructed these higher-character MLDEs by using a $\mathit{novel}$ Serre-Ramanujan type derivative operator which maps $k$-forms to $(k+2)$-forms in $Γ^{+}_0(p)$. We found that this $\mathit{novel}$ derivative construction enabled us to write down a general prescription for obtaining $\mathit{Ramanujan-Eisenstein}$ identities for these groups. We discovered several $\mathit{novel}$ single-, two-, and three-character admissible solutions for Fricke groups at levels $2$ and $3$ after solving the MLDEs among which we have realized some in terms of Mckay-Thompson series and others in terms of modular forms of the corresponding Hecke groups. Among these solutions, we have identified interesting non-trivial bilinear identities. Furthermore, we could construct $\mathit{putative}$ partition functions for these theories based on these bilinear pairings, which could have a range of lattice interpretations. We also present and discuss modular re-parameterization of MLDE and their solutions for Fricke groups of prime levels.

hep-th↗

Modular Linear Differential Equations for Hecke and Fricke Groups

Modular linear differential equations (MLDE) play a significant role in the classification of two-dimensional CFTs, where the modular forms in the equations belonged to the space of $\text{SL}(2,\mathbb{Z})$. A systematic study of the differential equations and their solutions for the Hecke groups $Γ_{0}(N)$ and Fricke groups $Γ_{0}^{+}(N)$ would better our understanding of CFT classification as there has not been significant work on the MLDE analysis for subgroups of $\text{SL}(2,\mathbb{Z})$. In this paper, we set up and solve MLDEs for Hecke and Fricke groups at levels $N\leq 12$ and report on admissible character-like solutions obtained in each group. We find that only the first four genus zero groups $Γ_{0}^{+}(p)$ where $p$ is a prime divisor of the Monster group $\mathbb{M}$ possess admissible single character solutions and we argue that the solutions for $Γ_{0}^{+}(11)$ are rendered inadmissible due to its Hauptmodul while those for $Γ_{0}^{+}(13)$ are rendered inadmissible due to the nature of the basis decomposition of the space of modular forms. We present a new quasi-character solution at the single character level for the Hecke groups $Γ_{0}(2)$, $Γ_{0}(7)$, and the subsequent group in its modular tower, $Γ_{0}(49)$. We also extend all of the results for single character solutions of Fricke groups to all prime divisor levels of $\mathbb{M}$ and remark on favorable properties in each group that could play a role in obtaining admissible solutions. Finally, we find the $Θ$-series associated with levels $p = 2,3,5,7$ and the corresponding lattice data of Kissing numbers and lattice radii for each case. We find that the Fricke $Θ$-series of level $p = 2$ has distinctive ties to the odd Leech lattice in $24$-dimensions.

hep-th↗