SearcharxivSearch

arXiv subjects

Jesse Perla

Publications and source records attributed to Jesse Perla.

3 recordsLinked to original sources

STEER-ME: Assessing the Microeconomic Reasoning of Large Language Models

How should one judge whether a given large language model (LLM) can reliably perform economic reasoning? Most existing LLM benchmarks focus on specific applications and fail to present the model with a rich variety of economic tasks. A notable exception is Raman et al. [2024], who offer an approach for comprehensively benchmarking strategic decision-making; however, this approach fails to address the non-strategic settings prevalent in microeconomics, such as supply-and-demand analysis. We address this gap by taxonomizing microeconomic reasoning into $58$ distinct elements, focusing on the logic of supply and demand, each grounded in up to $10$ distinct domains, $5$ perspectives, and $3$ types. The generation of benchmark data across this combinatorial space is powered by a novel LLM-assisted data generation protocol that we dub auto-STEER, which generates a set of questions by adapting handwritten templates to target new domains and perspectives. Because it offers an automated way of generating fresh questions, auto-STEER mitigates the risk that LLMs will be trained to over-fit evaluation benchmarks; we thus hope that it will serve as a useful tool both for evaluating and fine-tuning models for years to come. We demonstrate the usefulness of our benchmark via a case study on $27$ LLMs, ranging from small open-source models to the current state of the art. We examined each model's ability to solve microeconomic problems across our whole taxonomy and present the results across a range of prompting strategies and scoring metrics.

cs.CL

Solving Models of Economic Dynamics with Ridgeless Kernel Regressions

This paper proposes a ridgeless kernel method for solving infinite-horizon, deterministic, continuous-time models in economic dynamics, formulated as systems of differential-algebraic equations with asymptotic boundary conditions (e.g., transversality). Traditional shooting methods enforce the asymptotic boundary conditions by targeting a known steady state -- which is numerically unstable, hard to tune, and unable to address cases with steady-state multiplicity. Instead, our approach solves the underdetermined problem without imposing the asymptotic boundary condition, using regularization to select the unique solution fulfilling transversality among admissible trajectories. In particular, ridgeless kernel methods recover this path by selecting the minimum norm solution, coinciding with the non-explosive trajectory. We provide theoretical guarantees showing that kernel solutions satisfy asymptotic boundary conditions without imposing them directly, and we establish a consistency result ensuring convergence within the solution concept of differential-algebraic equations. Finally, we illustrate the method in canonical models and demonstrate its ability to handle problems with multiple steady states.

econ.GN

Eigenvalues and Eigenvectors of Tau Matrices with Applications to Markov Processes and Economics

In the context of matrix displacement decomposition, Bozzo and Di Fiore introduced the so-called $\tau_{\varepsilon,\varphi}$ algebra, a generalization of the more known $\tau$ algebra originally proposed by Bini and Capovani. We study the properties of eigenvalues and eigenvectors of the generator $T_{n,\varepsilon,\varphi}$ of the $\tau_{\varepsilon,\varphi}$ algebra. In particular, we derive the asymptotics for the outliers of $T_{n,\varepsilon,\varphi}$ and the associated eigenvectors; we obtain equations for the eigenvalues of $T_{n,\varepsilon,\varphi}$, which provide also the eigenvectors of $T_{n,\varepsilon,\varphi}$; and we compute the full eigendecomposition of $T_{n,\varepsilon,\varphi}$ in the specific case $\varepsilon\varphi=1$. We also present applications of our results in the context of queuing models, random walks, and diffusion processes, with a special attention to their implications in the study of wealth/income inequality and portfolio dynamics.

math.NA