SearcharxivSearch

arXiv subjects

Rafael Frongillo

Publications and source records attributed to Rafael Frongillo.

At least 19 recordsLinked to original sources

Joint-task truthfulness of the DMI mechanism

The Determinant Mutual Information (DMI) mechanism of Kong (2020, 2024) is dominantly truthful within the class of *consistent* reporting strategies, those that apply the same single-task strategy to every task. In settings where agents see multiple tasks before reporting, such as peer grading or peer review, it is natural to consider *joint-task* strategies that may condition reports on the full signal vector. Perhaps surprisingly, we show that the DMI mechanism preserves truthful reporting as a best response among all joint-task strategies when other agents play consistent strategies, so that truthfulness remains a Bayes--Nash equilibrium in the joint-task class. Without the restriction of peers to consistent strategies, however, both dominant truthfulness and informed truthfulness fail against joint-task peer strategies.

cs.GT

Toward Simultaneously Optimal Regret in U-Calibration

U-calibration studies online forecasting algorithms whose predictions can be consumed by any unknown downstream agent, guaranteeing sublinear regret simultaneously for all proper loss functions. Existing U-calibration algorithms achieve worst-case optimal $O(\sqrt{T})$ regret for every bounded proper loss, but they fail to adapt to easier losses: as we show, even for smooth losses such as squared loss, they incur $\Omega(\sqrt{T})$ regret instead of the optimal $O(\log T)$ regret. In this work, we show that this limitation is not inherent. Specifically, we design a single forecast algorithm that simultaneously achieves $\tilde O(\sqrt{T})$ regret for every bounded proper loss and $O(\log T)$ regret for every bounded smooth proper loss. More generally, our algorithm also attains logarithmic regret for losses that are smooth relative to the log-barrier, which include several non-Lipschitz examples. Our approach is based on a novel variant of Follow-the-Perturbed-Leader (FTPL) in which perturbations are applied directly in the prediction space using self-concordant noise. The resulting analysis also departs substantially from prior FTPL analyses due to the complex nature of this noise and may be of independent interest.

stat.ML

Adaptive Liquidity in Prediction Markets via Online Learning

Prediction markets rely on liquidity to convert trades into informative prices, yet existing mechanisms fix liquidity ex ante. This restriction enforces a static trade-off between price responsiveness and worst-case loss despite inherently nonstationary trading conditions. We propose a fundamentally different approach that treats liquidity selection itself as an online learning problem. Our mechanism mixes a family of cost-function markets via learnable weights, yielding a single adaptive market that preserves no-arbitrage, bounded worst-case loss, expressiveness, and positive upside. We introduce a hybrid structural risk signal, a per-round objective that quantifies the trade-off between price impact and inventory risk, and show that standard online learning algorithms achieve switching-regret guarantees relative to the best sequence of liquidity regimes in hindsight. Simulations demonstrate that the mechanism adaptively shifts liquidity across regimes in response to both order flow and inventory dynamics. Our results establish a principled framework for adaptive liquidity, connecting prediction market design with online learning.

cs.GT

Equilibria in Large Position-Optimization Games

We propose a general class of symmetric games called position-optimization games. Given a probability distribution $Q$ over a set of targets $\mathcal{Y}$, the $n$ players each choose a position in a space $\mathcal{X}$. A player's utility is the $Q$-mass of targets they are closest to under some proximity measure, with ties broken evenly. Our model captures Hotelling games and forecasting competitions, among other applications. We show that for sufficiently large $n$, both pure and symmetric mixed Nash equilibria exist, and moreover are extreme: all players play on a finite set of pseudo-targets $\mathcal{X}^* \subseteq \mathcal{X}$. We further show that both pure and symmetric mixed equilibria converge to the distribution $P$ on $\mathcal{X}^*$ induced by $Q$, and bound the convergence rate in $n$. The generality of our model allows us to extend and strengthen previous work in Hotelling games, and prove entirely new results in forecasting competitions and other applications.

cs.GT

Minimax Duality in Game-Theoretic Probability

Game-theoretic probability uses the structure of gambles to define a concept like probability, but which is more flexible and robust. We show that results in game-theoretic probability can be thought of as minimax theorems for specific zero-sum games between two players, Gambler and World. The traditional measure-theoretic versions arise when World must play first. This perspective suggests the possibility of a more general minimax theorem from which a wide array of game-theoretic results would follow. After developing a new framing of game-theoretic probability via gamble spaces, we prove such a theorem for finite time. Applying this minimax theorem to games derived from existing measure-theoretic statements, we prove several existing and novel game-theoretic statements. This general minimax theorem can be thought of as a composite Ville's theorem, as we discuss along with future directions.

math.PR

Robust forecast aggregation via additional queries

We study the problem of robust forecast aggregation: combining expert forecasts with provable accuracy guarantees compared to the best possible aggregation of the underlying information. Prior work shows strong impossibility results, e.g. that even under natural assumptions, no aggregation of the experts' individual forecasts can outperform simply following a random expert (Neyman and Roughgarden, 2022). In this paper, we introduce a more general framework that allows the principal to elicit richer information from experts through structured queries. Our framework ensures that experts will truthfully report their underlying beliefs, and also enables us to define notions of complexity over the difficulty of asking these queries. Under a general model of independent but overlapping expert signals, we show that optimal aggregation is achievable in the worst case with each complexity measure bounded above by the number of agents $n$. We further establish tight tradeoffs between accuracy and query complexity: aggregation error decreases linearly with the number of queries, and vanishes when the "order of reasoning" and number of agents relevant to a query is $\omega(\sqrt{n})$. These results demonstrate that modest extensions to the space of expert queries dramatically strengthen the power of robust forecast aggregation. We therefore expect that our new query framework will open up a fruitful line of research in this area.

cs.GT

Consistency Conditions for Differentiable Surrogate Losses

The statistical consistency of surrogate losses for discrete prediction tasks is often checked via the condition of calibration. However, directly verifying calibration can be arduous. Recent work shows that for polyhedral surrogates, a less arduous condition, indirect elicitation (IE), is still equivalent to calibration. We give the first results of this type for non-polyhedral surrogates, specifically the class of convex differentiable losses. We first prove that under mild conditions, IE and calibration are equivalent for one-dimensional losses in this class. We construct a counter-example that shows that this equivalence fails in higher dimensions. This motivates the introduction of strong IE, a strengthened form of IE that is equally easy to verify. We establish that strong IE implies calibration for differentiable surrogates and is both necessary and sufficient for strongly convex, differentiable surrogates. Finally, we apply these results to a range of problems to demonstrate the power of IE and strong IE for designing and analyzing consistent differentiable surrogates.

cs.LG

Structured Prediction with Abstention via the Lov\'asz Hinge

The Lov\'asz hinge is a convex loss function proposed for binary structured classification, in which k related binary predictions jointly evaluated by a submodular function. Despite its prevalence in image segmentation and related tasks, the consistency of the Lov\'asz hinge has remained open. We show that the Lov\'asz hinge is inconsistent with its desired target unless the set function used for evaluation is modular. Leveraging the embedding framework of Finocchiaro et al. (2024), we find the target loss for which the Lov\'asz hinge is consistent. This target, which we call the structured abstain problem, is a variant of selective classification for structured prediction that allows one to abstain on any subset of the k binary predictions. We derive a family of link functions, each of which is simultaneously consistent for all polymatroids, a subset of submodular set functions. We then give sufficient conditions on the polymatroid for the structured abstain problem to be tightly embedded by the Lov\'asz hinge, meaning no target prediction is redundant. We experimentally demonstrate the potential of the structured abstain problem for interpretability in structured classification tasks. Finally, for the multiclass setting, we show that one can combine the binary encoding construction of Ramaswamy et al. (2018) with our link construction to achieve an efficient consistent surrogate for a natural multiclass generalization of the structured abstain problem.

cs.LG

Peer Prediction with More Signals than Reports

Peer prediction mechanisms are typically proposed and analyzed under the assumption that the report and signal spaces are identical. In practice, however, agents often observe richer information which they then map to a coarser report space. Motivated by this discrepancy between theory and practice, we initiate the study of peer prediction mechanisms with signal spaces that are richer than the report space. We begin by formalizing a model with real-valued signals and binary reports. In this setting, it is natural to study symmetric threshold strategies, where agents map their signals to binary reports according to a single real-valued threshold. For several well-known binary-report peer prediction mechanisms, we show that most equilibria under the original assumption of binary signals are no longer equilibria in our model. Furthermore, dynamic analysis proves that some of the remaining thresholds are unstable. These results extend beyond real-valued signals and binary reports to settings where the signal space is finer-grained than the report space. While the results above suggest important limitations for the deployment of existing peer prediction mechanisms in practice, we also use them to develop a new, more robust mechanism. This mechanism generates a larger number of stable threshold equilibria under our model, thus allowing the designer more flexibility in choosing how agents map their signals to reports.

cs.GT

Hedging and Approximate Truthfulness in Traditional Forecasting Competitions

In forecasting competitions, the traditional mechanism scores the predictions of each contestant against the outcome of each event, and the contestant with the highest total score wins. While it is well-known that this traditional mechanism can suffer from incentive issues, it is folklore that contestants will still be roughly truthful as the number of events grows. Yet thus far the literature lacks a formal analysis of this traditional mechanism. This paper gives the first such analysis. We first demonstrate that the ''long-run truthfulness'' folklore is false: even for arbitrary numbers of events, the best forecaster can have an incentive to hedge, reporting more moderate beliefs to increase their win probability. On the positive side, however, we show that two contestants will be approximately truthful when they have sufficient uncertainty over the relative quality of their opponent and the outcomes of the events, a case which may arise in practice.

cs.LG

A General Theory of Liquidity Provisioning for Prediction Markets

Liquidity provisioning in automated market makers is the practice of recruiting third-party liquidity providers (LPs) to contribute assets to the market in exchange for fees skimmed off of trades. This paper introduces a general framework for liquidity provisioning in cost function prediction markets. Our most general protocol allows LPs to submit or update an arbitrary cost function that specifies their liquidity over the entire price space. We show that our protocol encapsulates several notions of running market makers in parallel, which we prove to be equivalent. We also recover existing protocols from decentralized finance as special cases. In our protocol, liquidity can be expressed as a matrix-valued function, which we argue is necessary with three or more securities. Due to this inherent multidimensionality, the design of trading fees with three or more securities is nontrivial: we show that natural axioms on the design of these fees are incompatible.

cs.GT

An Axiomatic Characterization of CFMMs and Equivalence to Prediction Markets

Constant-function market makers (CFMMs), such as Uniswap, are automated exchanges offering trades among a set of assets. We study their technical relationship to another class of automated market makers, cost-function prediction markets. We first introduce axioms for market makers and show that CFMMs with concave potential functions characterize "good" market makers according to these axioms. We then show that every such CFMM on $n$ assets is equivalent to a cost-function prediction market for events with $n$ outcomes. Our construction directly converts a CFMM into a prediction market and vice versa. Conceptually, our results show that desirable market-making axioms are equivalent to desirable information-elicitation axioms, i.e., markets are good at facilitating trade if and only if they are good at revealing beliefs. For example, we show that every CFMM implicitly defines a proper scoring rule for eliciting beliefs; the scoring rule for Uniswap is unusual, but known. From a technical standpoint, our results show how tools for prediction markets and CFMMs can interoperate. We illustrate this interoperability by showing how liquidity strategies from both literatures transfer to the other, yielding new market designs.

cs.GT

Forecasting Competitions with Correlated Events

Beginning with Witkowski et al. [2022], recent work on forecasting competitions has addressed incentive problems with the common winner-take-all mechanism. Frongillo et al. [2021] propose a competition mechanism based on follow-the-regularized-leader (FTRL), an online learning framework. They show that their mechanism selects an $ε$-optimal forecaster with high probability using only $O(\log(n)/ε^2)$ events. These works, together with all prior work on this problem thus far, assume that events are independent. We initiate the study of forecasting competitions for correlated events. To quantify correlation, we introduce a notion of block correlation, which allows each event to be strongly correlated with up to $b$ others. We show that under distributions with this correlation, the FTRL mechanism retains its $ε$-optimal guarantee using $O(b^2 \log(n)/ε^2)$ events. Our proof involves a novel concentration bound for correlated random variables which may be of broader interest.

cs.LG

Proper losses for discrete generative models

We initiate the study of proper losses for evaluating generative models in the discrete setting. Unlike traditional proper losses, we treat both the generative model and the target distribution as black-boxes, only assuming ability to draw i.i.d. samples. We define a loss to be black-box proper if the generative distribution that minimizes expected loss is equal to the target distribution. Using techniques from statistical estimation theory, we give a general construction and characterization of black-box proper losses: they must take a polynomial form, and the number of draws from the model and target distribution must exceed the degree of the polynomial. The characterization rules out a loss whose expectation is the cross-entropy between the target distribution and the model. By extending the construction to arbitrary sampling schemes such as Poisson sampling, however, we show that one can construct such a loss.

cs.LG

Computational complexity of problems for deterministic presentations of sofic shifts

Sofic shifts are symbolic dynamical systems defined by the set of bi-infinite sequences on an edge-labeled directed graph, called a presentation. We study the computational complexity of an array of natural decision problems about presentations of sofic shifts, such as whether a given graph presents a shift of finite type, or an irreducible shift; whether one graph presents a subshift of another; and whether a given presentation is minimal, or has a synchronizing word. Leveraging connections to automata theory, we first observe that these problems are all decidable in polynomial time when the given presentation is irreducible (strongly connected), via algorithms both known and novel to this work. For the general (reducible) case, however, we show they are all PSPACE-complete. All but one of these problems (subshift) remain polynomial-time solvable when restricting to synchronizing deterministic presentations. We also study the size of synchronizing words and synchronizing deterministic presentations.

cs.CC

Consistent Polyhedral Surrogates for Top-$k$ Classification and Variants

Top-$k$ classification is a generalization of multiclass classification used widely in information retrieval, image classification, and other extreme classification settings. Several hinge-like (piecewise-linear) surrogates have been proposed for the problem, yet all are either non-convex or inconsistent. For the proposed hinge-like surrogates that are convex (i.e., polyhedral), we apply the recent embedding framework of Finocchiaro et al. (2019; 2022) to determine the prediction problem for which the surrogate is consistent. These problems can all be interpreted as variants of top-$k$ classification, which may be better aligned with some applications. We leverage this analysis to derive constraints on the conditional label distributions under which these proposed surrogates become consistent for top-$k$. It has been further suggested that every convex hinge-like surrogate must be inconsistent for top-$k$. Yet, we use the same embedding framework to give the first consistent polyhedral surrogate for this problem.

cs.LG

The Structured Abstain Problem and the Lovász Hinge

The Lovász hinge is a convex surrogate recently proposed for structured binary classification, in which $k$ binary predictions are made simultaneously and the error is judged by a submodular set function. Despite its wide usage in image segmentation and related problems, its consistency has remained open. We resolve this open question, showing that the Lovász hinge is inconsistent for its desired target unless the set function is modular. Leveraging a recent embedding framework, we instead derive the target loss for which the Lovász hinge is consistent. This target, which we call the structured abstain problem, allows one to abstain on any subset of the $k$ predictions. We derive two link functions, each of which are consistent for all submodular set functions simultaneously.

cs.LG

Quantum Information Elicitation

In the classic scoring rule setting, a principal incentivizes an agent to truthfully report their probabilistic belief about some future outcome. This paper addresses the situation when this private belief, rather than a classical probability distribution, is instead a quantum mixed state. In the resulting quantum scoring rule setting, the principal chooses both a scoring function and a measurement function, and the agent responds with their reported density matrix. Several characterizations of quantum scoring rules are presented, which reveal a familiar structure based on convex analysis. Spectral scores, where the measurement function is given by the spectral decomposition of the reported density matrix, have particularly elegant structure and connect to quantum information theory. Turning to property elicitation, eigenvectors of the belief are elicitable, whereas eigenvalues and entropy have maximal elicitation complexity. The paper concludes with a discussion of other quantum information elicitation settings and connections to the literature.

cs.GT