Searcharxiv⌕ Search

arXiv subjects

Olli Järviniemi

Publications and source records attributed to Olli Järviniemi.

14 recordsLinked to original sources

Propensity Inference: Environmental Contributors to LLM Behaviour

Motivated by loss of control risks from misaligned AI systems, we develop and apply methods for measuring language models' propensity for unsanctioned behaviour. We contribute three methodological improvements: analysing effects of changes to environmental factors on behaviour, quantifying effect sizes via Bayesian generalised linear models, and taking explicit measures against circular analysis. We apply the methodology to measure the effects of 12 environmental factors (6 strategic in nature, 6 non-strategic) and thus the extent to which behaviour is explained by strategic aspects of the environment, a question relevant to risks from misalignment. Across 23 language models and 11 evaluation environments, we find approximately equal contributions from strategic and non-strategic factors for explaining behaviour, do not find strategic factors becoming more or less influential as capabilities improve, and find some evidence for a trend for increased sensitivity to goal conflicts. Finally, we highlight a key direction for future propensity research: the development of theoretical frameworks and cognitive models of AI decision-making into empirically testable forms.

cs.AI↗

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI

We introduce FrontierMath, a benchmark of hundreds of original, exceptionally challenging mathematics problems crafted and vetted by expert mathematicians. The questions cover most major branches of modern mathematics -- from computationally intensive problems in number theory and real analysis to abstract questions in algebraic geometry and category theory. Solving a typical problem requires multiple hours of effort from a researcher in the relevant branch of mathematics, and for the upper end questions, multiple days. FrontierMath uses new, unpublished problems and automated verification to reliably evaluate models while minimizing risk of data contamination. Current state-of-the-art AI models solve under 2% of problems, revealing a vast gap between AI capabilities and the prowess of the mathematical community. As AI systems advance toward expert-level mathematical abilities, FrontierMath offers a rigorous testbed that quantifies their progress.

cs.AI↗

Subversion via Focal Points: Investigating Collusion in LLM Monitoring

We evaluate language models' ability to subvert monitoring protocols via collusion. More specifically, we have two instances of a model design prompts for a policy (P) and a monitor (M) in a programming task setting. The models collaboratively aim for M to classify all backdoored programs in an auditing dataset as harmful, but nevertheless classify a backdoored program produced by P as harmless. The models are isolated from each other, requiring them to independently arrive at compatible subversion strategies. We find that while Claude 3.7 Sonnet has low success rate due to poor convergence, it sometimes successfully colludes on non-obvious signals.

cs.CL↗

Uncovering Deceptive Tendencies in Language Models: A Simulated Company AI Assistant

We study the tendency of AI systems to deceive by constructing a realistic simulation setting of a company AI assistant. The simulated company employees provide tasks for the assistant to complete, these tasks spanning writing assistance, information retrieval and programming. We then introduce situations where the model might be inclined to behave deceptively, while taking care to not instruct or otherwise pressure the model to do so. Across different scenarios, we find that Claude 3 Opus 1) complies with a task of mass-generating comments to influence public perception of the company, later deceiving humans about it having done so, 2) lies to auditors when asked questions, and 3) strategically pretends to be less capable than it is during capability evaluations. Our work demonstrates that even models trained to be helpful, harmless and honest sometimes behave deceptively in realistic scenarios, without notable external pressure to do so.

cs.CL↗

Gaussian almost primes in almost all narrow sectors

We show that almost all sectors of the disc $\{z \in \mathbb{C}: |z|^2\leq X\}$ of area $(\log X)^{15.1}$ contain products of exactly two Gaussian primes, and that almost all sectors of area $(\log X)^{1 + \varepsilon}$ contain products of exactly three Gaussian primes. The argument is based on mean value theorems, large value estimates and pointwise bounds for Hecke character sums.

math.NT↗

Composite values of shifted exponentials

A well-known open problem asks to show that $2^n+5$ is composite for almost all values of $n$. This was proposed by Gil Kalai as a possible Polymath project, and was posed originally by Christopher Hooley. We show that, assuming GRH and a form of the pair correlation conjecture, the answer to this problem is affirmative. We in fact do not need the full power of the pair correlation conjecture, and it suffices to assume a generalization of the Brun-Titchmarsh inequality for the Chebotarev density theorem that is implied by it. Our methods apply to any shifted exponential sequence of the form $a^n-b$ and show that, under the same assumptions, such numbers are $k$-almost primes for a density $0$ of natural numbers $n$. Furthermore, we show that $a^p-b$ is composite for almost all primes $p$ whenever $(a, b) \neq (2, 1)$.

math.NT↗

On large differences between consecutive primes

We show that $$\sum_{\substack{p_n \in [x, 2x] \\ p_{n+1} - p_n \ge x^{1/2}}} (p_{n+1} - p_n) \ll x^{0.57+ε}$$ and $$\sum_{\substack{p_n \in [x, 2x] \\ p_{n+1} - p_n \ge x^{0.45}}} (p_{n+1} - p_n) \ll x^{0.63+ε},$$ where $p_n$ is the $n$th prime number. The proof combines Heath-Brown's recent work with Harman's sieve, improving and extending his results. We give applications of the results to prime-representing functions, binary digits of primes and approximation of reals by multiplicative functions.

math.NT↗

Unified treatment of Artin-type problems

Since Hooley's seminal 1967 resolution of Artin's primitive root conjecture under the Generalized Riemann Hypothesis, numerous variations of the conjecture have been considered. We present a framework generalizing and unifying many previously considered variants, and prove results in this full generality (under GRH).

math.NT↗

Unified treatment of Artin-type problems II

This work concerns Artin's Conjecture on primitive roots and related problems for number fields. Let $K$ be a number field and let $W_1$ to $W_n$ be finitely generated subgroups of $K^\times$ of positive rank. We consider the index map, which maps a prime $\mathfrak p$ of $K$ to the $n$-tuple of the indices of $(W_i \bmod \mathfrak p)$. Conditionally under GRH, any preimage under the index map admits a density, and the aim of this work is describing it. For example, we express the density as a limit in various ways. We study in particular the preimages of sets of $n$-tuples that are defined by prescribing valuations for their entries. Under some mild assumptions we can express the density as a multiple of a (suitably defined) Artin-type constant.

math.NT↗

Orders of algebraic numbers in finite fields

For an algebraic number $α$ we consider the orders of the reductions of $α$ in finite fields. In the case where $α$ is an integer, it is known by the work on Artin's primitive root conjecture that the order is "almost always almost maximal" assuming the generalized Riemann hypothesis, but unconditional results remain modest. We consider higher degree variants under GRH. First, we modify an argument of Roskam to settle the case where $α$ and the reduction have degree two. Second, we give a positive lower density result when $α$ is of degree three and the reduction is of degree two. Third, we give higher rank results in situations where the reductions are of degree two, three, four or six. As an application we give an almost equidistribution result for linear recurrences modulo primes. Finally, we present a general result conditional to GRH and a hypothesis on smooth values of polynomials at prime arguments.

math.NT↗

Positive lower density for prime divisors of generic linear recurrences

Let $d \ge 3$ be an integer and let $P \in \mathbb{Z}[x]$ be a polynomial of degree $d$ whose Galois group is $S_d$. Let $(a_n)$ be a linearly recuresive sequence of integers which has $P$ as its characteristic polynomial. We prove, under the generalized Riemann hypothesis, that the lower density of the set of primes which divide at least one element of the sequence $(a_n)$ is positive.

math.NT↗

Simultaneous insolvability of exponential congruences

We determine a necessary and sufficient condition for the infinitude of primes $p$ such that none of the equations $a_i^x \equiv b_i \pmod{p}, 1 \le i \le n,$ are solvable. We control the insolvability of $a^x \equiv b \pmod{p}$ by power residues for multiplicatively independent $a$ and $b$, and by divisibilities and, most importantly, parities of orders in multiplicatively dependent cases. We also consider a more general problem concerning divisibilities of orders. The problems are motivated by Artin's primitive root conjecture and its variants.

math.NT↗

Equality of orders of a set of integers modulo a prime

For finitely generated subgroups $W_1, \ldots , W_t$ of $\mathbb{Q}^{\times}$, integers $k_1, \ldots , k_t$, a Galois extension $F$ of $\mathbb{Q}$ and a union of conjugacy classes $C \subset \text{Gal}(F/\mathbb{Q})$, we develop methods for determining if there exists infinitely many primes $p$ such that the index of the reduction of $W_i$ modulo $p$ divides $k_i$ and such that the Artin symbol of $p$ on $F$ is contained in $C$. The results are a multivariable generalization of H.W. Lenstra's work. As an application, we determine all integers $a_1, \ldots , a_n$ such that $\text{ord}_p(a_1) = \ldots = \text{ord}_p(a_n)$ for infinitely many primes $p$. We also discuss the set of those $p$ for which $\text{ord}_p(a_1) > \ldots > \text{ord}_p(a_n)$. The obtained results are conditional to a generalization of the Riemann hypothesis.

math.NT↗

On the Common Prime Divisors of Polynomials

The prime divisors of a polynomial $P$ with integer coefficients are those primes $p$ for which $P(x) \equiv 0 \pmod{p}$ is solvable. Our main result is that the common prime divisors of any several polynomials are exactly the prime divisors of some single polynomial. By combining this result with a theorem of Ax we get that for any system $F$ of multivariate polynomial equations with integer coefficients, the set of primes $p$ for which $F$ is solvable modulo $p$ is the set of prime divisors of some univariate polynomial. In addition, we prove results on the densities of the prime divisors of polynomials. The article serves as a light introduction to algebraic number theory and Galois theory.

math.NT↗