arXiv subjects

J. Doyne Farmer

Publications and source records attributed to J. Doyne Farmer.

At least 73 records · Page 4Linked to original sources

arXiv2008

The non-random walk of stock prices: The long-term correlation between signs and sizes

We investigate the random walk of prices by developing a simple model relating the properties of the signs and absolute values of individual price changes to the diffusion rate (volatility) of prices at longer time scales. We show that this benchmark model is unable to reproduce the diffusion properties of real prices. Specifically, we find that for one hour intervals this model consistently over-predicts the volatility of real price series by about 70%, and that this effect becomes stronger as the length of the intervals increases. By selectively shuffling some components of the data while preserving others we are able to show that this discrepancy is caused by a subtle but long-range non-contemporaneous correlation between the signs and sizes of individual returns. We conjecture that this is related to the long-memory of transaction signs and the need to enforce market efficiency.

q-fin.ST↗

arXiv2008

The virtues and vices of equilibrium and the future of financial economics

The use of equilibrium models in economics springs from the desire for parsimonious models of economic phenomena that take human reasoning into account. This approach has been the cornerstone of modern economic theory. We explain why this is so, extolling the virtues of equilibrium theory; then we present a critique and describe why this approach is inherently limited, and why economics needs to move in new directions if it is to continue to make progress. We stress that this shouldn't be a question of dogma, but should be resolved empirically. There are situations where equilibrium models provide useful predictions and there are situations where they can never provide useful predictions. There are also many situations where the jury is still out, i.e., where so far they fail to provide a good description of the world, but where proper extensions might change this. Our goal is to convince the skeptics that equilibrium models can be useful, but also to make traditional economists more aware of the limitations of equilibrium models. We sketch some alternative approaches and discuss why they should play an important role in future research in economics.

q-fin.GN↗

arXiv2007

The Physics of Information

We review of the interface between (theoretical) physics and information for non-experts. The origin of information as related to the notion of entropy is described, first in the context of thermodynamics then in the context of statistical mechanics. A close examination of the foundations of statistical mechanics and the need to reconcile the probabilistic and deterministic views of the world leads us to a discussion of chaotic dynamics, where information plays a crucial role in quantifying predictability. We then discuss a variety of fundamental issues that emerge in defining information and how one must exercise care in discussing concepts such as order, disorder, and incomplete knowledge. We also discuss an alternative form of entropy and its possible relevance for nonequilibrium thermodynamics. In the final part of the paper we discuss how quantum mechanics gives rise to the very different concept of quantum information. Entirely new possibilities for information storage and computation are possible due to the massive parallel processing inherent in quantum mechanics. We also point out how entropy can be extended to apply to quantum mechanics to provide a useful measurement for quantum entanglement. Finally we make a small excursion to the interface betweeen quantum theory and general relativity, where one is confronted with an "ultimate information paradox" posed by the physics of Black Holes. In this review we have limited ourselves; not all relevant topics that touch on physics and information could be covered.

physics.class-ph↗

arXiv2007

Correlations and clustering in the trading of members of the London Stock Exchange

This paper analyzes correlations in patterns of trading of different members of the London Stock Exchange. The collection of strategies associated with a member institution is defined by the sequence of signs of net volume traded by that institution in hour intervals. Using several methods we show that there are significant and persistent correlations between institutions. In addition, the correlations are structured into correlated and anti-correlated groups. Clustering techniques using the correlations as a distance metric reveal a meaningful clustering structure with two groups of institutions trading in opposite directions.

q-fin.ST↗

arXiv2007

An empirical behavioral model of liquidity and volatility

We develop a behavioral model for liquidity and volatility based on empirical regularities in trading order flow in the London Stock Exchange. This can be viewed as a very simple agent based model in which all components of the model are validated against real data. Our empirical studies of order flow uncover several interesting regularities in the way trading orders are placed and cancelled. The resulting simple model of order flow is used to simulate price formation under a continuous double auction, and the statistical properties of the resulting simulated sequence of prices are compared to those of real data. The model is constructed using one stock (AZN) and tested on 24 other stocks. For low volatility, small tick size stocks (called Group I) the predictions are very good, but for stocks outside Group I they are not good. For Group I, the model predicts the correct magnitude and functional form of the distribution of the volatility and the bid-ask spread, without adjusting any parameters based on prices. This suggests that at least for Group I stocks, the volatility and heavy tails of prices are related to market microstructure effects, and supports the hypothesis that, at least on short time scales, the large fluctuations of absolute returns are well described by a power law with an exponent that varies from stock to stock.

q-fin.ST↗

arXiv2007

A simple evolutionary game with feedback between perception and reality

We study an evolutionary game of chance in which the probabilities for different outcomes (e.g., heads or tails) depend on the amount wagered on those outcomes. The game is perhaps the simplest possible probabilistic game in which perception affects reality. By varying the `reality map', which relates the amount wagered to the probability of the outcome, it is possible to move continuously from a purely objective game in which probabilities have no dependence on wagers, to a purely subjective game in which probabilities equal the amount wagered. The reality map can reflect self-reinforcing strategies or self-defeating strategies. In self-reinforcing games, rational players can achieve increasing returns and manipulate the outcome probabilities to their advantage; consequently, an early lead in the game, whether acquired by chance or by strategy, typically gives a persistent advantage. We investigate the game both in and out of equilibrium and with and without rational players. We introduce a method of measuring the inefficiency of the game and show that in the large time limit the inefficiency decreases slowly in its approach to equilibrium as a power law with an exponent between zero and one, depending on the subjectivity of the game.

physics.soc-ph↗

arXiv2006

Mechanical vs. informational components of price impact

We study the problem of what causes prices to change. We define the mechanical impact of a trading order as the change in future prices in the absence of any future changes in decision making, and its it informational impact as the remainder of the total impact once mechanical impact is removed. We introduce a method of measuring mechanical impact and apply it to order book data from the London Stock Exchange. The average mechanical impact of a market order decays to zero as a function of time, at an asymptotic rate that is consistent with a power law with an exponent of roughly 1.7. In contrast the average informational impact builds to approach a constant value. Initially the impact is entirely mechanical, and is about half as big as the asymptotic informational impact. The size of the informational impact is positively correlated to mechanical impact. For cases where the mechanical impact is zero for all times, we find that the informational impact is negative, i.e. buy market orders that have no mechanical impact at all generate strong negative price responses.

physics.soc-ph↗

arXiv2006

Market efficiency and the long-memory of supply and demand: Is price impact variable and permanent or fixed and temporary?

In this comment we discuss the problem of reconciling the linear efficiency of price returns with the long-memory of supply and demand. We present new evidence that shows that efficiency is maintained by a liquidity imbalance that co-moves with the imbalance of buyer vs. seller initiated transactions. For example, during a period where there is an excess of buyer initiated transactions, there is also more liquidity for buy orders than sell orders, so that buy orders generate smaller and less frequent price responses than sell orders. At the moment a buy order is placed the transaction sign imbalance tends to dominate, generating a price impact. However, the liquidity imbalance rapidly increases with time, so that after a small number of time steps it cancels all the inefficiency caused by the transaction sign imbalance, bounding the price impact. While the view presented by Bouchaud et al. of a fixed and temporary bare price impact is self-consistent and formally correct, we argue that viewing this in terms of a variable but permanent price impact provides a simpler and more natural view. This is in the spirit of the original conjecture of Lillo and Farmer, but generalized to allow for finite time lags in the build up of the liquidity imbalance after a transaction. We discuss the possible strategic motivations that give rise to the liquidity imbalance and offer an alternative hypothesis. We also present some results that call into question the statistical significance of large swings in expected price impact at long times.

physics.soc-ph↗

arXiv2005

An empirical behavioral model of price formation

Although behavioral economics has demonstrated that there are many situations where rational choice is a poor empirical model, it has so far failed to provide quantitative models of economic problems such as price formation. We make a step in this direction by developing empirical models that capture behavioral regularities in trading order placement and cancellation using data from the London Stock Exchange. For order placement we show that the probability of placing an order at a given price is well approximated by a Student distribution with less than two degrees of freedom, centered on the best quoted price. This result is surprising because it implies that trading order placement is symmetric, independent of the bid-ask spread, and the same for buying and selling. We also develop a crude but simple cancellation model that depends on the position of an order relative to the best price and the imbalance between buying and selling orders in the limit order book. These results are combined to construct a stochastic representative agent model, in which the orders and cancellations are described in terms of conditional probability distributions. This model is used to simulate price formation and the results are compared to real data from the London Stock Exchange. Without adjusting any parameters based on price data, the model produces good predictions for the magnitude and functional form of the distribution of returns and the bid-ask spread.

physics.soc-ph↗

arXiv2005

There's more to volatility than volume

It is widely believed that fluctuations in transaction volume, as reflected in the number of transactions and to a lesser extent their size, are the main cause of clustered volatility. Under this view bursts of rapid or slow price diffusion reflect bursts of frequent or less frequent trading, which cause both clustered volatility and heavy tails in price returns. We investigate this hypothesis using tick by tick data from the New York and London Stock Exchanges and show that only a small fraction of volatility fluctuations are explained in this manner. Clustered volatility is still very strong even if price changes are recorded on intervals in which the total transaction volume or number of transactions is held constant. In addition the distribution of price returns conditioned on volume or transaction frequency being held constant is similar to that in real time, making it clear that neither of these are the principal cause of heavy tails in price returns. We analyze recent results of Ane and Geman (2000) and Gabaix et al. (2003), and discuss the reasons why their conclusions differ from ours. Based on a cross-sectional analysis we show that the long-memory of volatility is dominated by factors other than transaction frequency or total trading volume.

physics.soc-ph↗

arXiv2005

Economics: The next physical science?

We review an emerging body of work by physicists addressing questions of economic organization and function. We suggest that, beyond simply employing models familiar from physics to economic observables, remarkable regularities in economic data may suggest parts of social order that can usefully be incorporated into, and in turn can broaden, the conceptual structure of physics.

physics.soc-ph↗

arXiv2005

A theory for long-memory in supply and demand

Recent empirical studies have demonstrated long-memory in the signs of orders to buy or sell in financial markets [2, 19]. We show how this can be caused by delays in market clearing. Under the common practice of order splitting, large orders are broken up into pieces and executed incrementally. If the size of such large orders is power law distributed, this gives rise to power law decaying autocorrelations in the signs of executed orders. More specifically, we show that if the cumulative distribution of large orders of volume v is proportional to v to the power -alpha and the size of executed orders is constant, the autocorrelation of order signs as a function of the lag tau is asymptotically proportional to tau to the power -(alpha - 1). This is a long-memory process when alpha < 2. With a few caveats, this gives a good match to the data. A version of the model also shows long-memory fluctuations in order execution rates, which may be relevant for explaining the long-memory of price diffusion rates.

cond-mat.other↗

arXiv2004

The long memory of the efficient market

For the London Stock Exchange we demonstrate that the signs of orders obey a long-memory process. The autocorrelation function decays roughly as $τ^{-α}$ with $α\approx 0.6$, corresponding to a Hurst exponent $H \approx 0.7$. This implies that the signs of future orders are quite predictable from the signs of past orders; all else being equal, this would suggest a very strong market inefficiency. We demonstrate, however, that fluctuations in order signs are compensated for by anti-correlated fluctuations in transaction size and liquidity, which are also long-memory processes. This tends to make the returns whiter. We show that some institutions display long-range memory and others don't.

cond-mat.other↗

arXiv2004

What really causes large price changes?

We study the cause of large fluctuations in prices in the London Stock Exchange. This is done at the microscopic level of individual events, where an event is the placement or cancellation of an order to buy or sell. We show that price fluctuations caused by individual market orders are essentially independent of the volume of orders. Instead, large price fluctuations are driven by liquidity fluctuations, variations in the market's ability to absorb new orders. Even for the most liquid stocks there can be substantial gaps in the order book, corresponding to a block of adjacent price levels containing no quotes. When such a gap exists next to the best price, a new order can remove the best quote, triggering a large midpoint price change. Thus, the distribution of large price changes merely reflects the distribution of gaps in the limit order book. This is a finite size effect, caused by the granularity of order flow: In a market where participants placed many small orders uniformly across prices, such large price fluctuations would not happen. We show that this explains price fluctuations on longer timescales. In addition, we present results suggesting that the risk profile varies from stock to stock, and is not universal: lightly traded stocks tend to have more extreme risks.

cond-mat.other↗

arXiv2004

The Predictive Power of Zero Intelligence in Financial Markets

Standard models in economics stress the role of intelligent agents who maximize utility. However, there may be situations where, for some purposes, constraints imposed by market institutions dominate intelligent agent behavior. We use data from the London Stock Exchange to test a simple model in which zero intelligence agents place orders to trade at random. The model treats the statistical mechanics of order placement, price formation, and the accumulation of revealed supply and demand within the context of the continuous double auction, and yields simple laws relating order arrival rates to statistical properties of the market. We test the validity of these laws in explaining the cross-sectional variation for eleven stocks. The model explains 96% of the variance of the bid-ask spread, and 76% of the variance of the price diffusion rate, with only one free parameter. We also study the market impact function, describing the response of quoted prices to the arrival of new orders. The non-dimensional coordinates dictated by the model approximately collapse data from different stocks onto a single curve. This work is important from a practical point of view because it demonstrates the existence of simple laws relating prices to order flows, and in a broader context, because it suggests that there are circumstances where institutions are more important than strategic considerations.

cond-mat.stat-mech↗

arXiv2004

On the origin of power law tails in price fluctuations

In a recent Nature paper, Gabaix et al. \cite{Gabaix03} presented a theory to explain the power law tail of price fluctuations. The main points of their theory are that volume fluctuations, which have a power law tail with exponent roughly -1.5, are modulated by the average market impact function, which describes the response of prices to transactions. They argue that the average market impact function follows a square root law, which gives power law tails for prices with exponent roughly -3. We demonstrate that the long-memory nature of order flow invalidates their statistical analysis of market impact, and present a more careful analysis that properly takes this into account. This makes it clear that the functional form of the average market impact function varies from market to market, and in some cases from stock to stock. In fact, for both the London Stock Exchange and the New York Stock Exchange the average market impact function grows much slower than a square root law; this implies that the exponent for price fluctuations predicted by modulations of volume fluctuations is much too big. We find that for LSE stocks the distribution of transaction volumes does not even have a power law tail. This makes it clear that volume fluctuations do not determine the power law tail of price returns.

cond-mat.stat-mech↗

arXiv2002

A quantitative model of trading and price formation in financial markets

We use standard physics techniques to model trading and price formation in a market under the assumption that order arrival and cancellations are Poisson random processes. This model makes testable predictions for the most basic properties of a market, such as the diffusion rate of prices, which is the standard measure of financial risk, and the spread and price impact functions, which are the main determinants of transaction cost. Guided by dimensional analysis, simulation, and mean field theory, we find scaling relations in terms of order flow rates. We show that even under completely random order flow the need to store supply and demand to facilitate trading induces anomalous diffusion and temporal structure in prices.

cond-mat.stat-mech↗

arXiv2002

Statistical theory of the continuous double auction

Most modern financial markets use a continuous double auction mechanism to store and match orders and facilitate trading. In this paper we develop a microscopic dynamical statistical model for the continuous double auction under the assumption of IID random order flow, and analyze it using simulation, dimensional analysis, and theoretical tools based on mean field approximations. The model makes testable predictions for basic properties of markets, such as price volatility, the depth of stored supply and demand vs. price, the bid-ask spread, the price impact function, and the time and probability of filling orders. These predictions are based on properties of order flow and the limit order book, such as share volume of market and limit orders, cancellations, typical order size, and tick size. Because these quantities can all be measured directly there are no free parameters. We show that the order size, which can be cast as a nondimensional granularity parameter, is in most cases a more significant determinant of market behavior than tick size. We also provide an explanation for the observed highly concave nature of the price impact function. On a broader level, this work suggests how stochastic models based on zero-intelligence agents may be useful to probe the structure of market institutions. Like the model of perfect rationality, a stochastic-zero intelligence model can be used to make strong predictions based on a compact set of assumptions, even if these assumptions are not fully believable.

cond-mat.stat-mech↗