arXiv subjects
Publications and source records attributed to Damien Challet.
We apply the knockoff procedure to factor selection in finance. By building fake but realistic factors, this procedure makes it possible to control the fraction of false discovery in a given set of factors. To show its versatility, we apply it to fund replication and to the inference of explanatory and prediction networks.
We propose a novel deep learning architecture suitable for the prediction of investor interest for a given asset in a given time frame. This architecture performs both investor clustering and modelling at the same time. We first verify its superior performance on a synthetic scenario inspired by real data and then apply it to two real-world databases, a publicly available dataset about the position of investors in Spanish stock market and proprietary data from BNP Paribas Corporate and Institutional Banking.
While wealth distribution in the world is highly skewed and heavy-tailed, human talent - as the majority of individual features - is normally distributed. In a recent computational study by Pluchino et al [Talent vs luck: The role of randomness in success and failure, Adv. Complex Syst. 21 (03-04) (2018) 1850014], it has been shown that the combined effects of both random external factors (lucky and unlucky events) and multiplicative dynamics in capital accumulation are able to clarify this apparent contradiction. We introduce here a simplified version (STvL) of the original Talent versus Luck (TvL) model, where only lucky events are present, and verify that its dynamical rules lead to the same very large wealth inequality as the original model. We also derive some analytical approximations aimed to capture the mechanism responsible for the creation of such wealth inequality from a Gaussian-distributed talent. Under these approximations, our analysis is able to reproduce quite well the results of the numerical simulations of the simplified model in special cases. On the other hand, it also shows that the complexity of the model lies in the fact that lucky events are transformed into an increase of capital with heterogeneous rates, which yields a non-trivial generalization of the role of multiplicative processes in generating wealth inequality, whose fully generic case is still not amenable to analytical computations.
We introduce a framework to infer lead-lag networks between the states of elements of complex systems, determined at different timescales. As such networks encode the causal structure of a system, infering lead-lag networks for many pairs of timescales provides a global picture of the mutual influence between timescales. We apply our method to two trader-resolved FX data sets and document strong and complex asymmetric influence of timescales on the structure of lead-lag networks. Expectedly, this asymmetry extends to trader activity: for institutional clients in our dataset, past activity on timescales longer than 3 hours is more correlated with future activity at shorter timescales than the opposite (Zumbach effect), while a reverse Zumbach effect is found for past timescales shorter than 3 hours; retail clients have a totally different, and much more intricate, structure of asymmetric timescale influence. The causality structures are clearly caused by markedly different behaviors of the two types of traders. Hence, market nanostructure, i.e., market dynamics at the individual trader level, provides an unprecedented insight into the causality structure of financial markets, which is much more complex than previously thought.
Statistical inference of the dependence between objects often relies on covariance matrices. Unless the number of features (e.g. data points) is much larger than the number of objects, covariance matrix cleaning is necessary to reduce estimation noise. We propose a method that is robust yet flexible enough to account for fine details of the structure covariance matrix. Robustness comes from using a hierarchical ansatz and dependence averaging between clusters; flexibility comes from a bootstrap procedure. This method finds several possible hierarchical structures in DNA microarray gene expression data, and leads to lower realized risk in global minimum variance portfolios than current filtering methods when the number of data points is relatively small.
We introduce a method to predict which correlation matrix coefficients are likely to change their signs in the future in the high-dimensional regime, i.e. when the number of features is larger than the number of samples per feature. The stability of correlation signs, two-by-two relationships, is found to depend on three-by-three relationships inspired by Heider social cohesion theory in this regime. We apply our method to US and Hong Kong equities historical data to illustrate how the structure of correlation matrices influences the stability of the sign of its coefficients.
We first investigate the evolution of opening and closing auctions volumes of US equities along the years. We then report dynamical properties of pre-auction periods: the indicative match price is strongly mean-reverting because the imbalance is; the final auction price reacts to a single auction order placement or cancellation in markedly different ways in the opening and closing auctions when computed conditionally on imbalance improving or worsening events; the indicative price reverts towards the mid price of the regular limit order book but is not especially bound to the spread.
We introduce a method to infer lead-lag networks of agents' actions in complex systems. These networks open the way to both microscopic and macroscopic states prediction in such systems. We apply this method to trader-resolved data in the foreign exchange market. We show that these networks are remarkably persistent, which explains why and how order flow prediction is possible from trader-resolved data. In addition, if traders' actions depend on past prices, the evolution of the average price paid by traders may also be predictable. Using random forests, we verify that the predictability of both the sign of order flow and the direction of average transaction price is strong for retail investors at an hourly time scale, which is of great relevance to brokers and order matching engines. Finally, we argue that the existence of trader lead-lag networks explains in a self-referential way why a given trader becomes active, which is in line with the fact that most trading activity has an endogenous origin.
We report statistical regularities of the opening and closing auctions of French equities, focusing on the diffusive properties of the indicative auction price. Two mechanisms are at play as the auction end time nears: the typical price change magnitude decreases, favoring underdiffusion, while the rate of these events increases, potentially leading to overdiffusion. A third mechanism, caused by the strategic behavior of traders, is needed to produce nearly diffusive prices: waiting to submit buy orders until sell orders have decreased the indicative price and vice-versa.
Using more than 6.7 billions of trades, we explore how the tick-by-tick dynamics of limit order books depends on the aggregate actions of large investment funds on a much larger (quarterly) timescale. In particular, we find that the well-established long memory of market order signs is markedly weaker when large investment funds trade either in a directional way and even weaker when their aggregate participation ratio is large. Conversely, we investigate to what respect a weaker memory of market order signs predicts that an asset is being actively traded by large funds. Theoretical arguments suggest two simple mechanisms that contribute to the observed effect: a larger number of active meta-orders and a modification of the distribution of size of meta-orders. Empirical evidence suggests that the number of active meta-orders is the most important contributor to the loss of market order sign memory.
We show that univariate and symmetric multivariate Hawkes processes are only weakly causal: the true log-likelihoods of real and reversed event time vectors are almost equal, thus parameter estimation via maximum likelihood only weakly depends on the direction of the arrow of time. In ideal (synthetic) conditions, tests of goodness of parametric fit unambiguously reject backward event times, which implies that inferring kernels from time-symmetric quantities, such as the autocovariance of the event rate, only rarely produce statistically significant fits. Finally, we find that fitting financial data with many-parameter kernels may yield significant fits for both arrows of time for the same event time vector, sometimes favouring the backward time direction. This goes to show that a significant fit of Hawkes processes to real data with flexible kernels does not imply a definite arrow of time unless one tests it.
The average portfolio structure of institutional investors is shown to have properties which account for transaction costs in an optimal way. This implies that financial institutions unknowingly display collective rationality, or Wisdom of the Crowd. Individual deviations from the rational benchmark are ample, which illustrates that system-wide rationality does not need nearly rational individuals. Finally we discuss the importance of accounting for constraints when assessing the presence of Wisdom of the Crowd.
The total duration of drawdowns is shown to provide a moment-free, unbiased, efficient and robust estimator of Sharpe ratios both for Gaussian and heavy-tailed price returns. We then use this quantity to infer an analytic expression of the bias of moment-based Sharpe ratio estimators as a function of the return distribution tail exponent. The heterogeneity of tail exponents at any given time among assets implies that our new method yields significantly different asset rankings than those of moment-based methods, especially in periods large volatility. This is fully confirmed by using 20 years of historical data on 3449 liquid US equities.
Common asset holding by financial institutions, namely portfolio overlap, is nowadays regarded as an important channel for financial contagion with the potential to trigger fire sales and thus severe losses at the systemic level. In this paper we propose a method to assess the statistical significance of the overlap between pairs of heterogeneously diversified portfolios, which then allows us to build a validated network of financial institutions where links indicate potential contagion channels due to realized portfolio overlaps. The method is implemented on a historical database of institutional holdings ranging from 1999 to the end of 2013, but can be in general applied to any bipartite network where the presence of similar sets of neighbors is of interest. We find that the proportion of validated network links (i.e., of statistically significant overlaps) increased steadily before the 2007-2008 global financial crisis and reached a maximum when the crisis occurred. We argue that the nature of this measure implies that systemic risk from fire sales liquidation was maximal at that time. After a sharp drop in 2008, systemic risk resumed its growth in 2009, with a notable acceleration in 2013, reaching levels not seen since 2007. We finally show that market trends tend to be amplified in the portfolios identified by the algorithm, such that it is possible to have an informative signal about financial institutions that are about to suffer (enjoy) the most significant losses (gains).
We first review empirical evidence that asset prices have had episodes of large fluctuations and been inefficient for at least 200 years. We briefly review recent theoretical results as well as the neurological basis of trend following and finally argue that these asset price properties can be attributed to two fundamental mechanisms that have not changed for many centuries: an innate preference for trend following and the collective tendency to exploit as much as possible detectable price arbitrage, which leads to destabilizing feedback loops.
This contribution discusses in what respect Econophysics may be able to contribute to the rebuilding of economics theory. It focuses on aggregation, individual vs collective learning and functional wisdom of the crowds.
We run experimental asset markets to investigate the emergence of excess trading and the occurrence of synchronised trading activity leading to crashes in the artificial markets. The market environment favours early investment in the risky asset and no posterior trading, i.e. a buy-and-hold strategy with a most probable return of over 600%. We observe that subjects trade too much, and due to the market impact that we explicitly implement, this is detrimental to their wealth. The asset market experiment was followed by risk aversion measurement. We find that preference for risk systematically leads to higher activity rates (and lower final wealth). We also measure subjects' expectations of future prices and find that their actions are fully consistent with their expectations. In particular, trading subjects try to beat the market and make profits by playing a buy low, sell high strategy. Finally, we have not detected any major market crash driven by collective panic modes, but rather a weaker but significant tendency of traders to synchronise their entry and exit points in the market.
A new family of nonparametric statistics, the r-statistics, is introduced. It consists of counting the number of records of the cumulative sum of the sample. The single-sample r-statistic is almost as powerful as Student's t-statistic for Gaussian and uniformly distributed variables, and more powerful than the sign and Wilcoxon signed-rank statistics as long as the data are not too heavy-tailed. Three two-sample parametric r-statistics are proposed, one with a higher specificity but a smaller sensitivity than Mann-Whitney U-test and the other one a higher sensitivity but a smaller specificity. A nonparametric two-sample r-statistic is introduced, whose power is very close to that of Welch statistic for Gaussian or uniformly distributed variables.