Searcharxiv⌕ Search

arXiv subjects

D. Sornette

Publications and source records attributed to D. Sornette.

At least 91 records · Page 5Linked to original sources

Limits of Declustering Methods for Disentangling Exogenous from Endogenous Events in Time Series with Foreshocks, Main shocks and Aftershocks

Many time series in natural and social sciences can be seen as resulting from an interplay between exogenous influences and an endogenous organization. We use a simple (ETAS) model of events occurring sequentially, in which future events are influenced (partially triggered) by past events to ask the question of how well can one disentangle the exogenous events from the endogenous ones. We apply both model-dependant and model-independent stochastic declustering methods to reconstruct the tree of ancestry and estimate key parameters. In contrast with previously reported positive results, we have to conclude that declustered catalogs are rather unreliable for the synthetic catalogs that we have investigated, which contains of the order of thousands of events, typical of realistic applications. The estimated rates of exogenous events suffer from large errors. The key branching ratio $n$, quantifying the fraction of events that have been triggered by previous events, is also badly estimated in general from declustered catalogs. We find however that the errors tend to be smaller and perhaps acceptable in some cases for small triggering efficiency and branching ratios. The high level of randomness together with the very long memory makes the stochastic reconstruction of trees of ancestry and the estimation of the key parameters perhaps intrinsically unreliable for long memory processes. For shorter memories (larger "bare" Omori exponent), the results improve significantly.

physics.data-an↗

Market bubbles and crashes

Episodes of market crashes have fascinated economists for centuries. Although many academics, practitioners and policy makers have studied questions related to collapsing asset price bubbles, there is little consensus yet about their causes and effects. This review and essay evaluates some of the hypotheses offered to explain the market crashes that often follow asset price bubbles. Starting from historical accounts and syntheses of past bubbles and crashes, we put the problem in perspective with respect to the development of the efficient market hypothesis. We then present the models based on heterogeneous agents and the limits to arbitrage that prevent rational agents from bursting bubbles before they inflate. Then, we explore another set of explanations of why rational traders would be led to actually profit from and surf on bubbles, by anticipating the behavior of noise traders or by realizing the difficulties in synchronizing their actions. We then end by discussing a complex system approach of social imitation leading to collective market regimes like herding and the phenomenon of bifurcation (or phase transition) that rationalize what crash can occur in unstable market regimes. The key insight is that diagnosing bubbles may be feasible when taking into account the positive feedback mechanisms that give rise to transient "super-exponential" price growth, the bubbles.

q-fin.RM↗

Trust! Why it Has Been Lost and How to Regain It

This essay suggests that a proper assessment of the presently unfolding financial crisis, and its cure, requires going back at least to the late 1990s, accounting for the cumulative effect of the ITC, real-estate and financial derivative bubbles. We focus on the deep loss of trust, not only in Wall Street, but more importantly in Main Street, and how to recover it on the short and long terms. A multi-disciplinary approach is needed to deal with the nonlinear complex systems of the present world, in order to develop a culture of fairness, and of upside opportunities associated with a risky world.

q-fin.GN↗

Theory of Zipf's Law and of General Power Law Distributions with Gibrat's law of Proportional Growth

We summarize a book under publication with his title written by the three present authors, on the theory of Zipf's law, and more generally of power laws, driven by the mechanism of proportional growth. The preprint is available upon request from the authors. For clarity, consistence of language and conciseness, we discuss the origin and conditions of the validity of Zipf's law using the terminology of firms' asset values. We use firms at the entities whose size distributions are to be explained. It should be noted, however, that most of the relations discussed in this book, especially the intimate connection between Zipf's and Gilbrat's laws, underlie Zipf's law in diverse scientific areas. The same models and variations thereof can be straightforwardly applied to any of the other domains of application.

q-fin.GN↗

Interdisciplinarity in Socio-economics, mathematical analysis and predictability of complex systems

In this essay, I attempt to provide supporting evidence as well as some balance for the thesis on `Transforming socio-economics with a new epistemology' presented by Hollingworth and Mueller (2008). First, I review a personal highlight of my own scientific path that illustrates the power of interdisciplinarity as well as unity of the mathematical description of natural and social processes. I also argue against the claim that complex systems are in general `not susceptible to mathematical analysis, but must be understood by letting them evolve over time or with simulation analysis'. Moreover, I present evidence of the limits of the claim that scientists working within Science II do not make predictions about the future because it is too complex. I stress the potentials for a third `Quantum Science' and its associated conceptual and philosophical revolutions, and finally point out some limits of the `new' theory of networks.

physics.soc-ph↗

The 2006-2008 Oil Bubble and Beyond

We present an analysis of oil prices in US$ and in other major currencies that diagnoses unsustainable faster-than-exponential behavior. This supports the hypothesis that the recent oil price run-up has been amplified by speculative behavior of the type found during a bubble-like expansion. We also attempt to unravel the information hidden in the oil supply-demand data reported by two leading agencies, the US Energy Information Administration (EIA) and the International Energy Agency (IEA). We suggest that the found increasing discrepancy between the EIA and IEA figures provides a measure of the estimation errors. Rather than a clear transition to a supply restricted regime, we interpret the discrepancy between the IEA and EIA as a signature of uncertainty, and there is no better fuel than uncertainty to promote speculation!

q-fin.GN↗

Empirical Tests of Zipf's law Mechanism In Open Source Linux Distribution

The evolution of open source software projects in Linux distributions offers a remarkable example of a growing complex self-organizing adaptive system, exhibiting Zipf's law over four full decades. We present three tests of the usually assumed ingredients of stochastic growth models that have been previously conjectured to be at the origin of Zipf's law: (i) the growth observed between successive releases of the number of in-directed links of packages obeys Gibrat's law of proportional growth; (ii) the average growth increment of the number of in-directed links of packages over a time interval $Δt$ is proportional to $Δt$, while its standard deviation is proportional to $\sqrt{Δt}$; (iii) the distribution of the number of in-directed links of new packages appearing in evolving versions of Debian Linux distributions has a tail thinner than Zipf's law, with an exponent which converges to the Zipf's law value 1 as the time $Δt$ between releases increases.

physics.data-an↗

Anomalous Returns in a Neural Network Equity-Ranking Predictor

Using an artificial neural network (ANN), a fixed universe of approximately 1500 equities from the Value Line index are rank-ordered by their predicted price changes over the next quarter. Inputs to the network consist only of the ten prior quarterly percentage changes in price and in earnings for each equity (by quarter, not accumulated), converted to a relative rank scaled around zero. Thirty simulated portfolios are constructed respectively of the 10, 20,..., and 100 top ranking equities (long portfolios), the 10, 20,..., 100 bottom ranking equities (short portfolios) and their hedged sets (long-short portfolios). In a 29-quarter simulation from the end of the third quarter of 1994 through the fourth quarter of 2001 that duplicates real-world trading of the same method employed during 2002, all portfolios are held fixed for one quarter. Results are compared to the S&P 500, the Value Line universe itself, trading the universe of equities using the proprietary ``Value Line Ranking System'' (to which this method is in some ways similar), and to a Martingale method of ranking the same equities. The cumulative returns generated by the network predictor significantly exceed those generated by the S&P 500, the overall universe, the Martingale and Value Line prediction methods and are not eroded by trading costs. The ANN shows significantly positive Jensen's alpha, i.e., anomalous risk-adjusted expected return. A time series of its global performance shows a clear antipersistence. However, its performance is significantly better than a simple one-step Martingale predictor, than the Value Line system itself and than a simple buy and hold strategy, even when transaction costs are accounted for.

q-fin.GN↗

Characterization of the tail of the distribution of earthquake magnitudes by combining the GEV and GPD descriptions of Extreme Value Theory

We present a generic and powerful approach to study the statistics of extreme phenomena (meteorology, finance, biology...) that we apply to the statistical estimation of the tail of the distribution of earthquake sizes. The chief innovation is to combine the two main limit theorems of Extreme Value Theory (EVT) that allow us to derive the distribution of T-maxima (maximum magnitude occurring in sequential time intervals of duration T) for arbitrary T. We propose a method for the estimation of the unknown parameters involved in the two limit theorems corresponding to the Generalized Extreme Value distribution (GEV) and to the Generalized Pareto Distribution (GPD). We establish the direct relations between the parameters of these distributions, which permit to evaluate the distribution of the T-maxima for arbitrary T. The duality between the GEV and GPD provides a new way to check the consistency of the estimation of the tail characteristics of the distribution of earthquake magnitudes for earthquake occurring over arbitrary time interval. We develop several procedures and check points to decrease the scatter of the estimates and to verify their consistency. We test our full procedure on the global Harvard catalog (1977-2006) and on the Fennoscandia catalog (1900-2005). For the global catalog, we obtain the following estimates: Mmax = 9.53 +- 0.52; quantile(0.97)==9.21 +- 0.20. For Fennoscandia, we obtain Mmax = 5.76 +- 0.165; quantile(0.97) =5.44 +- 0.073. The estimates of all related parameters for the GEV and GPD, including the most important form parameter, are also provided.

physics.geo-ph↗

Cycles, determinism and persistence in agent-based games and financial time-series

The Minority Game (MG), the Majority Game (MAJG) and the Dollar Game ($G) are important and closely-related versions of market-entry games designed to model different features of real-world financial markets. In a variant of these games, agents measure the performance of their available strategies over a fixed-length rolling window of prior time-steps. These are the so-called Time Horizon MG/MAJG/$G (THMG, THMAJG, TH$G). Their probabilistic dynamics may be completely characterized in Markov-chain formulation. Games of both the standard and TH variants generate time-series that may be understood as arising from a stochastically perturbed determinism because a coin toss is used to break ties. The average over the binomially-distributed coin-tosses yields the underlying determinism. In order to quantify the degree of this determinism and of higher-order perturbations, we decompose the sign of the time-series they generate (analogous to a market price time series) into a superposition of weighted Hamiltonian cycles on graphs (exactly in the TH variants and approximately in the standard versions). The cycle decomposition also provides a ``dissection'' of the internal dynamics of the games and a quantitative measure of the degree of determinism. We discuss how the outperformance of strategies relative to agents in the THMG (the ``illusion of control'') and the reverse in the THMAJG and TH$G (i.e., genuine control) may be understood on a cycle-by-cycle basis. The decomposition offers as well a new metric for comparing different game dynamics to real-world financial time-series and a method for generating predictors. We apply the cycle predictor a real-world market, with significantly positive returns for the latter.

nlin.AO↗

Statistical Physics Approaches to Seismicity

This entry in the Encyclopedia of Complexity and Systems Science, Springer present a summary of some of the concepts and calculational tools that have been developed in attempts to apply statistical physics approaches to seismology. We summarize the leading theoretical physical models of the space-time organization of earthquakes. We present a general discussion and several examples of the new metrics proposed by statistical physicists, underlining their strengths and weaknesses. The entry concludes by briefly outlining future directions. The presentation is organized as follows. I Glossary II Definition and Importance of the Subject III Introduction IV Concepts and Calculational Tools IV.1 Renormalization, Scaling and the Role of Small Earthquakes in Models of Triggered Seismicity IV.2 Universality IV.3 Intermittent Periodicity and Chaos IV.4 Turbulence IV.5 Self-Organized Criticality V Competing mechanisms and models V.1 Roots of complexity in seismicity: dynamics or heterogeneity? V.2 Critical earthquakes V.3 Spinodal decomposition V.4 Dynamics, stress interaction and thermal fluctuation effects VI Empirical studies of seismicity inspired by statistical physics VI.1 Early successes and latter subsequent challenges VI.2 Entropy method for the distribution of time intervals between mainshocks VI.3 Scaling of the PDF of Waiting Times VI.4 Scaling of the PDF of Distances Between Subsequent Earthquakes VI.5 The Network Approach VII Future Directions

physics.geo-ph↗

Robust dynamic classes revealed by measuring the response function of a social system

We study the relaxation response of a social system after endogenous and exogenous bursts of activity using the time-series of daily views for nearly 5 million videos on YouTube. We find that most activity can be described accurately as a Poisson process. However, we also find hundreds of thousands of examples in which a burst of activity is followed by an ubiquitous power-law relaxation governing the timing of views. We find that these relaxation exponents cluster into three distinct classes, and allow for the classification of collective human dynamics. This is consistent with an epidemic model on a social network containing two ingredients: A power law distribution of waiting times between cause and action and an epidemic cascade of actions becoming the cause of future actions. This model is a conceptual extension of the fluctuation-dissipation theorem to social systems, and provides a unique framework for the investigation of timing in complex systems.

physics.soc-ph↗

Illusory versus Genuine Control in Agent-Based Games

In the Minority, Majority and Dollar Games (MG, MAJG, $G), synthetic agents compete for rewards, at each time-step acting in accord with the previously best-performing of their limited sets of strategies. Different components and/or aspects of real-world financial markets are modelled by these games. In the MG, agents compete for scarce resources; in the MAJG gents imitate the group in the hope of exploiting a trend; in the $G agents attempt to successfully predict and benefit from trends as well as changes in the direction of a market. It has been previously shown that in the MG for a reasonable number of preliminary time steps preceding equilibrium (Time Horizon MG, THMG), agents' attempt to optimize their gains by active strategy selection is ``illusory'': The calculated hypothetical gains of their individual strategies is greater on average than agents' actual average gains. Furthermore, if a small proportion of agents deliberately choose and act in accord with their seemingly worst performing strategy, these outper-form all other agents on average, and even attain mean positive gain, otherwise rare for agents in the MG. This latter phenomenon raises the question as to how well the optimization procedure works in the MAJG and $G. We demonstrate that the illusion of control is absent in MAJG and $G. In other words, low-entropy (more informative) strategies under-perform high-entropy (or random) strategies in the MG but outperform them in the MAJG and $G. This provides further clarification of the kinds of situations subject to genuine control, and those not, in set-ups a priori defined to emphasize the importance of optimization.

q-fin.TR↗

Econophysics: historical perspectives

Econophysics embodies the recent upsurge of interest by physicists into financial economics, driven by the availability of large amount of data, job shortage in physics and the possibility of applying many-body techniques developed in statistical and theoretical physics to the understanding of the self-organizing economy. This brief historical survey emphasizes that Econophysics has many historical precursors, and is in fact rooted in a continuous cross-fertilization between economics and physics that has been active in the last centuries.

q-fin.GN↗

Nonlinear theory and tests of earthquake recurrence times

We develop an efficient numerical scheme to solve accurately the set of nonlinear integral equations derived previously in (Saichev and Sornette, 2007), which describes the distribution of inter-event times in the framework of a general model of earthquake clustering with long memory. Detailed comparisons between the linear and nonlinear versions of the theory and direct synthetic catalogs show that the nonlinear theory provides an excellent fit to the synthetic catalogs, while there are significant biases resulting from the use of the linear approximation. We then address the suggestions proposed by some authors to use the empirical distribution of inter-event times to obtain a better determination of the so-called clustering parameter. Our theory and tests against synthetic and empirical catalogs find a rather dramatic lack of power for the distribution of inter-event times to distinguish between quite different sets of parameters, casting doubt on the usefulness of this statistics for the specific purpose of identifying the clustering parameter.

physics.data-an↗

Quantitative determination of the level of cooperation in the presence of punishment in three public good experiments

Strong reciprocity is a fundamental human characteristic associated with our extraordinary sociality and cooperation. Laboratory experiments on social dilemma games and many field studies have quantified well-defined levels of cooperation and propensity to punish/reward. The level of cooperation is observed to be strongly dependent on the availability of punishments and/or rewards. Here, we suggest that the propensity for altruistic punishment and reward is an emergent property that has co-evolved with cooperation by providing an efficient feedback mechanism through both biological and cultural interactions. By favoring high survival probability and large individual gains, the propensity for altruistic punishment and rewards reconciles self- and group interests. We show that a simple cost/benefit analysis at the level of a single agent, who anticipates the action of her fellows, determines an optimal level of altruistic punishment, which explains quantitatively experimental results on the third-party punishment game, the ultimatum game and altruistic punishment games. We also report numerical simulations of an evolutionary agent-based model of repeated agent interactions with feedback-by-punishments, which confirms that the propensity to punish is a robust emergent property selected by the evolutionary rules of the model.

physics.soc-ph↗

Magnitude Uncertainties Impact Seismic Rate Estimates, Forecasts and Predictability Experiments

The Collaboratory for the Study of Earthquake Predictability (CSEP) aims to prospectively test time-dependent earthquake probability forecasts on their consistency with observations. To compete, time-dependent seismicity models are calibrated on earthquake catalog data. But catalogs contain much observational uncertainty. We study the impact of magnitude uncertainties on rate estimates in clustering models, on their forecasts and on their evaluation by CSEP's consistency tests. First, we quantify magnitude uncertainties. We find that magnitude uncertainty is more heavy-tailed than a Gaussian, such as a double-sided exponential distribution, with scale parameter nu_c=0.1 - 0.3. Second, we study the impact of such noise on the forecasts of a simple clustering model which captures the main ingredients of popular short term models. We prove that the deviations of noisy forecasts from an exact forecast are power law distributed in the tail with exponent alpha=1/(a*nu_c), where a is the exponent of the productivity law of aftershocks. We further prove that the typical scale of the fluctuations remains sensitively dependent on the specific catalog. Third, we study how noisy forecasts are evaluated in CSEP consistency tests. Noisy forecasts are rejected more frequently than expected for a given confidence limit. The Poisson assumption of the consistency tests is inadequate for short-term forecast evaluations. To capture the idiosyncrasies of each model together with any propagating uncertainties, the forecasts need to specify the entire likelihood distribution of seismic rates.

physics.geo-ph↗

Probability Distributions in Complex Systems

We review briefly the concepts underlying complex systems and probability distributions. The later are often taken as the first quantitative characteristics of complex systems, allowing one to detect the possible occurrence of regularities providing a step toward defining a classification of the different levels of organization (the ``universality classes''). A rapid survey covers the Gaussian law, the power law and the stretched exponential distributions. The fascination for power laws is then explained, starting from the statistical physics approach to critical phenomena, out-of-equilibrium phase transitions, self-organized criticality, and ending with a large but not exhaustive list of mechanisms leading to power law distributions. A check-list for testing and qualifying a power law distribution from your data is described in 7 steps. This essay enlarges the description of distributions by proposing that ``kings'', i.e., events even beyond the extrapolation of the power law tail, may reveal an information which is complementary and perhaps sometimes even more important than the power law distribution. We conclude a list of future directions.

physics.data-an↗