arXiv subjects

D. Sornette

Publications and source records attributed to D. Sornette.

At least 73 records · Page 4Linked to original sources

arXiv2010

Processing Information in Quantum Decision Theory

A survey is given summarizing the state of the art of describing information processing in Quantum Decision Theory, which has been recently advanced as a novel variant of decision making, based on the mathematical theory of separable Hilbert spaces. This mathematical structure captures the effect of superposition of composite prospects, including many incorporated intended actions. The theory characterizes entangled decision making, non-commutativity of subsequent decisions, and intention interference. The self-consistent procedure of decision making, in the frame of the quantum decision theory, takes into account both the available objective information as well as subjective contextual effects. This quantum approach avoids any paradox typical of classical decision theory. Conditional maximization of entropy, equivalent to the minimization of an information functional, makes it possible to connect the quantum and classical decision theories, showing that the latter is the limit of the former under vanishing interference terms.

physics.soc-ph↗

arXiv2010

Reverse Engineering Financial Markets with Majority and Minority Games using Genetic Algorithms

Using virtual stock markets with artificial interacting software investors, aka agent-based models (ABMs), we present a method to reverse engineer real-world financial time series. We model financial markets as made of a large number of interacting boundedly rational agents. By optimizing the similarity between the actual data and that generated by the reconstructed virtual stock market, we obtain parameters and strategies, which reveal some of the inner workings of the target stock market. We validate our approach by out-of-sample predictions of directional moves of the Nasdaq Composite Index.

q-fin.TR↗

arXiv2009

Physics of risk and uncertainty in quantum decision making

The Quantum Decision Theory, developed recently by the authors, is applied to clarify the role of risk and uncertainty in decision making and in particular in relation to the phenomenon of dynamic inconsistency. By formulating this notion in precise mathematical terms, we distinguish three types of inconsistency: time inconsistency, planning paradox, and inconsistency occurring in some discounting effects. While time inconsistency is well accounted for in classical decision theory, the planning paradox is in contradiction with classical utility theory. It finds a natural explanation in the frame of the Quantum Decision Theory. Different types of discounting effects are analyzed and shown to enjoy a straightforward explanation within the suggested theory. We also introduce a general methodology based on self-similar approximation theory for deriving the evolution equations for the probabilities of future prospects. This provides a novel classification of possible discount factors, which include the previously known cases (exponential or hyperbolic discounting), but also predicts a novel class of discount factors that decay to a strictly positive constant for very large future time horizons. This class may be useful to deal with very long-term discounting situations associated with intergenerational public policy choices, encompassing issues such as global warming and nuclear waste disposal.

physics.soc-ph↗

arXiv2009

Scheme of thinking quantum systems

A general approach describing quantum decision procedures is developed. The approach can be applied to quantum information processing, quantum computing, creation of artificial quantum intelligence, as well as to analyzing decision processes of human decision makers. Our basic point is to consider an active quantum system possessing its own strategic state. Processing information by such a system is analogous to the cognitive processes associated to decision making by humans. The algebra of probability operators, associated with the possible options available to the decision maker, plays the role of the algebra of observables in quantum theory of measurements. A scheme is advanced for a practical realization of decision procedures by thinking quantum systems. Such thinking quantum systems can be realized by using spin lattices, systems of magnetic molecules, cold atoms trapped in optical lattices, ensembles of quantum dots, or multilevel atomic systems interacting with electromagnetic field.

quant-ph↗

arXiv2009

Gibrat's law for cities: uniformly most powerful unbiased test of the Pareto against the lognormal

We address the general problem of testing a power law distribution versus a log-normal distribution in statistical data. This general problem is illustrated on the distribution of the 2000 US census of city sizes. We provide definitive results to close the debate between Eeckhout (2004, 2009) and Levy (2009) on the validity of Zipf's law, which is the special Pareto law with tail exponent 1, to describe the tail of the distribution of U.S. city sizes. Because the origin of the disagreement between Eeckhout and Levy stems from the limited power of their tests, we perform the {\em uniformly most powerful unbiased test} for the null hypothesis of the Pareto distribution against the lognormal. The $p$-value and Hill's estimator as a function of city size lower threshold confirm indubitably that the size distribution of the 1000 largest cities or so, which include more than half of the total U.S. population, is Pareto, but we rule out that the tail exponent, estimated to be $1.4 \pm 0.1$, is equal to 1. For larger ranks, the $p$-value becomes very small and Hill's estimator decays systematically with decreasing ranks, qualifying the lognormal distribution as the better model for the set of smaller cities. These two results reconcile the opposite views of Eeckhout (2004, 2009) and Levy (2009). We explain how Gibrat's law of proportional growth underpins both the Pareto and lognormal distributions and stress the key ingredient at the origin of their difference in standard stochastic growth models of cities \cite{Gabaix99,Eeckhout2004}.

physics.data-an↗

arXiv2009

Effects of Diversity and Procrastination in Priority Queuing Theory: the Different Power Law Regimes

Empirical analysis show that, after the update of a browser, the publication of the vulnerability of a software, or the discovery of a cyber worm, the fraction of computers still using the older version, or being not yet patched, or exhibiting worm activity decays as power laws $\sim 1/t^α$ with $0 < α\leq 1$ over time scales of years. We present a simple model for this persistence phenomenon framed within the standard priority queuing theory, of a target task which has the lowest priority compared with all other tasks that flow on the computer of an individual. We identify a "time deficit" control parameter $β$ and a bifurcation to a regime where there is a non-zero probability for the target task to never be completed. The distribution of waiting time ${\cal T}$ till the completion of the target task has the power law tail $\sim 1/t^{1/2}$, resulting from a first-passage solution of an equivalent Wiener process. Taking into account a diversity of time deficit parameters in a population of individuals, the power law tail is changed into $1/t^α$ with $α\in(0.5,\infty)$, including the well-known case $1/t$. We also study the effect of "procrastination", defined as the situation in which the target task may be postponed or delayed even after the individual has solved all other pending tasks. This new regime provides an explanation for even slower apparent decay and longer persistence.

physics.soc-ph↗

arXiv2009

Distribution of Maximum Earthquake Magnitudes in Future Time Intervals, Application to the Seismicity of Japan (1923-2007)

We modify the new method for the statistical estimation of the tail distribution of earthquake seismic moments introduced by Pisarenko et al. [2009] and apply it to the earthquake catalog of Japan (1923-2007). The method is based on the two main limit theorems of the theory of extreme values and on the derived duality between the Generalized Pareto Distribution (GPD) and Generalized Extreme Value distribution (GEV). We obtain the distribution of maximum earthquake magnitudes in future time intervals of arbitrary duration tau. This distribution can be characterized by its quantile Qq(tau) at any desirable statistical level q. The quantile Qq(tau) provides a much more stable and robust characteristic than the traditional absolute maximum magnitude Mmax (Mmax can be obtained as the limit of Qq(tau) as q tends to 1, and tau tends to infinity). The best estimates of the parameters governing the distribution of Qq(tay) for Japan (1923-2007) are the following: Form parameter for GEV = -0.1901 +- 0.0717; position parameter GEV(tau=200)= 6.3387 +- 0.0380; spread parameter for GEV(tau=200)= 0.5995 +- 0.0223; Q_0.90,GEV(tau=10)= 8.34 +- 0.32. We also estimate Qq(tau) for a set of q-values and future time periods in the range for tau between 1 and 50 years from 2007. For comparison, the absolute maximum estimate Mmax from GEV, which is equal to 9.57 +- 0.86, has a scatter more than twice that of the 90 percent quantile Q_{0.90,GEV}(tau=10) of the maximum magnitude over the next 10 years counted from 2007.

physics.geo-ph↗

arXiv2009

Most Efficient Homogeneous Volatility Estimators

We present a comprehensive theory of homogeneous volatility (and variance) estimators of arbitrary stochastic processes that fully exploit the OHLC (open, high, low, close) prices. For this, we develop the theory of most efficient point-wise homogeneous OHLC volatility estimators, valid for any price processes. We introduce the "quasi-unbiased estimators", that can address any type of desirable constraints. The main tool of our theory is the parsimonious encoding of all the information contained in the OHLC prices for a given time interval in the form of the joint distributions of the high-minus-open, low-minus-open and close-minus-open values, whose analytical expression is derived exactly for Wiener processes with drift. The distributions can be calculated to yield the most efficient estimators associated with any statistical properties of the underlying log-price stochastic process. Applied to Wiener processes for log-prices with drift, we provide explicit analytical expressions for the most efficient point-wise volatility and variance estimators, based on the analytical expression of the joint distribution of the high-minus-open, low-minus-open and close-minus-open values. The efficiency of the new proposed estimators is favorably compared with that of the Garman-Klass, Roger-Satchell and maximum likelihood estimators.

q-fin.ST↗

arXiv2009

Earthquake Forecasting Based on Data Assimilation: Sequential Monte Carlo Methods for Renewal Processes

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts, than can be achieved by ignoring data uncertainties. Earthquake forecasting, too, suffers from measurement errors and partial model information and may thus gain significantly from data assimilation. We present perhaps the first fully implementable data assimilation method for earthquake forecasts generated by a point-process model of seismicity. We test the method on a synthetic and pedagogical example of a renewal process observed in noise, which is relevant to the seismic gap hypothesis, models of characteristic earthquakes and to recurrence statistics of large quakes inferred from paleoseismic data records. To address the non-Gaussian statistics of earthquakes, we use sequential Monte Carlo methods, a set of flexible simulation-based methods for recursively estimating arbitrary posterior distributions. We perform extensive numerical simulations to demonstrate the feasibility and benefits of forecasting earthquakes based on data assimilation. In particular, we show that the forecasts based on the Optimal Sampling Importance Resampling (OSIR) particle filter are significantly better than those of a benchmark forecast that ignores uncertainties in the observed event times. We use the marginal data likelihood, a measure of the explanatory power of a model in the presence of data errors, to estimate parameters and compare models.

physics.geo-ph↗

arXiv2009

Punctuated evolution due to delayed carrying capacity

A new delay equation is introduced to describe the punctuated evolution of complex nonlinear systems. A detailed analytical and numerical investigation provides the classification of all possible types of solutions for the dynamics of a population in the four main regimes dominated respectively by: (i) gain and competition, (ii) gain and cooperation, (iii) loss and competition and (iv) loss and cooperation. Our delay equation may exhibit bistability in some parameter range, as well as a rich set of regimes, including monotonic decay to zero, smooth exponential growth, punctuated unlimited growth, punctuated growth or alternation to a stationary level, oscillatory approach to a stationary level, sustainable oscillations, finite-time singularities as well as finite-time death.

nlin.AO↗

arXiv2009

Stable States of Biological Organisms

A novel model of biological organisms is advanced, treating an organism as a self-consistent system subject to a pathogen flux. The principal novelty of the model is that it describes not some parts, but a biological organism as a whole. The organism is modeled by a five-dimensional dynamical system. The organism homeostasis is described by the evolution equations for five interacting components: healthy cells, ill cells, innate immune cells, specific immune cells, and pathogens. The stability analysis demonstrates that, in a wide domain of the parameter space, the system exhibits robust structural stability. There always exist four stable stationary solutions characterizing four qualitatively differing states of the organism: alive state, boundary state, critical state, and dead state.

physics.bio-ph↗

arXiv2009

The Chinese Equity Bubble: Ready to Burst

Amid the current financial crisis, there has been one equity index beating all others: the Shanghai Composite. Our analysis of this main Chinese equity index shows clear signatures of a bubble build up and we go on to predict its most likely crash date: July 17-27, 2009 (20%/80% quantile confidence interval).

q-fin.ST↗

arXiv2009

Icequakes as precursors of ice avalanches

A hanging glacier at the east face of Weisshorn broke off in 2005. We were able to monitor and measure surface motion and icequake activity for 21 days up to three days prior to the break-off. Results are presented from the analysis of seismic waves generated by the glacier during the rupture maturation process. Three types of precursory signals of the imminent catastrophic rupture were identified: (i) an increasing seismic activity within the glacier, (ii) a change in the size-frequency distribution of icequake energy, and (iii) a log-periodic oscillating behavior superimposed on power law acceleration of the inverse of waiting time between two icequakes. The analysis of the seismic activity gave indications of the rupture process and led to the identification of two regimes: a stable one where events are isolated and non correlated which is characteristic of diffuse damage, and an unstable and dangerous one in which events become synchronized and large icequakes are triggered.

physics.geo-ph↗

arXiv2009

Endogenous versus Exogenous Origins of Diseases

Many illnesses are associated with an alteration of the immune system homeostasis due to any combination of factors, including exogenous bacterial insult, endogenous breakdown (e.g., development of a disease that results in immuno suppression), or an exogenous hit like surgery that simultaneously alters immune responsiveness and provides access to bacteria, or genetic disorder. We conjecture that, as a consequence of the co-evolution of the immune system of individuals with the ecology of pathogens, the homeostasis of the immune system requires the influx of pathogens. This allows the immune system to keep the ever present pathogens under control and to react and adjust fast to bursts of infections. We construct the simplest and most general system of rate equations which describes the dynamics of five compartments: healthy cells, altered cells, adaptive and innate immune cells, and pathogens. We study four regimes obtained with or without auto-immune disorder and with or without spontaneous proliferation of infected cells. Over all regimes, we find that seven different states are naturally described by the model: (i) strong healthy immune system, (ii) healthy organism with evanescent immune cells, (iii) chronic infections, (iv) strong infections, (v) cancer, (vi) critically ill state and (vii) death. The analysis of stability conditions demonstrates that these seven states depend on the balance between the robustness of the immune system and the influx of pathogens.

physics.bio-ph↗

arXiv2009

A Consistent Model of `Explosive' Financial Bubbles With Mean-Reversing Residuals

We present a self-consistent model for explosive financial bubbles, which combines a mean-reverting volatility process and a stochastic conditional return which reflects nonlinear positive feedbacks and continuous updates of the investors' beliefs and sentiments. The conditional expected returns exhibit faster-than-exponential acceleration decorated by accelerating oscillations, called "log-periodic power law." Tests on residuals show a remarkable low rate (0.2%) of false positives when applied to a GARCH benchmark. When tested on the S&P500 US index from Jan. 3, 1950 to Nov. 21, 2008, the model correctly identifies the bubbles ending in Oct. 1987, in Oct. 1997, in Aug. 1998 and the ITC bubble ending on the first quarter of 2000. Different unit-root tests confirm the high relevance of the model specification. Our model also provides a diagnostic for the duration of bubbles: applied to the period before Oct. 1987 crash, there is clear evidence that the bubble started at least 4 years earlier. We confirm the validity and universality of the volatility-confined LPPL model on seven other major bubbles that have occurred in the World in the last two decades. Using Bayesian inference, we find a very strong statistical preference for our model compared with a standard benchmark, in contradiction with Chang and Feigenbaum (2006) which used a unit-root model for residuals.

q-fin.RM↗

arXiv2009

Generation-by-Generation Dissection of the Response Function in Long Memory Epidemic Processes

In a number of natural and social systems, the response to an exogenous shock relaxes back to the average level according to a long-memory kernel $\sim 1/t^{1+θ}$ with $0 \leq θ<1$. In the presence of an epidemic-like process of triggered shocks developing in a cascade of generations at or close to criticality, this "bare" kernel is renormalized into an even slower decaying response function $\sim 1/t^{1-θ}$. Surprisingly, this means that the shorter the memory of the bare kernel (the larger $1+θ$), the longer the memory of the response function (the smaller $1-θ$). Here, we present a detailed investigation of this paradoxical behavior based on a generation-by-generation decomposition of the total response function, the use of Laplace transforms and of "anomalous" scaling arguments. The paradox is explained by the fact that the number of triggered generations grows anomalously with time at $\sim t^θ$ so that the contributions of active generations up to time $t$ more than compensate the shorter memory associated with a larger exponent $θ$. This anomalous scaling results fundamentally from the property that the expected waiting time is infinite for $0 \leq θ\leq 1$. The techniques developed here are also applied to the case $θ>1$ and we find in this case that the total renormalized response is a {\bf constant} for $t < 1/(1-n)$ followed by a cross-over to $\sim 1/t^{1+θ}$ for $t \gg 1/(1-n)$.

physics.data-an↗

arXiv2009

Heavy-Tailed Distribution of Cyber-Risks

With the development of the Internet, new kinds of massive epidemics, distributed attacks, virtual conflicts and criminality have emerged. We present a study of some striking statistical properties of cyber-risks that quantify the distribution and time evolution of information risks on the Internet, to understand their mechanisms, and create opportunities to mitigate, control, predict and insure them at a global scale. First, we report an exceptionnaly stable power-law tail distribution of personal identity losses per event, ${\rm Pr}({\rm ID loss} \geq V) \sim 1/V^b$, with $b =0.7 \pm 0.1$. This result is robust against a surprising strong non-stationary growth of ID losses culminating in July 2006 followed by a more stationary phase. Moreover, this distribution is identical for different types and sizes of targeted organizations. Since $b<1$, the cumulative number of all losses over all events up to time $t$ increases faster-than-linear with time according to $\mathbf{\simeq t^{1/b}}$, suggesting that privacy, characterized by personal identities, is necessarily becoming more and more insecure. We also show the existence of a size effect, such that the largest possible ID losses per event grow faster-than-linearly as $\sim S^{1.3}$ with the organization size $S$. The small value $b \simeq 0.7$ of the power law distribution of ID losses is explained by the interplay between Zipf's law and the size effect. We also infer that compromised entities exhibit basically the same probability to incur a small or large loss.

physics.soc-ph↗

arXiv2009

Quantum decision theory as quantum theory of measurement

We present a general theory of quantum information processing devices, that can be applied to human decision makers, to atomic multimode registers, or to molecular high-spin registers. Our quantum decision theory is a generalization of the quantum theory of measurement, endowed with an action ring, a prospect lattice and a probability operator measure. The algebra of probability operators plays the role of the algebra of local observables. Because of the composite nature of prospects and of the entangling properties of the probability operators, quantum interference terms appear, which make actions noncommutative and the prospect probabilities non-additive. The theory provides the basis for explaining a variety of paradoxes typical of the application of classical utility theory to real human decision making. The principal advantage of our approach is that it is formulated as a self-consistent mathematical theory, which allows us to explain not just one effect but actually all known paradoxes in human decision making. Being general, the approach can serve as a tool for characterizing quantum information processing by means of atomic, molecular, and condensed-matter systems.

quant-ph↗