SearcharxivSearch

arXiv · cond-mat/0701589

Markov vs. nonMarkovian processes A comment on the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T.D. Frank

Abstract

The purpose of this comment is to correct mistaken assumptions and claims made in the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T. D. Frank. Our comment centers on the claims of a nonlinear Markov process and a nonlinear Fokker-Planck equation. First, memory in transition densities is misidentified as a Markov process. Second, Frank assumes that one can derive a Fokker-Planck equation from a Chapman-Kolmogorov equation, but no proof was given that a Chapman-Kolmogorov equation exists for memory-dependent processes. A nonlinear Markov process is claimed on the basis of a nonlinear diffusion pde for a 1-point probability density. We show that, regardless of which initial value problem one may solve for the 1-point density, the resulting stochastic process, defined necessarily by the transition probabilities, is either an ordinary linearly generated Markovian one, or else is a linearly generated nonMarkovian process with memory. We provide explicit examples of diffusion coefficients that reflect both the Markovian and the memory-dependent cases. So there is neither a nonlinear Markov process nor nonlinear Fokker-Planck equation for a transition density. The confusion rampant in the literature arises in part from labeling a nonlinear diffusion equation for a 1-point probability density as nonlinear Fokker-Planck, whereas neither a 1-point density nor an equation of motion for a 1-point density defines a stochastic process, and Borland misidentified a translation invariant 1-point density derived from a nonlinear diffusion equation as a conditional probability density. In the Appendix we derive Fokker-Planck pdes and Chapman-Kolmogorov eqns. for stochastic processes with finite memory.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Joseph L. McCauley. 2007-03-13. Markov vs. nonMarkovian processes A comment on the paper Stochastic feedback, nonlinear families of Markov processes, and nonlinear Fokker-Planck equations by T.D. Frank. https://doi.org/10.1016/j.physa.2007.03.020

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The free energy of the square lattice Ising model with interactions alternating in horizontal and vertical directions

The free energy of the Ising model on the square lattice with alternating interactions in both horizontal and vertical directions is exactly derived. This model is distinct from the checkerboard Ising model. The result includes Onsager's free energy as a special case, and also includes Lee-Yang's free energy with an imaginary field, and relates these two solutions via continuous parameters. The result includes a generalization of Lee-Yang's result to cases with four different couplings. It is also derived that each imaginary magnetic field $iπ/2$ applied to a lattice site corresponds to a single frustrated square in its dual lattice.

cond-mat.stat-mech

Ideal heat engine cycles at maximal efficiency -- the ideal gas and beyond

Given a particular heat engine cycle, what is the optimal working medium that results in the highest efficiency? While one might jump to the conclusion that it must surely be the ideal gas, the situation is actually more intricate. Starting with a general Helmholtz potential that depends polynomially on molar volume and temperature we derive exact expressions for the ideal Stirling, Otto, and Brayton cycles. We find that for the thermodynamic systems described by our ansatz for the Helmholtz potential the maximal efficiency is achieved, if the working medium is described by a fundamental relation linear in temperature. This includes the ideal gas, but also classical harmonic oscillators and phenomenological models of the rubber band.

cond-mat.stat-mech

Local Detailed Balance in the Lorenz Model: Replaces the Butterfly with Frenetic Bursting

The Lorenz system is the canonical low-order model of convective instability, yet its dissipative and driving terms have never been checked against, nor constructed from, an explicit thermodynamic bookkeeping. We derive a modification that satisfies the local-detailed-balance condition for macroscopic relaxation toward nonequilibrium steady states, thereby identifying the thermodynamic force, entropy-production rate and frenesy of the resulting flow. The resulting model produces a transition from a quiescent fixed point to a robust, large-amplitude relaxation oscillation, closely analogous to recharge-discharge oscillator paradigms used for the El Nino-Southern Oscillation. The system alternates between a long, nearly reversible recharge phase and a brief, violently frenetic discharge burst, during which essentially all of the cycle's activity and entropy production is concentrated.

cond-mat.stat-mech