Jump to content

Piecewise-deterministic Markov process

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Melcombe (talk | contribs) at 18:19, 10 June 2012 (Applications: add isbn). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

In probability theory, a piecewise-deterministic Markov process (PDMP) is a process whose behaviour is governed by random jumps at points in time, but whose evolution is deterministically governed by an ordinary differential equation between those times. The class of models is "wide enough to include as special cases virtually all the non-diffusion models of applied probability."[1]

The model was first introduced in a paper by Mark H. A. Davis in 1984.[1]

Encapsulated models

Piecewise linear models such as the M/G/1 queue, the GI/G/1 queue and dam theory can be encapsulated as PDMPs with simple differential equations.[1]

Applications

PDMPs have been shown useful in ruin theory[2] and for modelling biochemical processes such as subtilin production by the organism B. subtilis and DNA replication in eukaryotes.[3]

References

  1. ^ a b c Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:2345677, please use {{cite journal}} with |jstor=2345677 instead.
  2. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:1427443, please use {{cite journal}} with |jstor=1427443 instead.
  3. ^ Cassandras, Christos G.; Lygeros, John (2007). "Chapter 9. Stochastic Hybrid Modeling of Biochemical Processes". Stochastic Hybrid Systems. CRC Press. ISBN 9780849390838. {{cite book}}: External link in |chapterurl= (help); Unknown parameter |chapterurl= ignored (|chapter-url= suggested) (help)