Jump to content

Piecewise-deterministic Markov process

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Dicklyon (talk | contribs) at 05:45, 4 May 2012 (restore the correct hyphen). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

In probability theory a piecewise-deterministic Markov process (PDMP) is a process whose behaviour is goverened by random jumps at points in time. Between each jump the evolution of the process is goverened by an ordinary differential equation. The class of models is "wide enough to include as special cases virtually all the non-diffusion models of applied probability."[1]

The model was first introduced in a paper by Mark H. A. Davis in 1984.[1]

Encapsulated models

Piecewise linear models such as the M/G/1 queue, the GI/G/1 queue and dam theory can be encapsulated as PDMPs with simple differential equations.[1]

Applications

PDMPs have been shown useful in ruin theory[2] and for modelling biochemical processes such as subtilin production by the organism B. subtilis and DNA replication in eukaryotes.[3]

References

  1. ^ a b c Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:2345677, please use {{cite journal}} with |jstor=2345677 instead.
  2. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:1427443, please use {{cite journal}} with |jstor=1427443 instead.
  3. ^ Cassandras, Christos G.; Lygeros, John (2007). "9. Stochastic Hybrid Modeling of Biochemical Processes". Stochastic hybrid systems. CRC Press. {{cite book}}: External link in |chapterurl= (help); Unknown parameter |chapterurl= ignored (|chapter-url= suggested) (help)