Jump to content

Piecewise-deterministic Markov process

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Gareth Jones (talk | contribs) at 09:51, 12 June 2013 (Examples: link markov chains, ctmcs). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

In probability theory, a piecewise-deterministic Markov process (PDMP) is a process whose behaviour is governed by random jumps at points in time, but whose evolution is deterministically governed by an ordinary differential equation between those times. The class of models is "wide enough to include as special cases virtually all the non-diffusion models of applied probability."[1] The process is defined by three quantities: the flow, the jump rate, and the transition measure.[2]

The model was first introduced in a paper by Mark H. A. Davis in 1984.[1]

Examples

Piecewise linear models such as Markov chains, continuous-time Markov chains, the M/G/1 queue, the GI/G/1 queue and the fluid queue can be encapsulated as PDMPs with simple differential equations.[1]

Applications

PDMPs have been shown useful in ruin theory,[3] queueing theory,[4][5] for modelling biochemical processes such as subtilin production by the organism B. subtilis and DNA replication in eukaryotes[6] for modelling earthquakes[7]

Properties

Löpker and Palmowski have shown conditions under which a time reversed PDMP is a PDMP.[8] General conditions are known for PDMPs to be stable.[9]

References

  1. ^ a b c Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:2345677, please use {{cite journal}} with |jstor=2345677 instead.
  2. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1137/080718541, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1137/080718541 instead.
  3. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:1427443, please use {{cite journal}} with |jstor=1427443 instead.
  4. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:3214906, please use {{cite journal}} with |jstor=3214906 instead.
  5. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1017/S0269964805050011, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1017/S0269964805050011 instead.
  6. ^ Cassandras, Christos G.; Lygeros, John (2007). "Chapter 9. Stochastic Hybrid Modeling of Biochemical Processes". Stochastic Hybrid Systems. CRC Press. ISBN 9780849390838. {{cite book}}: External link in |chapterurl= (help); Unknown parameter |chapterurl= ignored (|chapter-url= suggested) (help)
  7. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1016/0304-4149(84)90009-7, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1016/0304-4149(84)90009-7 instead.
  8. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1214/EJP.v18-1958, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1214/EJP.v18-1958 instead.
  9. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1137/060670109, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1137/060670109 instead.