Bayes' theorem

In probability theory and applications, Bayes' theorem shows the relation between a conditional probability and its reverse form. For example, the probability of a hypothesis given some observed pieces of evidence and the probability of that evidence given the hypothesis. This theorem is named for Thomas Bayes (pronounced /ˈbeɪz/ or "bays") and often called Bayes' law or Bayes' rule.

Formula

The equation used is:

$P(A|B)={\frac {P(B|A)\,P(A)}{P(B)}}.$

Where:

• P(A) is the prior probability or marginal probability of A. It is "prior" in the sense that it does not take into account any information about B.
• P(A|B) is the conditional probability of A, given B. It is also called the posterior probability because it is derived from or depends upon the specified value of B.
• P(B|A) is the conditional probability of B given A. It is also called the likelihood.
• P(B) is the prior or marginal probability of B, and acts as a normalizing constant.

Example

A simple example is as follows: There is a 40% chance of it raining on Sunday. If it rains on Sunday, there is a 10% chance it will rain on Monday. If it didn't rain on Sunday, there's an 80% chance it will rain on Monday.

"Raining on Sunday" is event A, and "Raining on Monday" is event B.

• P(A) = 0.40 = Probability of Raining on Sunday.
• P(A`) = 0.60 = Probability of not raining on Sunday.
• P(B|A) = 0.10 = Probability of it raining on Monday, if it rained on Sunday.
• P(B`|A) = 0.10 = Probability of it not raining on Monday, if it rained on Sunday.
• P(B|A`) = 0.80 = Probability of it raining on Monday, if it did not rain on Sunday.
• P(B`|A`) = 0.20 = Probability of it not raining on Monday, if it did not rain on Sunday.

The first thing we'd normally calculate is the probability of it raining on Monday: This would be the sum of the probability of "Raining on Sunday and raining on Monday" and "Not raining on Sunday and raining on Monday"

$.40*.10+.60*.80=.52=52\%$ chance

However, what if we said: "It rained on Monday. What is the Probability it rained on Sunday?" That is where Bayes' theorem comes in. It allows us to calculate the probability of an earlier event, given the later event happened.

The equation used is:

$P(A|B)={\frac {P(B|A)\,P(A)}{P(B)}}.$

In our case, "Raining on Sunday" is event A, and "Raining on Monday" is event B.

• P(B|A) = 0.10 = Probability of it raining on Monday, if it rained on Sunday.
• P(A) = 0.40 = Probability of Raining on Sunday.
• P(B) = 0.52 = Probability of Raining on Monday.

So, to calculate the probability it rained on Sunday, given that it rained on Monday:

$P(A|B)={\frac {P(B|A)\,P(A)}{P(B)}}.$

or:

$P(A|B)={\frac {0.10*0.40}{0.52}}=.0769$

In other words, if it rained on Monday, there's a 7.69% chance it rained on Sunday.