Strong and weak sampling

Strong and weak sampling are two sampling approach in Statistics, and are popular in computational cognitive science. In strong sampling, it is assumed that the data are intentionally generated as positive examples of a concept, while in weak sampling, it is assumed that the data are generated without any restrictions.

Formal Definition

In strong sampling, we assume observation is randomly sampled from the true hypothesis:

$P(x|h)={\begin{cases}{\frac {1}{|h|}}{\text{, if }}x\in h\\0{\text{, otherwise}}\end{cases}}$

In weak sampling, we assume observations randomly sampled and then classified:

$P(x|h)={\begin{cases}1{\text{, if }}x\in h\\0{\text{, otherwise}}\end{cases}}$

External Link

• Lecture 20: Strong vs weak sampling