Simple matching coefficient

The Simple Matching Coefficient (SMC) is a statistic used for comparing the similarity and diversity of sample sets.

		A
		0	1
B	0	$M_{00}$	$M_{10}$
	1	$M_{01}$	$M_{11}$

Given two objects, A and B, each with n binary attributes, SMC is defined as:

$SMC={{\text{Number of Matching Attributes}} \over {\text{Number of Attributes}}}={{M_{00}+M_{11}} \over {M_{00}+M_{01}+M_{10}+M_{11}}}$

Where:

$M_{11}$ represents the total number of attributes where A and B both have a value of 1.

$M_{01}$ represents the total number of attributes where the attribute of A is 0 and the attribute of B is 1.

$M_{10}$ represents the total number of attributes where the attribute of A is 1 and the attribute of B is 0.

$M_{00}$ represents the total number of attributes where A and B both have a value of 0.

The Simple Matching Distance (SMD), which measures dissimilarity between sample sets, is given by $1-SMC$.

Difference with the Jaccard index

The SMC is very similar to the more popular Jaccard index. The main difference is that the SMC has the term $M_{00}$ in its denominator, whereas the Jaccard index does not. Thus, the SMC compares the number of matches with the entire set of the possible attributes, whereas the Jaccard index only compares it to the attributes that have been chosen by at least A or B.

In market basket analysis for example, the basket of two consumers who we wish to compare might only contain a small fraction of all the available products in the store, so the SMC would always return very small values compared to the Jaccard index. Using the SMC would then induce a bias by systematically considering as more similar two customers with large identical baskets than two customers with identical but smaller baskets, thus making the Jaccard index a better measure of similarity in that context.

In other contexts where 0 and 1 carry equivalent information (symmetry), the SMC is a better measure of similarity. For example, vectors of demographic variables stored in dummies variables, such as gender, would be better compared with the SMC than with the Jaccard index since the impact of gender on similarity should be equal independently from whether male is defined as a 0 and female as a 1 or the other way around. However, when we have symmetric dummy variables, one could replicate the behaviour of the SMC by splitting the dummies into two binary attributes (in that case male and female), thus transforming them into asymmetric attributes allowing to use the Jaccard index without suffering from the bias. So by using this trick, the Jaccard index can be considered as making the SMC a fully redundant metric. The SMC remains however more computationally efficient in the case of symmetric dummy variables since it doesn't require to add extra dimensions.

The Jaccard index is also more general than the SMC and can be used to compare other data types than just vectors of binary attributes, such as Probability measures.

See also

• Jaccard index