The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation

Table 3 Correlation between MCC, accuracy, and F₁ score values

N	PCC (MCC, F₁ score)	PCC (MCC, accuracy)	PCC (accuracy, F₁ score)
10	0.742162	0.869778	0.744323
25	0.757044	0.893572	0.760708
50	0.766501	0.907654	0.769752
75	0.769883	0.912530	0.772917
100	0.771571	0.914926	0.774495
200	0.774060	0.918401	0.776830
300	0.774870	0.919515	0.777595
400	0.775270	0.920063	0.777976
500	0.775509	0.920388	0.778201
1 000	0.775982	0.921030	0.778652

Pearson correlation coefficient (PCC) between accuracy, MCC and F₁ score computed on all confusion matrices with given number of samples N

ISSN: 1471-2164