Skip to main content

Table 1 Comparison of estimated repeat numbers in terms of RMSE for simulation datasets with STR mutation rates of 2.73×10−4 and 1.00×10−3 and read coverage of 20 ×

From: Short tandem repeat number estimation from paired-end reads for multiple individuals by considering coalescent tree

STR mutation rate

2.73×10−4

1.00×10−3

No. of samples

5

10

20

50

100

5

10

20

50

100

CoalescentSTR

2.30

2.46

2.17

1.25

1.09

4.09

3.22

2.24

1.96

1.81

CoalescentSTR (shuffled)

2.37

2.42

2.30

1.38

1.96

4.02

3.52

3.05

2.73

3.33

Basic Model

4.18

5.37

5.00

5.15

4.91

5.39

5.11

5.41

4.94

5.03

lobSTR

9.09

7.33

6.02

7.47

5.94

10.1

7.04

5.13

6.67

6.20

RepeatSeq

9.09

7.33

6.02

7.47

5.91

10.1

7.03

5.09

6.66

6.18

STRViper

8.38

6.87

5.57

6.91

5.60

9.37

6.59

4.90

6.23

5.75

  1. Repeat numbers were estimated with datasets with 5, 10, 20, 50, and 100 individuals. The best result in each condition is in bold