Skip to main content

Table 5 Mean residual errors for spots with σ2' > σ2 and σ2' < σ2, using I avg or I min pooling metric.

From: Improving the statistical detection of regulated genes from microarray data using intensity-based variance estimation

 

Agilent Feature Extraction

SPOT Processing

Agilent FG + SPOT BG

 

σ2' > σ2

σ2' < σ2

σ2' > σ2

σ2' < σ2

σ2' > σ2

σ2' < σ2

 

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

Iavg

Imin

σM 2 Cond. X

0.19

0.18

0.21

0.20

0.14

0.14

0.15

0.15

0.13

0.13

0.14

0.14

σM 2 Cond. Y

0.22

0.18

0.25

0.23

0.16

0.14

0.17

0.17

0.15

0.13

0.16

0.16

σμ 2

0.19

0.18

0.22

0.19

0.13

0.13

0.14

0.14

0.12

0.12

0.12

0.12

  1. Analysis was performed on Dataset 5 (reference sample design). Data is given for both unpaired and paired analyses, using three different image processing techniques: Agilent Feature Extraction, SPOT Image Processing, and Agilent foreground combined with SPOT background.