- Open Access
Simultaneous inferences based on empirical Bayes methods and false discovery rates ineQTL data analysis
© Chakraborty et al.; licensee BioMed Central Ltd. 2013
- Published: 9 December 2013
Genome-wide association studies (GWAS) have identified hundreds of genetic variants associated with complex human diseases, clinical conditions and traits. Genetic mapping of expression quantitative trait loci (eQTLs) is providing us with novel functional effects of thousands of single nucleotide polymorphisms (SNPs). In a classical quantitative trail loci (QTL) mapping problem multiple tests are done to assess whether one trait is associated with a number of loci. In contrast to QTL studies, thousands of traits are measured alongwith thousands of gene expressions in an eQTL study. For such a study, a huge number of tests have to be performed (). This extreme multiplicity gives rise to many computational and statistical problems. In this paper we have tried to address these issues using two closely related inferential approaches: an empirical Bayes method that bears the Bayesian flavor without having much a priori knowledge and the frequentist method of false discovery rates. A three-component t-mixture model has been used for the parametric empirical Bayes (PEB) method. Inferences have been obtained using Expectation/Conditional Maximization Either (ECME) algorithm. A simulation study has also been performed and has been compared with a nonparametric empirical Bayes (NPEB) alternative.
The results show that PEB has an edge over NPEB. The proposed methodology has been applied to human liver cohort (LHC) data. Our method enables to discover more significant SNPs with FDR<10% compared to the previous study done by Yang et al. (Genome Research, 2010).
In contrast to previously available methods based on p-values, the empirical Bayes method uses local false discovery rate (lfdr) as the threshold. This method controls false positive rate.
- False Discovery Rate
- Mixture Model
- Differentially Express
- Differentially Express Gene
- Expression Quantitative Trait Locus
Genome-wide association studies (GWASs) have done a remarkable progress in searching for susceptibility genes. In GWAS, instead of one gene at a time, variation across the entire genome is tested for association with disease risk. GWASs exploit the linkage disequilibrium (LD) relationships among single nucleotide polymorphisms (SNPs), making it possible to assay genome by testing a finite number of SNPs. Till date, the signals that can be discovered through GWAS has not been reported exhaustively. It is important to annotate SNPs information on expression for the better understanding of the genes and mechanisms driving the association. In many situations, there are more common variants truly associated with disease. These variants are highly likely to be expression quantitative trait loci (eQTLs). eQTLs are derived from polymorphisms in the genome that result in differential measurable transcript levels. Microarrays are used to measure gene expression levels across genetic mapping populations. For at least a subset of complex disorders, gene expression levels could be used as a surrogate/biomarker for classical phenotypes. The gene underlying the eQTL is considered to be an excellent candidate for phenotypic QTL.
eQTL mapping is a statistical technique to locate genomic intervals, that are likely to regulate the expression of each transcript, by correlating quantitative measurements of mRNA expression with genetic polymorphisms segregating in a population. In a GWAS, millions of SNPs are tested at once. Associations that initially appear to be significant must be statistically adjusted to account for the large number of tests being performed. A large number of false positives will result in if this correction is ignored. The multiple-testing correction, however, sets a very high threshold for genome-wide significance, on the order of when a million SNPs are tested. In the vast majority cases, however, association studies have achieved only limited success. Large sample sizes are needed to achieve sufficient statistical power to detect risk alleles with effects weak enough to have escaped detection in the past; the disease risk alleles identified by GWASs so far do have weak effects, each with odds ratios of 1.1 or 1.2 .
Two closely related inferential procedures for multiple testing have been discussed in this work-afrequentist approach based on Benjamini and Hochberg's () false discovery rate procedure, and an empirical Bayes methodology developed in Efron et al. [3, 4]. These two methods are not only very closely related, they can be used to support each other. In a classic two-sample problem in a microarray experiment, these approaches have been discussed by Efron and Tibshirani. However, they have considered nonparametric empirical Bayes (NPEB) model. Parametric Bayesian modeling has been considered by Newton et al. , Lee et al. , Kendziroski et al. [8–10], Gelfond et al. . Hierarchical models like gamma-gamma  or lognormal-normal  are used quite often in PEB procedures. These models suffer from a serious drawback that the variation is constant among genes. An extension has been done to these models by considering gene specific variations. The application of empirical Bayes has been somehow not very common in literature. The obvious reason is that, experimenters have not brought us many data sets having the parallel structure necessary for empirical Bayes to do its stuff. Because of the recent surge in high-throughput () technologies and genome projects, many genome studies are now underway. These studies have become a major data generator in the post-genomics era. Empirical Bayes procedures seem to be particularly well-suited for combining information in expression data.
One of the fundamental statistical problems in microarray gene expression analysis is the need to reduce dimensionality of the transcripts. This can be achieved by identifying differentially expressed (DE) genes under different conditions or groups. Regulatory network can be obtained by associating differential expressions with the genotype of molecular markers. It is possible to have a large number of DE genes that influences a certain phenotype while their relative proportion is very small. It is very important to identify these DE genes from among the number of recorded genes [6, 7, 9, 14, 15]. Empirical Bayes methods provide a natural approach to reduce the dimensionality significantly [16, 17]. Following the empirical Bayes approach DE genes are identified using the posterior probability for differential expression. EB approaches detect a DE gene by sharing information across the whole genome.
The development of the empirical Bayes methodologies that improve the power to detect DE genes essentially reduces to the choice of whether gene-specific effects should be modeled as fixed or random . Both mean and error variance can be of either of these two: fixed or random. Fixed mean and random error variance has been considered by Wright and Simon  and Cui et al.  whereas Lonnstedt et al. , Tai and Speed , Lonnstedt and Speed  have considered both the parameters to be random. Random mean effect with homogeneous fixed error variance has been considered by Newton et al. [6, 24], Kendziroski et al.  and Kendziroski et al. . However an extension to this fixed error variance has been considered by Gelfond et al. . They have considered discrete uniform prior for the variance component.
The paper is organized as follows. In the Methods section we introduce the necessary notations for our additive genetic model along with the notions of false discovery rate (fdr). In this section we have tried to establish the relationship between fdr and empirical Bayes. Methods section also describes, the proposed Expectation/Conditional Maximization Either (ECME) (Liu and Rubin ) in details. This algorithm generalizes the Expectation-Maximization algorithm with better convergence rate. A simulation study has been performed and described in the Results section. We show that proposed parametric empirical Bayes performs better compared to nonparametric empirical Bayes in terms of controlled fdr. In the Results section, as an application, we have applied the proposed methodology to the Liver Cohort (LHC) dataset. We conclude the article the Discussion section.
where is the usual standard deviations and is defined to minimize the difference in the coefficient of variation of within classes of genes with approximately equal variance. A drawback of calculating is the computational cost. Note that if , this reduces to usual t-statistic. Here is considered to be 90th percentile of all values (Efron el al. ).
with . Mixing proportions are nonnegative constantsand sum to one for fixed i. corresponds to distribution for no associationwhereas and correspond to distributions related to positive and negativeassociation respectively. In a recent work, Noma and Matsui , have used semiparametric hierarchical mixture model where the distribution of mean expression level of a transcript is considered to be a three-component mixture distribution.
Full Bayesian analysis of (4) will require prior specifications of and . However, one can use the massively parallel structure of microarray data to estimate an empirical Bayes estimate of the posterior probability. These huge data motivates to be quite empirical rather than specifying a-priori models in favor of data-based investigations .
Empirical Bayes, false discovery rates (fdr) and local false discovery rate (lfdr)
False discovery rate (fdr) is defined as the expected proportion of errors committed by falsely rejecting null hypotheses. Benjamini and Hochberg's fdr criterion has very close relation with the empirical Bayes analysis. This relation improved the connection between Bayesian and frequentist testing theory. The close connection between fdr and the empirical Bayes methodology follows directly from Bayes theorem and this has been established by the "Equivalence theorem". Tail area rejection regions like are common in the frequentist framework. According to this theorem, if the tail area rejection region is taken to be as large as possible subject to the constraint that the estimated Bayes proportions of false discoveries is less than , then the frequentist expected proportion of false discoveries is also less than .
All other parameters will be estimated by EM algorithm assuming to be known. There are some practical difficulties with the lfdr that relies on densities. The estimation of null becomes more problematic in the far tails. It is relatively easier to work with cumulative distribution function than work with densities. Identification of discoveries by lfdr may not be reproducible for a new data. Therefore, even in empirical Bayes framework, fdr should be preferred.
Nonparametric empirical Bayes (NPEB)
The main difference between parametric empirical Bayes (PEB) and nonparametric empirical Bayes (NPEB) is the way in which are treated. In PEB model, the functional form of are known, i.e., we have a parametric family of priors. In contrast, the NPEB does not assume the functional form to be known. Though NPEB methods are quite powerful, these are more suitable for large sample analyses. To compute the fdr under NPEB setup, we have followed the algorithm proposed by Efron et al. .
To fit a mixture model, EM algorithm is widely used. In case of t distribution the mean parameter and variance component can easily be estimated by EM algorithm assuming that degrees of freedom is known. However when is unknown EM still can be used as demonstrated by Lange, Little and Taylor . But this method appears to be very slow (Liu and Rubin ) and an extension has been proposed by Meng and Rubin  as ECM algorithm. This is a generalization of EM algorithm where the E step remains the same butthe M step is replaced by CM (constrained or conditional maximization) step. ECM algorithm is basically a generalized EM (GEM) as shown by Meng and Rubin . Incidentally, the rate of convergence, in terms of iterations, for this ECM algorithm is slower compared to EM. To overcome this computational problem, Liu and Rubin  propose an efficient algorithm ECME which is again an extension of ECM algorithm. Though this is not a GEM, it converges faster.
and s are independently distributed gamma variables.
then marginally, .
which is the posterior probability that belongs to the k-th component of the mixture based on current fit .
To get an efficient algorithm, let us partition as where contains all the parameters except parameters corresponding to degree of freedom of t-distributions. The above M-step is replaced by two CM-steps, as follows.
CM-Step 1. Keeping fixed, i.e. is fixed at , maximize to get
CM-Step 2. Now fix at and calculate by maximizing
Furthermore to make the algorithm more efficient, after the first CM-step, we replace the E-step with instead of .
To assess the proposed methodology, a small sample simulation study has been performed. This gives an idea whether or not the parameters are well estimated and most importantly, they provide information of false discovery rates.
The True FDR Performance of Controlled FDR in EB Models
True fraction of DE
Nonparametric empirical Bayes
Parametric empirical Bayes
It is evident from the above table that the nonparmateric empirical Bayes is much conservative compared to its parametric alternative. For parametric set up, the true FDR is very much close to the controlled one, whereas, for nonparametric empirical Bayes these values are not so close as the true fraction of DE transcripts increases.
HLC data analysis
We applied the empirical Bayes model to analyze a sequencing data publicly available. In the current study, we have started with liver tissue data of 213 Caucasian samples from apreviously described human liver cohort (LHC) (Yang et al. ). To get the genotypes and gene expression profiles, DNA and RNA have been isolated. Illumina platform is used to get the expressions. After putting some filtration (MAF>5%, HWE<10-5,) we are left with 173 samples, 472,000 SNPs and 30,000 expressions.
Number of eQTL pairs after crossing the threshold of FDR
No. of SNPs (FDR<10%)
No. of cis-SNP
No. of cis-eSNP (FDR<10%) by Yang et al. (2010)
In contrast to previously available methods based on p-values, the empirical Bayes method uses local false discovery rate (lfdr) as the threshold. This method controls false positive rate. For a particular SNP, the lfdr is computed for the site-specific evidence whereas the FDR averages over other sites with stronger evidence. There are some limitations of using FDR which may result in misleading inferences in genome studies. In such a situation, it is better to use lfdr which is a bit difficult to estimate compared to FDR.However there is still one computational problem which needs much attention. Due to the high dimensionality in the data, sometimes existing algorithms fail. This necessitates the need to find some more efficient algorithms. The choice of threshold FDR value is an important deciding factor in such studies. It would be interesting to see, how number of cis-SNPs vary with the change in FDR threshold. In this way FDR criterion can be used to estimate number of SNPs that we may need to consider.
This work is supported by the U.S. National Institutes of Health grants R01 GM74217 (Lang Li) and AHRQ Grant R01HS019818-01 (MalazBoustani)
The publication costs were funded by the authors through P50 CA113001 (Huang, T.M.), R01 GM088076 (Skaar, T.), R01 HS019818 (Dexter).
This article has been published as part of BMC Genomics Volume 14 Supplement 8, 2013: Selected articles from the International Conference on Intelligent Biology and Medicine (ICIBM 2013): Genomics. The full contents of the supplement are available online at http://0-www.biomedcentral.com.brum.beds.ac.uk/bmcgenomics/supplements/14/S8.
- Liu , Chunyu : Brain expression quantitative trait locus mapping informs genetic studies of psychiatric diseases. Neurosci Bull. 2011, 27 (2): 123-133. 10.1007/s12264-011-1203-5.PubMedPubMed CentralView ArticleGoogle Scholar
- Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological). 1995, 289-300.Google Scholar
- Efron B, Storey J, Tibshirani R: Microarrays, empirical Bayes methods, and false discovery rates. Stanford Technical Report. 2001Google Scholar
- Efron B, Tibshirani R, Storey JD, Tusher V: Empirical Bayes analysis of a microarray experiment. Journal of the American statistical association. 2001, 96 (456): 1151-1160. 10.1198/016214501753382129.View ArticleGoogle Scholar
- Efron B, Tibshirani R: Empirical Bayes methods and false discovery rates for microarrays. Genetic epidemiology. 2002, 23 (1): 70-86. 10.1002/gepi.1124.PubMedView ArticleGoogle Scholar
- Newton MA, Kendziorski CM, Richmond CS, Blattner FR, Tsui KW: On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. Journal of Computational Biology. 2001, 8: 37-52. 10.1089/106652701300099074.PubMedView ArticleGoogle Scholar
- Lee MLT, Kuo FC, Whitmore GA, Sklar J: Importance of replication in microarray gene expression studies: statistical methods and evidence from repetitive cDNA hybridizations. Proceedings of the National Academy of Sciences. 2000, 97 (18): 9834-9839. 10.1073/pnas.97.18.9834.View ArticleGoogle Scholar
- Kendziorski CM, Zhang Y, Lan H, Attie A: The efficiency of MRNA pooling in microarray experiments. Biostatistics. 2003, 4: 465-477. 10.1093/biostatistics/4.3.465.PubMedView ArticleGoogle Scholar
- Kendziorski CM, Newton MA, Lan H, Gould MN: On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles. Stat Med. 2003, 22: 3899-33914. 10.1002/sim.1548.PubMedView ArticleGoogle Scholar
- Kendziroski CM, Chen M, Yuan M, Lan H, Attie AD: Statistical methods for expression quantitative trait loci (eQTL) mapping. Biometrics. 2006, 62 (1): 19-27. 10.1111/j.1541-0420.2005.00437.x.View ArticleGoogle Scholar
- Gelfond JAL, Ibrahim JG, Zou F: Proximity Model for Expression Quantitative Trait Loci (eQTL) Detection. Biometrics. 2007, 63: 1108-1116. 10.1111/j.1541-0420.2007.00778.x.PubMedView ArticleGoogle Scholar
- Lo K, Gottardo R: Flexible empirical Bayes models for differential gene expression. Bioinformatics. 2007, 23 (3): 328-335. 10.1093/bioinformatics/btl612.PubMedView ArticleGoogle Scholar
- Sánchez-Linares I, Pérez-Sánchez H, Cecilia JM, García JM: High-Throughput parallel blind Virtual Screening using BINDSURF. BMC Bioinformatics. 2012, 13 (Suppl 14): S13-10.1186/1471-2105-13-S14-S13.PubMedPubMed CentralView ArticleGoogle Scholar
- Bergemann TL, Wilson J: Proportion statistics to detect differentially expressed genes: a comparison with log-ratio statistics. BMC Bioinformatics. 2011, 12: 228-10.1186/1471-2105-12-228.PubMedPubMed CentralView ArticleGoogle Scholar
- Ruan L, Yuan M: An Empirical Bayes' Approach to Joint Analysis of Multiple Microarray Gene Expression Studies. Biometrics. 2011, 67 (4): 1617-1626. 10.1111/j.1541-0420.2011.01602.x.PubMedView ArticleGoogle Scholar
- Efron B, Morris C: Combining possibly related estimation problems (with discussion). Journal of the Royal Statistical Society, Series B. 1973, 35: 379-421.Google Scholar
- Efron B, Morris C: Stein's paradox in statistics. Scientific American. 1977, 236: 119-127. 10.1038/scientificamerican0577-119.View ArticleGoogle Scholar
- Bar H, Booth J, Schifano E, Wells MT: Laplace approximated EM microarray analysis: an empirical Bayes approach for comparative microarray experiments. Statistical Science. 2010, 25 (3): 388-407. 10.1214/10-STS339.View ArticleGoogle Scholar
- Wright GW, Simon RM: A random variance model for detection of differential gene expression in small microarray experiments. Bioinformatics. 2003, 19: 2448-2455. 10.1093/bioinformatics/btg345.PubMedView ArticleGoogle Scholar
- Cui X, Hwang JG, Qiu J, Blades NJ, Churchill GA: Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics. 2005, 6 (1): 59-75. 10.1093/biostatistics/kxh018.PubMedView ArticleGoogle Scholar
- Lönnstedt I, Grant S, Begley G, Speed TP: Microarray analysis of two interacting treatments: a linear model and trends in expression over time. 2001, Technical Report, Department of Mathematics, Uppsala University, SwedenGoogle Scholar
- Tai YC, Speed TP: A multivariate empirical Bayes statistic for replicated microarray time course data. The Annals of Statistics. 2006, 34 (5): 2387-2412. 10.1214/009053606000000759.View ArticleGoogle Scholar
- Lonnstedt I, Speed T: Replicated microarray data. StatisticaSinica. 2002, 12: 31-46.Google Scholar
- Newton MA, Kendziorski CM: Parametric empirical Bayes methods for microarrays. The analysis of gene expression data: methods and software. 2003, 254-271.View ArticleGoogle Scholar
- Liu C, Rubin DB: The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika. 1994, 81 (4): 633-648. 10.1093/biomet/81.4.633.View ArticleGoogle Scholar
- Cui X, Churchill GA: Statistical tests for differential expression in cDNA microarray experiments. Genome Biol. 2003, 4 (4): 210-10.1186/gb-2003-4-4-210.PubMedPubMed CentralView ArticleGoogle Scholar
- Noma H, Matsui S: The optimal discovery procedure in multiple significance testing: an empirical Bayes approach. Statistics in Medicine. 2012, 31 (2): 165-176. 10.1002/sim.4375.PubMedView ArticleGoogle Scholar
- Efron B: Robbins, empirical Bayes and microarrays. The annals of Statistics. 2003, 31 (2): 366-378. 10.1214/aos/1051027871.View ArticleGoogle Scholar
- Lange KL, Little RJ, Taylor JM: Robust statistical modeling using the t distribution. Journal of the American Statistical Association. 1989, 84 (408): 881-896.Google Scholar
- Liu C, Rubin DB: The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika. 1994, 81 (4): 633-648. 10.1093/biomet/81.4.633.View ArticleGoogle Scholar
- Meng XL, Rubin DB: Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika. 1993, 80 (2): 267-278. 10.1093/biomet/80.2.267.View ArticleGoogle Scholar
- McLachlan G, Krishnan T: The EM Algorithm and Extensions. Wiley Series in Probability and Statistics. 1997Google Scholar
- Yang X, Zhang B, Lum PY: Systematic genetic and genomic analysis of cytochrome P450 enzyme activities in human liver. Genome Research. 2010, 20 (8): 1020-1036. 10.1101/gr.103341.109.PubMedPubMed CentralView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.