Skip to main content
Download PDF

Volume 21 Supplement 10

Selected articles from the 18th Asia Pacific Bioinformatics Conference (APBC 2020): genomics

Fully automated web-based tool for identifying regulatory hotspots

BMC Genomics volume 21, Article number: 616 (2020) Cite this article

Abstract

Background

Regulatory hotspots are genetic variations that may regulate the expression levels of many genes. It has been of great interest to find those hotspots utilizing expression quantitative trait locus (eQTL) analysis. However, it has been reported that many of the findings are spurious hotspots induced by various unknown confounding factors. Recently, methods utilizing complicated statistical models have been developed that successfully identify genuine hotspots. Next-generation Intersample Correlation Emended (NICE) is one of the methods that show high sensitivity and low false-discovery rate in finding regulatory hotspots. Even though the methods successfully find genuine hotspots, they have not been widely used due to their non-user-friendly interfaces and complex running processes. Furthermore, most of the methods are impractical due to their prohibitively high computational complexity.

Results

To overcome the limitations of existing methods, we developed a fully automated web-based tool, referred to as NICER (NICE Renew), which is based on NICE program. First, we dramatically reduced running and installing burden of NICE. Second, we significantly reduced running time by incorporating multi-processing. Third, besides our web-based NICER, users can use NICER on Google Compute Engine and can readily install and run the NICER web service on their local computers. Finally, we provide different input formats and visualizations tools to show results. Utilizing a yeast dataset, we show that NICER can be successfully used in an eQTL analysis to identify many genuine regulatory hotspots, for which more than half of the hotspots were previously reported elsewhere.

Conclusions

Even though many hotspot analysis tools have been proposed, they have not been widely used for many practical reasons. NICER is a fully-automated web-based solution for eQTL mapping and regulatory hotspots analysis. NICER provides a user-friendly interface and has made hotspot analysis more viable by reducing the running time significantly. We believe that NICER will become the method of choice for increasing power of eQTL hotspot analysis.

Background

Regulatory hotspots are genetic variations that regulate the level of expression of thousands of genes [1,2,3,4]. Finding hotspots can guide us to understand the causes and mechanism of many complex diseases and traits [5]. Thus far, genetic studies have been focused on finding regulatory hotspots using eQTL mapping. However, recent studies have reported that many of the previously identified hotspots do not replicate and that these are “spurious hotspots” induced by various unknown confounding effects such as non-biological effects during sample preparation and expression measurements. Several methods have been proposed to remove these confounding effects [6,7,8,9].

Next-generation Intersample Correlation Emended (NICE) [10] is one such method that has been reported to show superior sensitivity and specificity compared to others. In spite of its advantages, the NICE program is not widely used because of two main drawbacks. NICE is neither very user friendly nor very efficient in terms of the computing performance. It is not user friendly because prior to executing a NICE program, users are required to install several specific packages, create a script file, and perform self-debug. It is also impractical to run NICE on real datasets, as most of the eQTL datasets contain hundreds of thousands of SNPs (Single Nucleotide Polymorphisms), and hotspot analysis tools such as NICE use very complicated statistical models.

To resolve these issues, we introduce a fully automated hotspot analysis program referred to as NICE-Renew (NICER). NICER is created as a web-based tool, where users can activate an analysis by simply clicking and uploading data on the web browser. Besides, users may run NICER on Google Cloud Compute Engine or even download and install the web software as docker image to run NICER web service on their local computers or servers, in which their private data can be processed using their own resources. NICER has enhanced computing performance by incorporating multi-processing concepts in the program, for which the running time reduces linear to the number of processes used. In addition, NICER allows different data formats and provides some visualization tools, which help users better understand their result and provide a fast, more meaningful view in context.

Utilizing a yeast dataset, we show that NICER can be successfully used in an eQTL analysis to identify 29 genuine regulatory hotspots, of which 17 were previously reported elsewhere.

Implementation

In this paper, we introduce a fully automated hotspot analysis tool referred to as NICER, which provides enhanced NICE in the form of a website as well as in the form of downloadable software. The website and the documentation of the program can be accessed from the NICER website:

URL http://cblab.dongguk.edu/NICER/NICE_index.jsp

Fully-automated web-based program

A majority of NICE users are biologists, who may not have the required experience in computer science to run the NICE program. NICER is created as a web-based tool, where users can activate an analysis by simply clicking on the web browser (Fig. 1). The execution is completely hidden from the user, and the user does not need to check each stage of running the program. After the analysis has been completed, NICER automatically sends a hyperlink to the email provided by the user. From the hyperlink, users can download the result file from the server. This means that after uploading the input data to NICER, users do not have to keep their computers running while performing the analysis and that they are notified of the results via e-mail.

Fig. 1
figure 1

NICER website composition. Sequence of instructions to use NICER. (1) Select input data format among PLINK, VCF, and NICE format. (2) Select number of threads to use in the analysis. (3) Enter an email address. (4) Upload required input files. (5) Click submit button to start the analysis. Result file will be provided via email. Users can choose to run the analysis on either the NICER server (A) or GCE (B)

Full size image

Google cloud compute engine

We allow users to run NICER on Google Compute Engine (GCE), which has several advantages as compared to an ordinary high-computing server. The GCE has more computational power to run programs with more threads. It is protected by Google, and suspicious activities are flagged and banned. As GCE is virtually created as a docker container, server hardware components such as CPU, RAM, and HDD can be flexibly modified, which is helpful to increase the number of parallel processes and shorten the execution time if needed. However, because the web service is uploaded to GCE, users may have to consider the sensitivity of the data and additional costs for using GCE, which they can avoid by using the free NICER on our server. For those who want to avoid the process burden of signing up to the Google Cloud service and installing NICER on it, we also provide a Google Cloud Compute Engine server link upon request.

Downloadable NICER

For those who do not want to upload their data onto either our server or the GCE, we provide NICER as a downloadable version. The downloadable NICER is provided as a web software docker image file along with the source code. Users can easily download and install the docker image to run the NICER web service on their local computer or server with a few lines of code. Users do not need to worry about any initial preparation steps for running NICE such as building the running environment, installing specific packages required to run NICE program, creating a script file to run the NICE, or preparing required input data such as t-test statistics, as they are all incorporated and implemented inside the NICER program. NICER and its detailed documentation is provided on the NICER website http://cblab.dongguk.edu/NICER/NICE_index.jsp In addition, users are allowed to alter or update the source code to run alternative tests.

Visualization tools

NICER includes graphic analysis tools to assist with interpreting analysis results. After the eQTL mapping, p-values are provided as a result. To identify the hotspots from the p-values, eQTL map is one of the most commonly used tools for the analysis. eQTL shows the strength of associations between every SNP (x-axis) and gene (y-axis) on 2-dimensional space that helps analyzing patterns of associations at a glance. A plot that shows the average of negative logarithm of p-values is another tool that can help with identifying regulatory hotspots from the p-values. NICER provides these plots as an additional service to the NICE program. Users can upload and use their own p-value tables as well. The results of the plot can be seen in a pop-up page, and the corresponding image is sent to the users’ personal e-mails for safekeeping.

Input data format

NICER allows three input formats of genotype and phenotype for the analysis. In addition to the format for original NICE method, binary PLINK [11] format and VCF, which are the most commonly used formats in Genome-Wide Association Study (GWAS) and eQTL analysis are added. Since data format varies depending on the dataset, input format compatibility in NICER saves time to preprocess the data beforehand. Users can select their data format from the tab inside the website.

Parallel processing

NICER runs on a high-performance computing server and enhances the analysis by implementing parallel processing. Within the NICE algorithm, the value of genome data is calculated in the units of SNPs and as the same algorithm is used for each unit, it could run separately for each SNP in parallel. NICER reduces the execution time by dividing the input matrix data into multiple sets and running them in parallel. As the NICE algorithm is complexly intertwined with different software for each stage, a multi-processing technique is used instead of multi-threading. Thus, the web server splits the input data into multiple sets and creates processes to run NICE, and the web engine keeps track of each process. Parallel processing shortens the execution time considerably as compared to the original NICE method.

Results and discussion

Performance analysis

NICER has shown significant improvement in terms of performance and user friendliness.

As shown in Fig. 2, the execution time decreases significantly when more threads are used. The results shown here are those obtained for an evaluation of a renowned yeast dataset [12]. The running time reduces linearly to the number of processes used; thus when the number of computing processes used is doubled, the execution time halves. Furthermore, the number of SNPs did not have any effect on the reduction of execution time, which could be attributed to multi-threading. NICER can reduce running time from 8 months to less than 3 days in an analysis of the yeast data of 42,052 SNPs and 5720 genes [12], utilizing 1000 processes in parallel.

Fig. 2
figure 2

Time performance comparison between NICE and NICER. Using different numbers of threads, the x-axis corresponds to the number of SNPs analyzed and the y-axis corresponds the running time in hours. The yeast dataset is used for the test. The blue, orange, and gray bars show the performance of NICE, NICER using five processes, and NICER using 10 processes. The performance of the rightmost three bars are extrapolated from the results of 1000 SNPs

Full size image

NICER analysis using the yeast dataset

We evaluated the proposed method by using a yeast dataset that contains 1012 meiotic segregants with 5720 genes and 42,052 SNPs [12]. After adjusting for batch effects and the growth covariate by using the ComBat method in the SVA R package [13], a significant number of eQTLs were identified on the basis of the NICER p-value of < 5 × 10− 5 (Fig. 3A). SNPs that regulate genes within 10 kb were defined as cis-eQTL.The thresholds for identifying the regulatory hotspots were based on a binominal test with the Bonferroni-corrected p-values of < 0.05/total number of SNPs (42,052). We estimated that the number of eQTL in each SNP followed a binomial distribution with the parameters n = total number of eQTLs except for cis-eQTLs across the whole genome and p = 1/42,052, which denotes the equal probability of eQTL in each SNP. If these SNPs had significantly more eQTLs than expected by chance, the genetic positions corresponding to the SNPs were defined as regulatory hotspots. To determine the putative regulators for a given hotspot, the cis-eQTL genes in the corresponding hotspot regions were regarded as the causal regulators. Next, we divided the whole genome of the Yeast into 602 20-kb bins to compare with the results of other studies related to Yeast eQTL hotspots [14,15,16,17,18,19,20]. If the neighboring bins had eQTL hotspots, then the bins were merged into a single bin and a gene. The results showed that among the 29 identified hotspots, 17 eQTL hotspots had been previously identified (Fig. 3 and Table 1).

Fig. 3
figure 3

Hotspot identification of the yeast dataset. a The eQTL map showing the significant eQTLs across the whole genome. The x-axis corresponds to the SNP positions, and the y-axis corresponds to the gene positions. b The number of eQTLs (linkages) plotted in genome location. The numbers show the identified eQTL hotspots (Table 1). The dashed red line represents the threshold, and the asterisks indicate the previously identified hotspots [14,15,16,17,18,19,20]

Full size image
Table 1 Results of hotspots identified by NICER using the yeast dataset. Putative regulators identified by previous studies are denoted in boldface [14,15,16,17,18,19,20]
Full size table

Conclusions

NICER is a user-friendly web application to effectively identify eQTL hotspots. By reducing the installation steps and hiding the complicated running steps from the users, NICER lowers the entry barrier from non-computer experts to use eQTL analysis. NICER can be easily accessed through the Internet and the NICER web service could be run not only on the top of the NICER server but also on the Google Compute Engine or users’ local computers with a very simple installing process. Moreover, NICER provides useful tools that visualize analysis results. Applying NICER on the yeast dataset, we effectively found many hotspots, where more than half of the hotspots contain putative regulators reported by previous studies elsewhere.

Availability and requirements

Project name: NICER

Project home page: http://cblab.dongguk.edu/NICER/NICE_index.jsp

Operating system: CentOS7

Programming Language: Java, R

Other requirements: Apache Tomcat 9

License:

Any restrictions to use by non-academics: permission by the author

Availability of data and materials

Not applicable.

Abbreviations

eQTL:

Expression quantitative trait loci

GCE:

Google Compute Engine

GWAS:

Genome-Wide Association Study

NICE:

Next-Generation Intersample Correlation Emended

SNP:

Single-nucleotide polymorphisms

VCF:

Variant call format

References

  1. Brem RB, Kruglyak L. The landscape of genetic complexity across 5,700 gene expression traits in yeast. Proc Natl Acad Sci U S A. 2005;102(5):1572–7.

    Article  CAS  Google Scholar 

  2. Keurentjes JJB, Fu J, Terpstra IR, Garcia JM, van den Ackerveken G, Snoek LB, Peeters AJM, Vreugdenhil D, Koornneef M, Jansen RC. Regulatory network construction in Arabidopsis by using genome-wide gene expression quantitative trait loci. Proc Natl Acad Sci U S A. 2007;104(5):1708–13.

    Article  CAS  Google Scholar 

  3. Chesler EJ, Lu L, Shou S, Qu Y, Gu J, Wang J, Hsu HC, Mountz JD, Baldwin NE, Langston MA, Threadgill DW, Manly KF, Williams RW. Complex trait analysis of gene expression uncovers polygenic and pleiotropic networks that modulate nervous system function. Nat Genet. 2005;37(3):233–42.

    Article  CAS  Google Scholar 

  4. Cheung VG, Spielman RS, Ewens KG, Weber TM, Morley M, Burdick JT. Mapping determinants of human gene expression by regional and genome-wide association. Nature. 2005;437(7063):1365–9.

    Article  CAS  Google Scholar 

  5. Westra HJ, Franke L. From genome to function by studying eQTLs. Biochim Biophys Acta. 2014;1842(10):1896–902.

    Article  CAS  Google Scholar 

  6. Kang HM, Ye C, Eskin E. Accurate discovery of expression quantitative trait loci under confounding from spurious and genuine regulatory hotspots. Genetics. 2008;180(4):1909–25.

    Article  CAS  Google Scholar 

  7. Leek JT, Storey JD. Capturing heterogeneity in gene expression studies by surrogate variable analysis. PLoS Genet. 2007;3(9):1724–35.

    Article  CAS  Google Scholar 

  8. Listgarten J, Kadie C, Schadt EE, Heckerman D. Correction for hidden confounders in the genetic analysis of gene expression. Proc Natl Acad Sci U S A. 2010;107(38):16465–70.

    Article  CAS  Google Scholar 

  9. Fusi N, Stegle O, Lawrence ND. Joint modelling of confounding factors and prominent genetic regulators provides increased accuracy in genetical genomics studies. PLoS Comput Biol. 2012;8(1):e1002330.

    Article  CAS  Google Scholar 

  10. Joo JWJ, Sul JH, Han B, Ye C, Eskin E. Effectively identifying regulatory hotspots while capturing expression heterogeneity in gene expression studies. Genome Biol. 2014;15(4):r61.

    Article  Google Scholar 

  11. Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MAR, Bender D, Maller J, Sklar P, de Bakker PIW, Daly MJ, Sham PC. PLINK: a toolset for whole-genome association and population-based linkage analysis. Am J Hum Genet. 2007;81(3):559–75.

    Article  CAS  Google Scholar 

  12. Bloom JS, Ehrenreich IM, Loo WT, Lite TL, Kruglyak L. Finding the sources of missing heritability in a yeast cross. Nature. 2013;494(7436):234–7.

    Article  CAS  Google Scholar 

  13. Johnson WE, Li C, Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2007;8(1):118–27.

    Article  Google Scholar 

  14. Yvert G, Brem RB, Whittle J, Akey JM, Foss E, Smith EN, Mackelprang R, Kruglyak L. Trans-acting regulatory variation in Saccharomyces cerevisiae and the role of transcription factors. Nat Genet. 2003;35(1):57–64.

    Article  CAS  Google Scholar 

  15. Brem RB, Yvert G, Clinton R, Kruglyak L. Genetic dissection of transcriptional regulation in budding yeast. Science. 2002;296(5568):752–5.

    Article  CAS  Google Scholar 

  16. Zhu J, Zhang B, Smith EN, Drees B, Brem RB, Kruglyak L, Bumgarner RE, Schadt EE. Integrating large-scale functional genomic data to dissect the complexity of yeast regulatory networks. Nat Genet. 2008;40(7):854–61.

    Article  CAS  Google Scholar 

  17. Lee SI, Dudley AM, Drubin D, Silver PA, Krogan NJ, Pe'er D, Koller D. Learning a prior on regulatory potential from eQTL data. PLoS Genet. 2009;5(1):e1000358.

    Article  Google Scholar 

  18. Curtis RE, Kim S, Woolford JL Jr, Xu W, Xing EP. Structured association analysis leads to insight into Saccharomyces cerevisiae gene regulation by finding multiple contributing eQTL hotspots associated with functional gene modules. BMC Genomics. 2013;14(1):196.

    Article  CAS  Google Scholar 

  19. Lin L, Chen Q, Hirsch JP, Yoo S, Yeung K, Bumgarner RE, Tu Z, Schadt EE, Zhu J. Temporal genetic association and temporal genetic causality methods for dissecting complex networks. Nat Commun. 2018;9(1):3980.

    Article  Google Scholar 

  20. Albert FW, Bloom JS, Siegel J, Day L, Kruglyak L. Genetics of trans-regulatory variation in gene expression. Elife. 2018;7:e35471.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

About this supplement

This article has been published as part of BMC Genomics Volume 21 Supplement 10, 2020: Selected articles from the 18th Asia Pacific Bioinformatics Conference (APBC 2020): genomics. The full contents of the supplement are available online at https://0-bmcgenomics-biomedcentral-com.brum.beds.ac.uk/articles/supplements/volume-21-supplement-10

Funding

This research and the publication costs were supported by R&D program for Advanced Integrated-intelligence for IDentifiacation (AIID) through the National Research Foundation of Korea (NRF) funded by Ministry of Science and ICT (NO. 2018M3E3A1057288); by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (No. 2017R1C1B5017497). The funding body did not play any role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Author notes

  1. Ju Hun Choi and Taegun Kim contributed equally to this work.

Authors and Affiliations

  1. Department of Computer Science and Engineering, Dongguk University-Seoul, Seoul, 04620, South Korea

    Ju Hun Choi, Taegun Kim & Jong Wha J. Joo

  2. Department of Life Science, Dongguk University-Seoul, Seoul, 04620, South Korea

    Junghyun Jung

Authors
  1. Ju Hun Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taegun Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junghyun Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jong Wha J. Joo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JHC made substantial contributions to the conception and development of the acquisition, analysis of bioinformatics data, and to drafting manuscript. TGK also contributed to the conception and development of the acquisition and drafting manuscript. JJ made substantial contributions to the analysis, the interpretation of bioinformatics data, and the drafting the manuscript. JWJ made contributions to the overall conception of the acquisition and critical revisions in terms of intellectual content and gave final approval of the version to be published. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Jong Wha J. Joo.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Choi, J.H., Kim, T., Jung, J. et al. Fully automated web-based tool for identifying regulatory hotspots. BMC Genomics 21 (Suppl 10), 616 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12864-020-07012-z

Download citation

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12864-020-07012-z

Keywords

BMC Genomics

ISSN: 1471-2164

Contact us