Skip to main content

Evaluating the accuracy of Listeria monocytogenes assemblies from quasimetagenomic samples using long and short reads

Abstract

Background

Whole genome sequencing of cultured pathogens is the state of the art public health response for the bioinformatic source tracking of illness outbreaks. Quasimetagenomics can substantially reduce the amount of culturing needed before a high quality genome can be recovered. Highly accurate short read data is analyzed for single nucleotide polymorphisms and multi-locus sequence types to differentiate strains but cannot span many genomic repeats, resulting in highly fragmented assemblies. Long reads can span repeats, resulting in much more contiguous assemblies, but have lower accuracy than short reads.

Results

We evaluated the accuracy of Listeria monocytogenes assemblies from enrichments (quasimetagenomes) of naturally-contaminated ice cream using long read (Oxford Nanopore) and short read (Illumina) sequencing data. Accuracy of ten assembly approaches, over a range of sequencing depths, was evaluated by comparing sequence similarity of genes in assemblies to a complete reference genome. Long read assemblies reconstructed a circularized genome as well as a 71 kbp plasmid after 24 h of enrichment; however, high error rates prevented high fidelity gene assembly, even at 150X depth of coverage. Short read assemblies accurately reconstructed the core genes after 28 h of enrichment but produced highly fragmented genomes. Hybrid approaches demonstrated promising results but had biases based upon the initial assembly strategy. Short read assemblies scaffolded with long reads accurately assembled the core genes after just 24 h of enrichment, but were highly fragmented. Long read assemblies polished with short reads reconstructed a circularized genome and plasmid and assembled all the genes after 24 h enrichment but with less fidelity for the core genes than the short read assemblies.

Conclusion

The integration of long and short read sequencing of quasimetagenomes expedited the reconstruction of a high quality pathogen genome compared to either platform alone. A new and more complete level of information about genome structure, gene order and mobile elements can be added to the public health response by incorporating long read analyses with the standard short read WGS outbreak response.

Background

State of the art for pathogen typing

Rapid response, whole-genome sequencing (WGS) networks such as GenomeTrakr [1], PulseNet [2], and the National Antimicrobial Resistance Monitoring System (NARMS) [3, 4] have revolutionized the strain typing and source attribution of bacterial pathogens and antimicrobial resistance (AMR) important to human and animal health. These programs have relied primarily on high throughput short-read sequencing data generated using the Illumina MiSeq platform. Accurate strain typing of bacterial pathogens using short reads is typically accomplished with SNP (single nucleotide polymorphism) and/or MLST (multi-locus sequence typing) analyses. Both can be performed directly on the raw reads or with assemblies of the raw reads. SNP analyses quantify the number of SNPs between a set of isolates and a reference genome [5]. High resolution MLST analyses involve identifying the profile of alleles for genes in the core genome and whole genome [6, 7], cgMLST and wgMLST, respectively. Both methods can differentiate between very closely related strains of Salmonella enterica, Listeria monocytogenes, Escherichia coli, Staphylococcus aureus and many other pathogens [8,9,10]. However, despite providing high resolution, SNP and cgMLST/wgMLST analyses do not analyze nor require the entire genome assembly and, thus, miss aspects of genome architecture, such as the synteny of features and mobile elements with variable gene content [11].

The assembly of genomes using short and long reads

Ideally, complete genomes would be routinely sequenced and assembled de novo from outbreak samples for strain typing analyses. However, this is not yet possible in every situation. Although short reads can be sequenced with an error rate of less than 0.1% [12], these reads are typically 250 base pairs or less in length and cannot span many genomic repeat regions, resulting in fragmented assemblies that preclude the recovery of complete bacterial genomes [13]. In contrast, long read sequencing technologies like the Oxford Nanopore platform have higher sequencing error rates (~ 13% [14, 15]), but can routinely produce reads that are over 10 Kbp, thus spanning genomic repeats and supporting the assembly of complete bacterial genomes and plasmids [16].

Although assemblies of nanopore long reads can generate genome-length contigs, they often have a large number of errors inherited from the reads. The hybrid assembly of Illumina short and nanopore long reads can remarkably improve the quality of the assemblies while maintaining syntenic contiguity [16]. A study of the assembly of several Salmonella enterica strains demonstrated that short read assembly followed by long read scaffolding, reconstructed genomes more accurately than using short reads or long reads alone [17]. Another study reconstructed entire genomes of Shiga-toxin producing Escherichia coli strains using nanopore long reads that were polished with Illumina short reads [18]; however, these assemblies had less accurate cgMLST typing compared to those using only MiSeq short reads, despite the short read polishing.

Microbiological recovery of the target pathogen

Irrespective of sequencing technology, for applications such as the source tracking of bacterial pathogens, a fundamental challenge is the extraction of sufficient quantities of pathogen DNA to sequence in the first place. This is because pathogens frequently occur at low abundance in complex microbial communities, sometimes amongst large numbers of host cells, and/or in chemically challenging matrices. Current methods address this challenge by selective culture enrichment and pure colony isolation of the pathogens prior to sequencing and analysis. This approach however, is labor-intensive and can take days to weeks to provide sufficient DNA for sequencing. While protocols and media formulations for the enrichment of L. monocytogenes vary only slightly between agencies (Food and Drug Administration (FDA), International Organization of Standardization (ISO), and the United States Department of Agriculture (USDA)), in-house FDA metagenomic and quasimetagenomic analyses of timepoints along recovery continuums from different starting matrices have demonstrated that enrichment dynamics and efficiencies vary according to chemical and microbiological features of the input matrix (ie; different foods such as fresh produce, poultry, complex environmental samples, and varying initial loads (CFUs) of target pathogens) [19]. Community dynamics during all types of pathogen enrichments (e.g. Salmonella enterica, Escherichia coli, Listeria spp.) are still poorly understood and co-enriching non-target species often compete with pathogens of clinical significance [20].

Metagenomics

Metagenomics is the direct sequencing of microbial communities [21] and, in theory, could replace culture enrichment for pathogen source tracking. Short read sequencing has been used extensively for metagenomics due to low error rates and high throughput, but cannot assemble many of the genomic and intergenomic repeats present in environmental DNA. In contrast, the long reads generated by nanopore sequencing platforms can resolve many of the genomic and intergenomic repeats. Recently, metagenomic studies have successfully used nanopore sequencing for rapid identification of dominant pathogens [22, 23] contributing complete assemblies for a small subset of the bacteria in the full metagenome [13, 24, 25]. However, achieving sufficient depth of coverage to assemble pathogen genomes directly from metagenomes is often prohibitively expensive.

Quasimetagenomics

A middle ground between the direct sequencing of samples and the sequencing of isolates from selective enrichments is quasimetagenomics, the sequencing of abbreviated recovery enrichments [13, 26]. Quasimetagenomics has been used by FDA scientists since 2009 in efforts to recover pathogens from complex microbiomes such as outbreaks of Salmonella in tomatoes [27, 28], to better understand Latin cheese microbiota [29], to look at enrichments for Salmonella from cilantro [30], E.coli in flour [31], pathogens in seafood [32,33,34] and in the public health research response to the Blue Bell ice cream outbreak of 2015, which resulted in the dataset presented here [20, 26]. The first FDA ice cream work (2015) received a lot of attention in the food safety community and the quasimetagenomic approach was quickly emulated by other food safety research groups [26, 35, 36]. Many groups are moving the needle forward–demonstrating that strain level differentiation during an outbreak response can be achieved more rapidly with quasimetagenomic approaches [35, 36]. Here we build upon the first ice cream report [20] which demonstrated that a quasimetagenomic approach could recover the same quality of source tracking data much earlier than state of the art WGS approaches; and a second work which validated the bioinformatic SNP and cgMLST source tracking efficiency of the quasimetagenomic data [26]; and–presented here–the added value of GridIon long reads for circularization of genomes and plasmids.

Integrated microbiological, molecular and bioinformatic innovations that will move the field forward

Here, we provide a detailed benchmarking analysis for assessing how rapidly and accurately a targeted pathogen, L. monocytogenes, can be assembled from quasimetagenomic samples using short and long read sequencing technologies. The evaluated assembly tools include those developed specifically for metagenomic assemblies (MegaHit for short read assembly, metaFlye for long read assembly, and Opera-MS for hybrid assembly) as well as popular tools developed for long read genome assembly (Canu and Redbean) and hybrid genome assembly (HybridSpades). Additionally, we evaluated the impact of polishing with three tools: Pilon, ntEdit (both were used to polish long read assemblies with short reads), and Racon (was used to polish long read assemblies with long reads). The results of this study allowed us to point out the strengths and weaknesses in currently available tools and to make recommendations for future research.

Results

Characteristics of the sequencing data

The GridIon nanopore instrument generates sequencing data in batches of 4000 reads, denoted here as Bn for the nth batch. The first 30 batches of GridIon reads, at each enrichment time, were used for this study, i.e., the first 120,000 reads corresponding to batches B1, B2, …,B30 (Fig. 1). To analyze the quality of assemblies as a function of increased sequencing depth, each successive batch of reads was combined with the previous batches for assembly to form “cumulative batches”, denoted as C1, C2,...,C30, where Cn = B1 + B2 + ... + Bn (Fig. 1). To compare assembly results strictly based on sequencing technology, the number of base pairs for the MiSeq and GridIon data was normalized. Over a range of sequencing depths, MiSeq raw read files were partitioned into 30 corresponding batches of read pairs to match the cumulative batches by number of base pairs for GridIon reads. Table 1 records the total number of sequenced bases per C30 at each enrichment time.

Fig. 1
figure 1

The effective time required to sequence and analyze the quasimetagenomic samples. The blue circles marked as 24H, 28H, 32H, 36H, and 40H denote the five enrichment time points where the quasimetagenomic samples were collected and sequenced with the Illumina MiSeq (short read) and the Oxford Nanopore GridIon (long read). Diamonds represent the 30 batches (B1 to B30) of 4000 GridIon reads, each generated 45 min apart. For our analysis, reads from each batch were merged with previously obtained batches to form cumulative batches (Ci). The time taken to assemble the reads is shown with boxes labeled ‘A’. C18 at 24H marks the earliest time point where a complete Listeria monocytogenes genome was reconstructed (with metaFlye). The green circle corresponds to the time required to culture and sequence a pure colony isolate of Listeria monocytogenes i.e. 144 h. Note: bioinformatic analysis can be performed in “real-time” on the GridIon batches as they are output whereas an Illumina MiSeq sequencing run must finish before the bioinformatics can begin. However, for our analysis we partitioned the reads from each MiSeq run into 30 batches—each composed of an equal number of sequenced bases as the GridIon batches

Table 1 Summary of sequence data for C30 at each enrichment time

The mean read length for C30 across enrichment time points ranged from 174 to 198 nucleotides for Illumina MiSeq and 1923 to 4445 nucleotides for Oxford Nanopore GridIon. The longest sequenced GridIon read was 69,402 nucleotides long (Table 2). For the GridIon, there was a general increase in the mean and maximum read length as the enrichment time increased. Furthermore, the reads that mapped to the L. monocytogenes reference genome had a longer mean and maximum length compared to the rest of the reads across all enrichment time points (Supplementary Figure 1). The putative L. monocytogenes reads also had a much lower mean GC content (38%) compared to the rest of the reads (49–54%) across enrichment time points (Supplementary Figure 2).

Table 2 GridIon read length and sequencing error statistics for C30

The sequencing error rate for the reads mapping to the L. monocytogenes reference genome was 0.03% for the MiSeq reads and between 6.3 and 18% for the GridIon reads. The GridIon sequencing error rate has a range based upon whether the soft-clipping of read alignments (i.e. the ends of the reads not included in the alignment range) was included as error or not. Each read is thus assigned two error estimates: an upper estimate of error that treats the unaligned portion of the read as an error, and a lower estimate that relies solely on the errors identified within the aligned range. Insertions, deletions, and mismatches were only counted for the aligned portion of the reads i.e. excluding the soft-clipped regions. For the long reads, 29.6%, 25.4%, and 45% of the errors were due to mismatches, insertions, and deletions, respectively—in accordance with previously published results [14]. For the MiSeq, the sequencing error rate and mean base quality were relatively uniform across samples. For the GridIon, the estimated sequencing error rate range decreased from 24H (7% to 18%) to 40H (6.3% to 13%) while the mean per-base quality score slightly increased over the same time period, from 21.83 to 23.19, respectively.

Selection of the reference genome

The accuracy of the assemblies was assessed with respect to a complete reference genome that had been isolated and sequenced (PacBio SMRT technology) from ice cream samples from the same facility as used for our analysis [37]. The reference was treated as a “gold standard” with an expected accuracy of ~ 99.999% [38]. Previous research had shown that the outbreak consisted of two strains. One that was only isolated from Facility 1 and another that was mainly isolated from Facility 2 [37]. The ice cream samples used for our analysis came from Facility 1. The reference genome used here had been used as a reference for SNP analysis of the isolates from Facility 1, showing they differed by 29 SNPs or fewer. Another reference genome, from Facility 2, had been used as the representative of the second strain. The C30 MegaHit quasimetagenome assemblies showed a higher similarity with the reference from Facility 1 than Facility 2 (mean Mash [39] distance: 0.0206 and 0.0218 respectively). The reference from Facility 1 was subsequently used for our analysis.

The similarity between the L. monocytogenes contigs derived from the quasimetagenomes and the reference sequence was assessed, and 55 loci were identified (46 single nucleotide insertions, 2 di-nucleotide insertions, and 5 single nucleotide polymorphisms) that differed at all enrichment times. Four of these variants (1 single nucleotide polymorphism and 3 single nucleotide insertions) occurred within the core of the L. monocytogenes genome (see Methods for a description of how the core was defined).

Assessing the presence of multiple L. monocytogenes strains

The presence of multiple, closely-related L. monocytogenes strains in the quasimetagenomes could affect the accuracy of the assemblies. A prior analysis of the ice cream samples [20] had identified three putative co-occurring L. monocytogenes strains based upon the detection of three 16S rRNA gene variants. However, analysis of the 16S rRNA genes in the reference genome identified 6 copies of the 16S rRNA operon which clustered, by sequence, within three distinct clusters consistent with the originally-determined variants.

The presence of multiple strains in the quasimetagenomes was assessed and 586 loci were identified (75 within the core genes) where the pile-up of MiSeq reads indicated the presence of two alleles, i.e. the reference allele and a variant. The percent of reads supporting the variants had a normal distribution with a mean of 17% and a standard deviation of 4%—indicating a 5:1 ratio of relative abundance. This evidence suggests that two highly-clonal strains co-occur in our quasimetagenomic samples.

General quasimetagenome assembly statistics

Ten assembly approaches were tested (Table 3), which were grouped into four broad categories: short read, long read, short read hybrid and long read hybrid. For simplicity, a tool was defined as a hybrid assembly approach if it used both short and long reads whether it be short read assemblies that get scaffolded with long reads (short read hybrid) or long read assemblies that get polished with short reads (long read hybrid).

Table 3 The ten assembly approaches tested

All assembly approaches had a mean runtime (for the full set of reads, C30, across enrichment times) of approximately 40 min or less (Table 4) except Canu which had a mean runtime of 98 min per sample. The fastest assembly approach was Redbean with a mean runtime of just one minute (Supplementary Figure 3).

Table 4 Mean assembly statistics (C30 at each enrichment time) for each assembly approach

The contiguity of the assemblies was measured using several metrics: the total assembly length (Supplementary Figure 4), number of contigs (Supplementary Figure 5), N50 (Supplementary Figure 6), and longest contig assembled (Supplementary Figure 7). The mean values for C30 across enrichment times for each contiguity metric are described in Table 4. Approaches that first assemble short reads (short read and short read hybrid assemblies) contrasted substantially with those that first assemble long reads (long read and long read hybrid assemblies) having consistently longer total assembly lengths, orders of magnitude more contigs, lower N50s, and shorter longest contigs. In general, as the enrichment of L. monocytogenes progressed, there was a general decrease in the number of contigs and total assembly size (Supplementary Figures 4 and 5).

As expected, the long read and long read hybrid assemblies had the highest N50 values and the longest contigs—often near the reference genome length for L. monocytogenes (~ 3 Mbp). Amongst the long read assembly tools, the metagenome assembler metaFlye consistently produced the highest N50 values with the longest contigs nearest to the length of the L. monocytogenes reference genome (Table 4); however, the differences between long read assembly tools decreased with enrichment.

In contrast, the short read and short read hybrid assemblies had low N50 values and the longest contigs assembled were consistently shorter (often by orders of magnitude) with little to no increase beyond 60X depth of coverage. Opera-MS, using reference-guided scaffolding, was the main exception, assembling contigs of 2 Mbp or more at all enrichment time points.

Taxonomic composition of the quasimetagenomic samples

The number of species identified in the assemblies ranged from 2 to 10 with the short read and short read hybrid assemblies containing more species than the long read and long read hybrid assemblies (Fig. 2). The number of species decreased with enrichment time, and L. monocytogenes and Rothia mucilaginosa were the only species detected at all time points. Bacillus cereus was the most closely related species to L. monocytogenes detected in the quasimetagenomes (both species are members of the order Bacillales).

Fig. 2
figure 2

Taxonomic classification of cumulative batch 30 from each enrichment time point. For clarity, only the short read MegaHit and long read metaFlye assemblies were plotted (short read assembly results mirrored short read hybrid assemblies and long read assemblies mirrored long read hybrid assemblies). a The total bp of contigs per species (must have a minimum of 5000 bp) classified by Kraken. b Species in sample, excluding L. monocytogenes, R. mucilaginosa and unclassified sequences highlights how the short read assemblies capture more species than the long read assemblies

L. monocytogenes was the most abundant species at all times and its abundance increased with enrichment time, but the abundance estimates differed for the MiSeq and GridIon (Table 5). At 24H, 33% and 60% of the MiSeq and GridIon reads, respectively, mapped to the L. monocytogenes reference genome. At 40H, 92% and 97% of the MiSeq and GridIon reads respectively, mapped to the reference genome.

Table 5 Percent of reads that map to the L. monocytogenes reference genome

Reconstruction of the L. monocytogenes genome from the quasimetagenomes

The most contiguous recovery of the L. monocytogenes genome, as measured by the mean NG50 across enrichment time points (only using C30 at each time point), was by long read and long read hybrid assembly approaches (Fig. 3). For the long read assemblers Canu, Redbean, and metaFlye the mean NG50 values were 1,535,966 bp, 1,568,760 bp, and 2,490,733 bp, respectively. Because metaFlye assembled genome-length contigs for L. monocytogenes the most consistently of the long read assemblers, only the metaFlye assemblies were used for the long read hybrid assemblies. The long read hybrid approaches (using metaFlya and Racon in combination with Pilon or ntEdit) slightly decreased the mean NG50 of the metaFlye assemblies, 2,477,272 bp, 2,478,715 bp, 2,478,772 bp, respectively.

Fig. 3
figure 3

The NG50 versus the total number of base pairs sequenced per cumulative batch for the assembled L. monocytogenes contigs at each of the enrichment time points for each assembly approach. (Abbreviations: SR = short read, LR = long read, HY = hybrid)

The short read Megahit assemblies had the smallest mean NG50 at 162,346 bp. The short read hybrid assemblies of HybridSpades and Opera-MS without reference-guided scaffolding had mean NG50’s that were several fold higher than the Megahit assemblies, 431,211 bp and 375,881 bp, respectively. Opera-MS, using reference-guided scaffolding, had a mean NG50 of 1,414,301 bp, nearly an order of magnitude higher than Megahit and close to that of the long read assembler Canu.

Only the long read assemblers were able to assemble genome-length contigs (over 3 million bp) for L. monocytogenes. The earliest complete reconstruction of the L. monocytogenes genome was at 24H and C18 with metaFlye (33X depth of coverage of the L. monocytogenes genome), 24H and C22 with Canu (40X depth of coverage of the L. monocytogenes genome), and 28H and C16 with Redbean (47X depth of coverage of the L. monocytogenes genome). The genome length contigs, irrespective of the long read assembly approach, were frequently up to tens of thousands of base pairs longer than the reference genome, mainly due to over-circularization of the assembly by a read length or less. Additionally, each long read assembler recovered a circularized 71 kbp putative L. monocytogenes plasmid that was always fragmented in the short read assemblies. The best BLAST hits within the NCBI nt database for the assembled plasmid were to known L. monocytogenes plasmids (NCBI accessions CP053631.1 and CP044431.1). The plasmid was not found to host any known resistance or virulence genes.

Assembly errors in the L. monocytogenes genomes reconstructed from the quasimetagenomes

Quast was used to compare the mean number of misassemblies, mismatches per 100 Kbp, and indels (insertions and deletions) per 100 Kbp in the L. monocytogenes contigs for each assembly approach, given the highest sequencing depth of coverage of the quasimetagenomes (i.e. C30) across enrichment times (Fig. 4). The number of misassemblies and mismatches varied more by tool than assembly strategy. The mean number of misassemblies ranged from 10.8 (Canu) to 0 (HybridSpades). The mean number of mismatches per 100 Kbp ranged from 31.8 (Redbean) to 1.2 (metaFlye). In contrast, the long read assembly approaches had a pronounced indel rate versus other approaches, ranging from 265 (Canu) to 481 (metaFlye). The combination of metaFlye with Racon substantially reduced the number of indels to 74 per 100 kbp. Combining short read and long read information with long read hybrid assembly approaches further reduced the number of indels to ~ 3 per 100 kbp. Short read assembly/short read hybrid assembly approaches had the lowest indel rate of around 1 to 2 per 100 kbp.

Fig. 4
figure 4

The quality of assembled contigs annotated as L. monocytogenes, with respect to the reference genome, using Quast for cumulative batch 30 at each of the enrichment time points. The number of mismatches, insertion/deletion (indels), and misassemblies per 100 kbp for each assembly approach. (Abbreviations: SR = short read, LR = long read, HY = hybrid)

Accuracy of the L. monocytogenes metagenome-assembled genomes

At all enrichment time points and C30 reads (for both short and long reads), there was 100% breadth of coverage of the L. monocytogenes reference genome and up to ~160X depth of coverage.

The fraction of the L. monocytogenes genome that was typeable by the MiSeq and GridIon reads was assessed by identifying regions in the reference genome where the C30 reads mapped ambiguously (i.e. mapped with the same alignment score to multiple genome locations). For the MiSeq and GridIon reads, a median of 3.9% (118,615 bp) and 0% (0 bp), respectively, of the reference genome consisted of ambiguous regions.

Earlier results provided evidence for the presence (with a 5:1 relative abundance ratio) of two strains of L. monocytogenes in the quasimetagenomes. The less abundant strain differed from the more abundant strain at 586 loci. Analysis with Snippy showed that no more than 13 of the 586 variants in the low abundance strain were present in a given C30 assembly (across enrichment times). However, the long read assemblies contained the highest median number of variants (maximum was 12 with metaFlye) while the other assembly approaches had a median of 3 or less.

Next, the accuracy of the assemblies (C1 to C30 at each enrichment time) was assessed by calculating the BLAST distance between the core genes (Fig. 5) and the complete set of genes (Fig. 6) of the reference genome and the L. monocytogenes contigs. As defined earlier, the BLAST distance is a measure of sequence similarity equalling the number of mismatches, insertions, and deletions in the BLAST alignment between the reference genes and the assembled genes. The short read and short read hybrid assemblies attained the smallest BLAST distances for the core genes, while the long read hybrid assemblies attained the smallest BLAST distances for the complete set of genes.

Fig. 5
figure 5

Core gene BLAST distances. BLAST distance between the core genes of the reference genome and the assemblies versus the total number of base pairs sequenced per cumulative batch. (Abbreviations: SR = short read, LR = long read, HY = hybrid)

Fig. 6
figure 6

Complete gene set BLAST distances. BLAST distance between the complete gene set of the reference genome and the assemblies versus the total number of base pairs sequenced per cumulative batch. (Abbreviations: SR = short read, LR = long read, HY = hybrid)

For the core genes, the smallest BLAST distance observed was 5 (Fig. 5). Four of the differences were caused by variants identified previously in the core genes of the L. monocytogenes extracted from the quasimetagenomes. The fifth difference varied in location for different assemblies, and showed no relation to the variants discovered previously.

The short read hybrid approaches assembled the core genes with BLAST distance 5 at the earliest time point: HybridSpades at 24H and C22 corresponding to 40X (long reads) and 19X (short reads) depth of coverage of the L. monocytogenes reference genome; Opera-MS, both with and without reference-guided scaffolding, at 24H and C28 corresponding to 50X (long reads) and 25X (short reads) depth of coverage of the L. monocytogenes reference genome. Megahit assemblies attained a BLAST distance of 5 after 28H and C11 corresponding to 28X depth of coverage of the L. monocytogenes reference genome. At 24H, 28H and 36H the short read hybrid assemblies obtained a BLAST distance 5 with fewer short reads than the short read assemblies; however, at 32H and 40H, the short read and short read hybrid assemblies required the same amount of short read data to achieve a BLAST distance of 5.

The long read assemblies never achieved a BLAST distance of less than 2000 even with 158X depth of coverage of L. monocytogenes. Polishing the long read metaFlye assemblies with Racon improved the assembly of the core genes, achieving a minimum BLAST distance of 609. Long read hybrid assembly with Pilon achieved a BLAST distance of 5 at 28H and C14 which corresponded to 36X (short reads) and 38X (long reads) depth of coverage of the L. monocytogenes reference genome; however, it achieved BLAST distance 5 less consistently than short read or short read hybrid approaches (Fig. 5). Long read hybrid assembly with ntEdit assembled the core genes with less accuracy than Pilon, with a median BLAST distance (C1 to C30 across enrichment times) of 81 and 11, respectively.

The long read hybrid approaches assembled the complete gene set with the lowest BLAST distance, with Pilon outperforming ntEdit (Fig. 6). Pilon achieved a BLAST distance of 132, the best observed for any tool, at 28H and C14 corresponding to 36X (short reads) and 38X (long reads) depth of coverage of the L. monocytogenes reference genome. The mean BLAST distance across enrichment time points was 699 for Pilon and 798 for ntEdit. None of the other assembly approaches attained this level of accuracy. For reference, the next best tool, metaFlye+Racon, had a mean BLAST distance of 2991.

Variation in assembly quality between successive cumulative batches

In addition to accuracy, the precision with which assemblies can be reconstructed is of great importance for pathogen detection. The accuracy of the assembly approaches (in terms of divergence in core and full gene sets with respect to the L. monocytogenes reference) varied widely between successive cumulative batches (Fig. 7).

Fig. 7
figure 7

Consistency of assembly approaches between successive cumulative batches. Median successive cumulative batch difference in BLAST distances, across enrichment time points, for the A) the core genes and B) the complete gene

The tools that most consistently assembled the core genes were Opera-MS (without reference guided scaffolding), HybridSpades, MegaHit, and metaFlye+Racon+Pilon; the median difference in BLAST distance between successive cumulative batches for these tools was 0, 1, 1, and 5, respectively, across all enrichment time points. All assembly approaches had a median difference in BLAST distance of less than 50 except Opera-MS with reference guided scaffolding (121), Canu (1183) and Redbean (10,930).

The variability in the accuracy for the reconstruction of the complete gene set was an order of magnitude greater than for the core genes. The most consistent tools were HybridSpades, metaFlye+Racon+Pilon, metaFlye+Racon+ntEdit, metaFlye+Racon, and metaFlye—the median difference in BLAST distance between cumulative batches was 132, 137, 140, 183, and 207, respectively. All assembly approaches had a median difference in BLAST distance of less than 1000, with the exceptions of Opera-MS with reference guided scaffolding (1019), Canu (4758), and Redbean (32,655).

Depth of coverage did not always improve assembly quality

Increased depth of coverage did not always correlate with improved performance in assembly metrics. For example, the longest contig assembled by the short read assemblies was very similar at 30X depth of coverage and at 150X depth of coverage, 695,760 nt and 695,778 nt, respectively. In some cases, the performance of assembly approaches actually decreased with increased depth of coverage. For example, the lowest BLAST distance for the complete gene set for the metaFlye+Racon+Pilon assemblies increased from 132 to 153 despite an increase of 100X depth of coverage of the L. monocytogenes genome for both short and long reads.

Discussion

Public health labs are continually developing and testing new methods and approaches to increase the speed and resolution of pathogen source tracking. Expediting source attribution will contribute to reduced illnesses, deaths and the economic burden of illness outbreaks. Currently, the standard workflow for strain typing and source attribution involves sequencing genomes (primarily with Illumina MiSeq technology) of isolated colonies, cultured from selective enrichments. Sequence data is analyzed using SNP and/or MLST analyses. Here we evaluated the contribution of quasimetagenomics and the applied integration of (short) MiSeq and (long) GridIon reads for the improvement of this workflow.

Quasimetagenomics expedites source tracking

Currently, direct metagenomic sequencing of samples cannot replace genome sequencing of culture isolates for the strain typing of pathogens; however, quasimetagenomics has shown great promise for reducing the amount of enrichment time needed to type pathogens with sequence data [26, 35, 36]. Previous work on the listeriosis ice cream outbreak demonstrated that quasimetagenomic short read sequencing provided sufficient coverage of the L. monocytogenes genome to determine its membership in the outbreak cluster at 24 h enrichment—a significant improvement over the ~ 6 day procedure required to culture and sequence an isolate genome [26]. This work supports that MiSeq short read sequencing can expedite the recovery of a target pathogen from quasimetagenomes, accurately reconstructing the L. monocytogenes core genes at 28 h of enrichment. Further, the integration of MiSeq short read and GridIon long read sequencing further expedited the accurate assembly of the core genes and increased the contiguity of assemblies—including the reconstruction of a complete genome and plasmid—at 24 h of enrichment (Fig. 1). This highlights that an integrated approach to quasimetagenomics can greatly expedite and enhance source tracking.

Long reads have added value over short reads for quasimetagenomics

Although short reads can be used for high resolution SNP and cgMLST/wgMLST analyses they cannot span many genomic repeat regions, resulting in fragmented assemblies that preclude the recovery of complete bacterial genomes [13]. The fragmented assemblies can prevent the identification of genes, gene synteny, repeats, structural variants, and extrachromosomal sequences, like plasmids and phages, that could be readily observed in complete assemblies.

Our results showed that ~ 4% of the L. monocytogenes genome was not typeable by the MiSeq reads. In contrast, the entire L. monocytogenes genome was typeable with the GridIon reads, enabling the complete reconstruction of the L. monocytogenes genome and plasmid at 24 h of enrichment and only 33X depth of coverage. The ability of long reads to span genomic repeats will support much higher resolution whole genome based source tracking methods and provide detailed information about the mobileome. However, similar to previous studies [40], we found the high sequencing error rate of the nanopore reads to induce incorrect base calls in the assembled sequence, thereby negatively impacting strain typing and strain attribution. Nonetheless, with time, we expect the sequencing error rate to decrease and the utility of nanopore sequencing for source tracking to increase substantially.

Another advantage of nanopore over MiSeq sequencing is that the data is output in batches of reads every 30 to 60 min (as opposed to a MiSeq sequencing run which takes ~ 24 h depending on the number of cycles). As assembling the reads is much faster than sequencing itself (Fig. 1), nanopore sequencing allows the analysis to terminate as soon as sufficient reads have been obtained for accurate analysis—a point that may vary depending on the characteristics of the sample. This ability can greatly expedite source tracking by facilitating near-real-time bioinformatic analyses.

Hybrid assembly outperforms other approaches but with trade-offs

Our results support the accuracy of hybrid assemblies [17, 18, 36]—hybrid assembly, using both Illumina short reads and nanopore long reads, could reconstruct more complete and accurate genomes than using either of the platforms alone. However, the initial assembly strategy (i.e. whether the short reads were assembled first or long reads) had a substantial impact on the quality of the reconstructed genomes. Short read hybrid assembly approaches led to a more accurate assembly of the core genes, but the assemblies were more fragmented. The use of reference genomes to scaffold assemblies increased the contiguity of the short read hybrid assemblies, but also introduced assembly errors—a potential consequence if the references used for scaffolding has structural differences compared with the genomes being assembled. For the long read hybrid assembly approaches, a higher indel rate prevented the accurate assembly of the core genes; however, the assemblies had higher contiguity, sometimes reconstructing the complete L. monocytogenes genome. Additionally, the long read hybrid assembly approaches led to the most accurate recovery of the complete set of genes, with potential implications for characterizing the phenotype (e.g., drug resistance) of the pathogen. The choice of the hybrid assembly approach can be made subject to whether the application of the reconstructed genome mandates highly accurate core genes or an overall accurate complete genome.

Short read based assembly approaches showed the best performance

Assemblies need to be accurately reconstructed to be useful for SNP and cgMLST/wgMLST based source tracking analyses. Among the assembly approaches tested, the most accurate was the reconstruction of the core genes using either the short read or short read hybrid assembly strategy. Short read hybrid assembly was consistently able to accurately assemble the core genes with the same amount or fewer short reads than the short read assemblies. However, the combined use of short and long reads entails higher costs in both personnel time and reagents, which may not be justified as similar accuracy can be obtained with short reads alone at a slightly higher depth of coverage. In contrast, no assembly approach could reconstruct the complete set of genes with high accuracy or consistency, although long read hybrid approaches were by far the best performing. Nonetheless, given a lower sequencing error rate, long read approaches might become preferrable with the added value of assembling complete genomes and mobile elements like plasmids.

Areas of improvement for assembly algorithms

At the time of our analysis, metaFlye was the only metagenomic long read assembler available, and it performed better than the other long read assemblers in our application. This observation highlights that long read assemblers developed for single genomes are not effective when samples contain mixtures of DNA from multiple organisms—suggesting the need for further research in developing efficient metagenomic assembly tools for long read data. Additionally, the quality of the metaFlye assemblies was improved considerably by polishing the assemblies with the long reads themselves, indicating that none of the long read assemblers make full use of the information available in the long reads.

The observed differences between hybrid assembly approaches that start with short reads and those that start with long reads, suggest that hybrid approaches are currently limited by the weaknesses of the different technologies. This highlights the scope for improvement in hybrid assembly approaches, underscoring that we are still far from developing techniques which effectively integrate their strengths (e.g., the contiguity of long reads and high per-base quality of the short reads).

A weakness common to all assembly approaches was sensitivity to the addition of cumulative batches of sequence data, resulting in inconsistent gains/losses in assembly quality. This affected many metrics such as the N50 and the accuracy of the assembled genes. The differential sensitivity of assembly approaches to the addition of sequence data from the same sample suggests that assembly tools can be made more robust and consistent—greatly benefiting many applications including strain typing.

An advantage for quasimetagenomics is the detection of co-occurring strains that might be missed by traditional methods (i.e. culturing and sequencing a single isolate). Our analysis suggested the presence of at least two strains of L. monocytogenes in the quasimetagenomes. However, the current tools do not account for the variations within the (quasi-)metagenomic samples and current assembly approaches simply reconstruct the most abundant strain, which is what we observed with our assemblies. While further analysis of the data can reveal the strain structure hidden by the consensus assembly, we believe it is preferable that assemblers themselves account for and reveal the strains contained in the sample, information that could be valuable for source tracking.

Conclusion

The integration of nanopore long read and Illumina short read sequencing expedited the reconstruction of high quality L. monoctyogenes assemblies from ice cream quasimetagenomes. The core genes were accurately reconstructed after 24 h enrichment with the short read hybrid assemblies and 28 h for the short read assemblies–a significant reduction from the standard 6 day protocol. Although the GridIon long read assemblies had too many errors to reconstruct the core genes with high fidelity, they had added value for reconstructing complete genomes and plasmids–providing information about synteny, gene content and genome structure that were not accessible with short reads. Hybrid assembly showed the best performance but with different weaknesses depending on whether the short or long reads built the initial assembly–highlighting areas for algorithmic improvement that integrate the strengths of long and short reads (e.g., the contiguity of long reads and high per-base quality of the short reads). A new and more complete level of information about genome structure, gene order and mobile elements can be added to the public health response by integrating microbiological (quasimetagenomic), molecular (long and short read sequencing) and optimized bioinformatic approaches.

Methods

Experimental design

Using long and short read sequencing technologies, we compared the performance of various assembly approaches for reconstructing the genome of L. monocytogenes from selective enrichments of naturally contaminated ice cream samples (Fig. 1). The isolation of a pure colony of L. monocytogenes for sequencing typically requires up to 6 days of selective culture enrichment [26]. During the selective enrichment, aliquots were collected at 4-h intervals from 24 to 40 h (denoted as 24H, 28H, 32H, 36H, 40H). MiSeq short read and GridIon long read sequencing were performed on DNA from these incremental enrichments. At each time point, over a range of sequenced depth of coverage of the quasimetagenomes, the sequence data was assembled using the short and long reads in combination and separately. Assembly quality was evaluated by comparison to a complete L. monocytogenes reference genome—sequenced and assembled from PacBio data—obtained from the full 6-day enrichment protocol.

Enrichment

Ice cream samples, associated with the 2015 Blue Bell multistate listeriosis outbreak, were homogenized and added to Buffered Listeria Enrichment Broth (BLEB) with pyruvate according to the specifications outlined in Chapter 10 of the FDA BAM [19]. The mean MPN/g of L. monocytogenes in the ice cream samples was 11.99. After four hours, three filter sterilized selective agents (M52) were added to achieve final concentrations of 10 mg/L acriflavin, 40 mg/L cycloheximide, and 50 mg/L sodium nalidixic acid in the BLEB. Four replicates of negative (no ice-cream) and positive controls (L. monocytogenes cells) were also evaluated for bacterial growth every four hours over the 40-h enrichment.

DNA extraction and sequencing for short reads

For each of the enrichment time points (24H, 28H, 32H, 36H, and 40H), DNA was extracted using DNeasy Blood and Tissue kit (Qiagen) following the protocol for Gram-positive bacteria with minor modifications: 1.5 ml of the culture was pelleted (5000×g, 15 min) and the pellet resuspended in 200 mL of enzymatic lysis buffer containing 20 mM Tris-HCl (pH -8.0), 2 mM Sodium EDTA, 1.2% Triton X- 100, 20 mg/ml of lysozyme. Samples were incubated for 60 min at 37 °C. Short read libraries were prepared with Nextera Flex (Illumina) library prep kit according to the manufacturer’s specifications. Libraries from enrichment time points 24H, 28H, 32H, 36H, and 40H were multiplexed along with 20 other libraries from different time points from the same study on to Illumina MiSeq 2 × 250 cartridge (Illumina, CA) following manufacturer recommended protocol.

DNA extraction and sequencing for long reads

For each enrichment time point (24H, 28H, 32H, 36H, 40H), 2 ml aliquots of enrichment were removed and pelletized using a benchtop Centrifuge (Eppendorf 5418 R, NY, USA) at 4000 rpm for 10 mins. The pellet was resuspended in 300ul of TE Buffer. 300ul of the resuspended cells were loaded on the Maxwell® RSC Instrument (automated DNA extraction instrument, Madison, WI, USA) cartridge for DNA extraction. Genomic DNA was extracted using Maxwell® RSC Cultured Cells DNA Kit (Cat no: AS1260, Madison, WI, USA) on Maxwell RSC instrument following the manufacturer recommended protocol for Gram-positive bacteria.

Sequencing libraries were prepared using the ligation sequencing kit (Cat no: SQK-LSK109, Oxford Nanopore, Oxford, UK), according to the manufacturer’s specifications along with Native Barcoding Expansion 1–12 (Cat no: EXP-NBD104, Oxford Nanopore, Oxford, UK) for multiplexing the samples. The libraries were multiplexed into 2 pools (Pool1: 24H, 28H, 32H): Pool 2: 36H, 40H). The libraries were sequenced using GridIon with Flow cell (Cat no: FLO-MIN106, Oxford, UK) following the manufacturer’s recommended protocol. The GridIon outputs the raw signal data in batches of 4000 sequenced reads in fast5 format files [41]. Each fast5 file was converted into fastq formatted DNA sequences using Guppy for basecalling [42]. The fast base calling mode was used, which has a speed of ~ 4.6 Mbp/second. The GridIon typically outputs a batch of reads every 30 to 60 min (internal to lab), but is affected by factors such as the length and quality of the DNA fragments being sequenced.

L. monocytogenes reference genome

Previous work identified two strains from the L. monocytogenes ice cream outbreak [37]. Two reference genomes (NZ_CP016213.1 and NZ_MAGN00000000.1) were used for the SNP analysis of the two strains. These reference genomes were compared with the L. monocytogenes assemblies from the quasimetagenomes using Mash (v2.0, k = 25, s = 100,000). The complete L. monocytogenes genome (Genbank accession NZ_CP016213.1) was more similar to the data in the quasimetagenomes (see Results section) and was used as the reference for our analyses. This reference organism had previously been isolated from a single colony at the end of the enrichment protocol and sequenced with PacBio RSII from ice cream samples from Facility 1, the same facility our samples came from [37]. The reference is 3,030,827 bp long with 2984 protein-coding genes (2,710,041 bp in total length) predicted by Prokka (v1.12) [43] and a GC-content of 38%. The core genes (using the 1013 gene cgMLST scheme developed for L. monocytogenes at the FDA [6, 7]) were identified by BLAST [44] alignment. The total length of the core genes was 1,075,554 bp. Six copies of the 16S rRNA were identified in the reference genome with BLAST using the RNAmmer database [45].

Partitioning the sequenced reads into cumulative batches

The GridIon nanopore sequencing instrument generates the data in batches of 4000 reads, denoted here as Bn for the nth batch. Our analysis used the first 30 batches of reads, i.e., the first 120,000 reads corresponding to batches B1, B2, …,B30 (Fig. 1). To analyze the quality of assemblies as a function of increased sequencing depth, each successive batch of reads was combined with the previous batches for assembly to form “cumulative batches”, denoted as C1, C2,...,C30, where Cn = B1 + B2 + ... + Bn (Fig. 1). To compare assembly results strictly based on sequencing technology, the number of base pairs for the MiSeq and GridIon data was normalized. Over a range of sequencing depths, MiSeq raw read files were partitioned into 30 corresponding batches of read pairs to match the cumulative batches by number of base pairs for GridIon reads. Table 1 records the total number of sequenced bases per C30 at each enrichment time.

Detection of genomic variants and the presence of multiple strains

The detection of variants between the reference and the L. monocytogenes sequences reconstructed from the quasimetagenomes was conducted with two methods. In both cases, the MiSeq reads from cumulative batch C30 from each enrichment time were analyzed. The first method called variants with Snippy (v4.6) [46] if there was ≥10X depth of coverage and ≥ 95% of the reads supported the variant. The second method consisted of mapping the MiSeq reads to the reference genome with Bowtie2 (v2.3.4) [47] and analyzing the pile-up of reads with SAMtools (v1.7) [48]. Loci with ≥50X depth of coverage and where 20 to 90% of the aligned reads indicated the presence of another allele (while the rest of the aligned reads supported the reference allele) were considered to be evidence for multiple strains.

Raw read statistics and reference genome coverage

Raw read statistics were collected for the 30 batches of reads (B1 to B30) per enrichment time point, including: mean per base quality score, number of reads, number of base pairs, read length distribution, and estimated sequencing error rate. To estimate the sequencing error rate, the short and long reads were mapped to the L. monocytogenes reference genome with Bowtie2 (v2.3.0) and MiniMap2 (v2.17-r974-dirty) [49], respectively, using default settings. The number of mismatches, insertions, and deletions were counted for the mapped reads with respect to the reference genome. For the GridIon reads, an estimated range was provided for the sequencing error rate because MiniMap2 is a local, as opposed to a global, read alignment tool. The range is based on whether soft-clipping of the read alignments is included as sequencing error (maximum estimate of error) or not (minimum estimate of error). Insertions, deletions, and mismatches were only counted for the aligned portion of the reads i.e. excluding the soft-clipped regions. The read mappings were used to estimate the breadth and depth of coverage (DOC) of the L. monocytogenes reference genome.

Assembling the sequenced reads

Short reads and long-reads from each cumulative batch (C1 to C30) were assembled per enrichment time point (Fig. 1). The short reads were assembled using MegaHit (v1.2.9) [50] with default settings and scaffolded with MetaCarvel [51]. The long reads were assembled using Canu (v1.7) [52], Redbean (v2.5) [53], and metaFlye (v2.6-release) [54] with default settings. The Redbean assemblies were polished with MiniMap2 (v2.17-r974-dirty) and SAMtools (v1.5) following the tutorial for Redbean on its GitHub page. Unlike metaFlye, which is a long read metagenome assembler, Canu and Redbean are not designed for metagenomic assembly. However, these assemblers were chosen for comparative analysis as they are frequently used long-read genome assemblers. All of the metaFlye assemblies were polished, using the long reads, with Racon (v1.4.15) [55]. HybridSpades (v3.14.0) [56] and Opera-MS (v0.8.3) [40] (with and without reference genome scaffolding) were used for short read hybrid assembly—short read assembly followed by scaffolding with the long reads. Opera-MS was chosen because it is a metagenome assembler, while HybridSpades was chosen because it is a popular genome assembler. Pilon (v1.23) [57] and ntEdit (v1.3.1) [58] were used for long read hybrid assemblies—long read assembly with metaFlye followed by short read polishing. Each tool was run with 12 cores of 2.70 GHz Intel Xeon E5–2680 processor.

Assembly statistics

The runtime (user time) of each assembly method on the server was recorded for cumulative batch C30 at each enrichment time point. Quast (v5.0.2) [59] was used to report the number of insertion/deletions/mismatches and the NG50 for the C30 assembled L. monocytogenes contigs with respect to the reference genome.

General quasimetagenomic assembly statistics (total assembly length, the number of contigs, the longest contig, the N50) were collected for every cumulative batch (C1 to C30 at each enrichment time) using a custom Python script.

Comparison of the reference genome with the L. monocytogenes assembled from the cumulative batches

We estimated the fraction of the reference genome where reads (MiSeq and GridIon) mapped ambiguously, i.e. mapped with the same alignment score to multiple genome locations. The MiSeq reads were mapped with Bowtie2 and the GridIon reads were mapped with MiniMap2. The mean MAPQ score was calculated for each base of the reference genome. Loci with median scores lower than 40 were considered ambiguous [60].

The presence of alleles from the low abundance strain was assessed for the C30 assemblies (across enrichment times) with Snippy by aligning the assemblies to the reference genome and cross-referencing the variant loci identified when looking for multiple strains.

The L. monocytogenes contigs assembled from each cumulative batch (C1 to C30 at each enrichment time) were assessed for accuracy with respect to the reference genome. Accuracy was assessed by measuring the BLAST distance (a measure of sequence similarity) between the predicted genes (both the core and complete set of genes) of the reference and the L. monocytogenes metagenome-assembled genomes. We define the BLAST distance as the number of mismatches, insertions, and deletions in the BLAST alignment between the reference genes and the assembled genes. Preferably, the edit distance between the reference genes and the genes found in the assemblies would have been calculated, but correctly identifying the entire length of genes, especially in noisy long read assemblies, is difficult; instead, the BLAST distance forms an approximation of the edit distance.

If the L. monocytogenes genome assembled from a sample comprised a single contig, the synteny of the core genes was compared to that in the reference.

Taxonomic classification

The contigs from the MegaHit (short read) assemblies and metaFlye (long read) assemblies (from each cumulative batch at every enrichment time) were taxonomically classified with Kraken (v1.1.1) [61] and the MiniKraken database using default settings. A species was considered present if ≥5000 nt of contigs were annotated as that species.

The proportion of reads mapped to the L. monocytogenes genome was used as the relative abundance of L. monocytogenes in the samples.

Availability of data and materials

The short and long reads are available on NCBI in Bioproject PRJNA630588. The L. monocytogenes reference genome is available on Genbank under accession NZ_CP016213.1. The code and data used for our analysis is available on GitHub at https://github.com/SethCommichaux/Long_read_short_read_comparison.

References

  1. Allard MW, Strain E, Melka D, Bunning K, Musser SM, Brown EW, et al. Practical value of food pathogen traceability through building a whole-genome sequencing network and database. J Clin Microbiol. 2016;54(8):1975–83. https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.00081-16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Swaminathan B, Barrett TJ, Hunter SB, Tauxe RV, the CDC PulseNet Task Force. PulseNet: The Molecular Subtyping Network for Foodborne Bacterial Disease Surveillance, United States. Emerging Infectious Diseases. 2001. pp. 382–389. https://0-doi-org.brum.beds.ac.uk/10.3201/eid0703.017303

  3. Centers for Disease Control and Prevention (CDC). Establishment of a national surveillance program for antimicrobial resistance in Salmonella. MMWR Morb Mortal Wkly Rep. 1996;45:110–1.

    Google Scholar 

  4. Tollefson L. FDA reveals plans for antimicrobial susceptibility monitoring. J Am Vet Med Assoc. 1996;208(4):459–60.

    CAS  PubMed  Google Scholar 

  5. Davis S, Pettengill JB, Luo Y, Payne J, Shpuntoff A, Rand H, et al. CFSAN SNP Pipeline: an automated method for constructing SNP matrices from next-generation sequence data. PeerJ Comput Sci. 2015:e20. https://0-doi-org.brum.beds.ac.uk/10.7717/peerj-cs.20.

  6. Pightling AW, Petronella N, Pagotto F. The Listeria monocytogenes Core-genome sequence Typer (LmCGST): a bioinformatic pipeline for molecular characterization with next-generation sequence data. BMC Microbiol. 2015;15(1):224. https://0-doi-org.brum.beds.ac.uk/10.1186/s12866-015-0526-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Pettengill JB, Pightling AW, Baugher JD, Rand H, Strain E. Real-time pathogen detection in the era of whole-genome sequencing and big data: comparison of k-mer and site-based methods for inferring the genetic distances among tens of thousands of Salmonella samples. PLoS One. 2016;11(11):e0166162. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0166162.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Ruppitsch W, Pietzka A, Prior K, Bletz S, Fernandez HL, Allerberger F, et al. Defining and evaluating a Core genome multilocus sequence typing scheme for whole-genome sequence-based typing of Listeria monocytogenes. J Clin Microbiol. 2015;53(9):2869–76. https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.01193-15.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Mellmann A, Bletz S, Böking T, Kipp F, Becker K, Schultes A, et al. Real-time genome sequencing of resistant Bacteria provides precision infection control in an institutional setting. J Clin Microbiol. 2016;54(12):2874–81. https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.00790-16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Alikhan N-F, Zhou Z, Sergeant MJ, Achtman M. A genomic overview of the population structure of Salmonella. PLoS Genet. 2018;14(4):e1007261. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pgen.1007261.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Pearce ME, Alikhan N-F, Dallman TJ, Zhou Z, Grant K, Maiden MCJ. Comparative analysis of core genome MLST and SNP typing within a European Salmonella serovar Enteritidis outbreak. Int J Food Microbiol. 2018;274:1–11. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ijfoodmicro.2018.02.023.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Schirmer M, D’Amore R, Ijaz UZ, Hall N, Quince C. Illumina error profiles: resolving fine-scale variation in metagenomic sequencing data. BMC Bioinformatics. 2016;17(1):125. https://0-doi-org.brum.beds.ac.uk/10.1186/s12859-016-0976-y.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Moss EL, Maghini DG, Bhatt AS. Complete, closed bacterial genomes from microbiomes using nanopore sequencing. Nat Biotechnol. 2020;38(6):701–7. https://0-doi-org.brum.beds.ac.uk/10.1038/s41587-020-0422-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Wang L, Qu L, Yang L, Wang Y, Zhu H. NanoReviser: an error-correction tool for Nanopore sequencing based on a deep learning algorithm. Front Genet. 2020;11:900. https://0-doi-org.brum.beds.ac.uk/10.3389/fgene.2020.00900.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Dohm JC, Peters P, Stralis-Pavese N, Himmelbauer H. Benchmarking of long-read correction methods. NAR Genom Bioinform. 2020;2:lqaa037.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Lemon JK, Khil PP, Frank KM, Dekker JP. Rapid Nanopore sequencing of plasmids and resistance gene detection in clinical isolates. J Clin Microbiol. 2017;55(12):3530–43. https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.01069-17.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Chen Z, Kuang D, Xu X, González-Escalona N, Erickson DL, Brown E, et al. Genomic analyses of multidrug-resistant Salmonella Indiana, Typhimurium, and Enteritidis isolates using MinION and MiSeq sequencing technologies. PLoS One. 2020;15(7):e0235641. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0235641.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. González-Escalona N, Allard MA, Brown EW, Sharma S, Hoffmann M. Nanopore sequencing for fast determination of plasmids, phages, virulence markers, and antimicrobial resistance genes in Shiga toxin-producing Escherichia coli. PLoS One. 2019;14(7):e0220494. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0220494.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. United States. Food and Drug Administration. Bacteriological Analytical Manual: Aoac International; 1995.

  20. Ottesen A, Ramachandran P, Reed E, White JR, Hasan N, Subramanian P, et al. Enrichment dynamics of Listeria monocytogenes and the associated microbiome from naturally contaminated ice cream linked to a listeriosis outbreak. BMC Microbiol. 2016;16(1):275. https://0-doi-org.brum.beds.ac.uk/10.1186/s12866-016-0894-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Handelsman J. Metagenomics: application of genomics to uncultured microorganisms. Microbiol Mol Biol Rev. 2004;68(4):669–85. https://0-doi-org.brum.beds.ac.uk/10.1128/MMBR.68.4.669-685.2004.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Loit K, Adamson K, Bahram M, Puusepp R, Anslan S, Kiiker R, et al. Relative performance of MinION (Oxford Nanopore technologies) versus sequel (Pacific biosciences) third-generation sequencing instruments in identification of agricultural and Forest fungal pathogens. Appl Environ Microbiol. 2019;85(21). https://0-doi-org.brum.beds.ac.uk/10.1128/AEM.01368-19.

  23. Petersen LM, Martin IW, Moschetti WE, Kershaw CM, Tsongalis GJ. Third-generation sequencing in the clinical laboratory: exploring the advantages and challenges of Nanopore sequencing. J Clin Microbiol. 2019;58(1). https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.01315-19.

  24. Hamner S, Brown BL, Hasan NA, Franklin MJ, Doyle J, Eggers MJ, et al. Metagenomic profiling of microbial pathogens in the little Bighorn River, Montana. Int J Environ Res Public Health. 2019;16(7). https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16071097.

  25. Latorre-Pérez A, Villalba-Bermell P, Pascual J, Vilanova C. Assembly methods for nanopore-based metagenomic sequencing: a comparative study. Sci Rep. 2020;10(1):13588. https://0-doi-org.brum.beds.ac.uk/10.1038/s41598-020-70491-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Ottesen A, Ramachandran P, Chen Y, Brown E, Reed E, Strain E. Quasimetagenomic source tracking of Listeria monocytogenes from naturally contaminated ice cream. BMC Infect Dis. 2020;20(1):83. https://0-doi-org.brum.beds.ac.uk/10.1186/s12879-019-4747-z.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Pettengill JB, McAvoy E, White JR, Allard M, Brown E, Ottesen A. Using metagenomic analyses to estimate the consequences of enrichment bias for pathogen detection. BMC Res Notes. 2012;5(1):378. https://0-doi-org.brum.beds.ac.uk/10.1186/1756-0500-5-378.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Ottesen AR, Gonzalez A, Bell R, Arce C, Rideout S, Allard M, et al. Co-enriching microflora associated with culture based methods to detect Salmonella from tomato phyllosphere. PLoS One. 2013;8(9):e73079. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0073079.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Lusk TS, Ottesen AR, White JR, Allard MW, Brown EW, Kase JA. Characterization of microflora in Latin-style cheeses by next-generation sequencing technology. BMC Microbiol. 2012;12(1):254. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2180-12-254.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Jarvis KG, White JR, Grim CJ, Ewing L, Ottesen AR, Beaubrun JJ-G, et al. Cilantro microbiome before and after nonselective pre-enrichment for Salmonella using 16S rRNA and metagenomic sequencing. BMC Microbiol. 2015;15(1):160. https://0-doi-org.brum.beds.ac.uk/10.1186/s12866-015-0497-2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Lusk Pfefer T, Ramachandran P, Reed E, Kase JA, Ottesen A. Metagenomic description of Preenrichment and Postenrichment of recalled Chapati Atta flour using a shotgun sequencing approach. Genome Announc. 2018;6(21). https://0-doi-org.brum.beds.ac.uk/10.1128/genomeA.00305-18.

  32. Ramachandran P, Reed E, Ottesen A. Exploring the microbiome of Callinectes sapidus (Maryland blue crab). Genome Announc. 2018;6(22). https://0-doi-org.brum.beds.ac.uk/10.1128/genomeA.00466-18.

  33. Ossai S, Ramachandran P, Ottesen A, Reed E, DePaola A, Parveen S. Microbiomes of American oysters () harvested from two sites in the Chesapeake Bay. Genome Announc. 2017;5(30). https://0-doi-org.brum.beds.ac.uk/10.1128/genomeA.00729-17.

  34. Ramachandran P, Reed E, Commichaux S, Strain E, Depaola A, Rikard S, et al. Characterization of the microbiota of oyster larvae (Crassostrea virginica) and tank water from an aquaculture system with high and low larval survival rates. Genome Announc. 2018;6(25). https://0-doi-org.brum.beds.ac.uk/10.1128/genomeA.00597-18.

  35. Townsend A, Li S, Mann DA, Deng X. A quasimetagenomics method for concerted detection and subtyping of Salmonella enterica and E. coli O157:H7 from romaine lettuce. Food Microbiol. 2020;103575. https://0-doi-org.brum.beds.ac.uk/10.1016/j.fm.2020.103575.

  36. Hyeon J-Y, Li S, Mann DA, Zhang S, Li Z, Chen Y, et al. Quasimetagenomics-based and real-time-sequencing-aided detection and subtyping of Salmonella enterica from food samples. Appl Environ Microbiol. 2018;84(4). https://0-doi-org.brum.beds.ac.uk/10.1128/AEM.02340-17.

  37. Chen Y, Luo Y, Curry P, Timme R, Melka D, Doyle M, et al. Assessing the genome level diversity of Listeria monocytogenes from contaminated ice cream and environmental samples linked to a listeriosis outbreak in the United States. PLoS One. 2017;12(2):e0171389. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0171389.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Roberts RJ, Carneiro MO, Schatz MC. The advantages of SMRT sequencing. Genome Biol. 2013;14(6):405. https://0-doi-org.brum.beds.ac.uk/10.1186/gb-2013-14-6-405.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Ondov BD, Treangen TJ, Melsted P, Mallonee AB, Bergman NH, Koren S, et al. Mash: fast genome and metagenome distance estimation using MinHash. Genome Biol. 2016;17(1):132. https://0-doi-org.brum.beds.ac.uk/10.1186/s13059-016-0997-x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Bertrand D, Shaw J, Kalathiyappan M, Ng AHQ, Kumar MS, Li C, et al. Hybrid metagenomic assembly enables high-resolution analysis of resistance determinants and mobile elements in human microbiomes. Nat Biotechnol. 2019;37(8):937–44. https://0-doi-org.brum.beds.ac.uk/10.1038/s41587-019-0191-2.

    Article  CAS  PubMed  Google Scholar 

  41. [No title]. [cited 29 Oct 2020]. Available: https://store.nanoporetech.com/media/it-requirements-configure-gridion-capex.pdf

  42. Basecalling using Guppy. [cited 30 Oct 2020]. Available: https://timkahlke.github.io/LongRead_tutorials/BS_G.html

  43. Seemann T. Prokka: rapid prokaryotic genome annotation. Bioinformatics. 2014:2068–9. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btu153.

  44. Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool. J Mol Biol. 1990;215(3):403–10. https://0-doi-org.brum.beds.ac.uk/10.1016/S0022-2836(05)80360-2.

    Article  CAS  PubMed  Google Scholar 

  45. Lagesen K, Hallin P, Rødland EA, Staerfeldt H-H, Rognes T, Ussery DW. RNAmmer: consistent and rapid annotation of ribosomal RNA genes. Nucleic Acids Res. 2007;35(9):3100–8. https://0-doi-org.brum.beds.ac.uk/10.1093/nar/gkm160.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. tseemann. tseemann/snippy. [cited 9 Mar 2021]. Available: https://github.com/tseemann/snippy

  47. Langmead B, Salzberg SL. Fast gapped-read alignment with Bowtie 2. Nature Methods. 2012:357–9. https://0-doi-org.brum.beds.ac.uk/10.1038/nmeth.1923.

  48. Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, et al. The sequence alignment/map format and SAMtools. Bioinformatics. 2009;25(16):2078–9. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btp352.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Li H. Minimap2: pairwise alignment for nucleotide sequences. Bioinformatics. 2018;34(18):3094–100. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/bty191.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Li D, Liu C-M, Luo R, Sadakane K, Lam T-W. MEGAHIT: an ultra-fast single-node solution for large and complex metagenomics assembly via succinct de Bruijn graph. Bioinformatics. 2015;31(10):1674–6. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btv033.

    Article  CAS  PubMed  Google Scholar 

  51. Ghurye J, Treangen T, Fedarko M, Hervey WJ 4th, Pop M. MetaCarvel: linking assembly graph motifs to biological variants. Genome Biol. 2019;20(1):174. https://0-doi-org.brum.beds.ac.uk/10.1186/s13059-019-1791-3.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Koren S, Walenz BP, Berlin K, Miller JR, Bergman NH, Phillippy AM. Canu: scalable and accurate long-read assembly via adaptivek-mer weighting and repeat separation. Genome Research. 2017:722–36. https://0-doi-org.brum.beds.ac.uk/10.1101/gr.215087.116.

  53. Ruan J, Li H. Fast and accurate long-read assembly with wtdbg2. Nat Methods. 2020;17(2):155–8. https://0-doi-org.brum.beds.ac.uk/10.1038/s41592-019-0669-3.

    Article  CAS  PubMed  Google Scholar 

  54. Kolmogorov M, Bickhart DM, Behsaz B, Gurevich A, Rayko M, Shin SB, et al. metaFlye: scalable long-read metagenome assembly using repeat graphs. Nat Methods. 2020;17(11):1103–10. https://0-doi-org.brum.beds.ac.uk/10.1038/s41592-020-00971-x.

    Article  CAS  PubMed  Google Scholar 

  55. Vaser R, Sović I, Nagarajan N, Šikić M. Fast and accurate de novo genome assembly from long uncorrected reads. Genome Research. 2017:737–46. https://0-doi-org.brum.beds.ac.uk/10.1101/gr.214270.116.

  56. Antipov D, Korobeynikov A, McLean JS, Pevzner PA. hybridSPAdes: an algorithm for hybrid assembly of short and long reads. Bioinformatics. 2016;32(7):1009–15. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btv688.

    Article  CAS  PubMed  Google Scholar 

  57. Walker BJ, Abeel T, Shea T, Priest M, Abouelliel A, Sakthikumar S, et al. Pilon: an integrated tool for comprehensive microbial variant detection and genome assembly improvement. PLoS One. 2014;9(11):e112963. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0112963.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Warren RL, Coombe L, Mohamadi H, Zhang J, Jaquish B, Isabel N, et al. ntEdit: scalable genome sequence polishing. Bioinformatics. 2019;35(21):4430–2. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btz400.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Gurevich A, Saveliev V, Vyahhi N, Tesler G. QUAST: quality assessment tool for genome assemblies. Bioinformatics. 2013;29(8):1072–5. https://0-doi-org.brum.beds.ac.uk/10.1093/bioinformatics/btt086.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  60. Li H, Ruan J, Durbin R. Mapping short DNA sequencing reads and calling variants using mapping quality scores. Genome Res. 2008;18(11):1851–8. https://0-doi-org.brum.beds.ac.uk/10.1101/gr.078212.108.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Wood DE, Salzberg SL. Kraken: ultrafast metagenomic sequence classification using exact alignments. Genome Biology. 2014:R46. https://0-doi-org.brum.beds.ac.uk/10.1186/gb-2014-15-3-r46.

Download references

Acknowledgements

We would like to acknowledge the qMGS pathogen detection efforts of the Metagenometrakr initiative of FDA. Thanks to our collaborators from the National Antimicrobial Resistance Monitoring System (NARMS), the Office of Regulatory Affairs (ORA), and at the Center for Veterinary Medicine (CVM).

Funding

Funding was supported by the Office of Regulatory Science, Center for Food Safety and Applied Nutrition, and the FDA. Kiran Javkar was supported by the University of Maryland, Joint Institute for Food Safety and Applied Nutrition (JIFSAN) through cooperative agreement #5 U01-FD001418, provided by the U.S. Food and Drug Administration, Center for Food Safety and Applied Nutrition (FDA, CFSAN). The funding bodies played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

SC and KJ performed bioinformatic analyses, wrote the manuscript and created figures. AO and PR designed the experiment. AO, PR, YC and NGE performed microbiological and molecular lab work. ER created figures and organized data. NN and DB ran Opera-MS assemblies and analyses. SC, KJ, AO, PR, YC, NGE, ES, HR and MP edited the manuscript. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Seth Commichaux.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary Figure 1.

Read length distributions for long reads that mapped to the Listeria monocytogenes reference genome versus those that did not.

Additional file 2: Supplementary Figure 2.

GC content distributions for long reads that mapped to the Listeria monocytogenes reference genome and those that did not.

Additional file 3: Supplementary Figure 3.

Runtimes for the assembly approaches in minutes when assembling cumulative batch 30 from each of the enrichment time points. (Abbreviations: SR = short read, LR = long read, HY = hybrid).

Additional file 4: Supplementary Figure 4.

Total assembly length versus the total number of base pairs sequenced per cumulative batch at each of the enrichment time points for each assembly approach. Sometimes the results for Canu, Redbean and metaFlye overlap as do Opera-MS (NoRef) and Opera-Ms (RefCluster). (Abbreviations: SR = short read, LR = long read, HY = hybrid).

Additional file 5: Supplementary Figure 5.

Number of contigs versus the total number of base pairs sequenced per cumulative batch at each of the enrichment time points for each assembly approach. metaFlye+Racon, metaFlye+Racon+Pilon, and metaFlye+Racon+ntEdit are obscured by the line for metaFlye in each of the plots. (Abbreviations: SR = short read, LR = long read, HY = hybrid).

Additional file 6: Supplementary Figure 6.

N50 versus the total number of base pairs sequenced per cumulative batch at each of the enrichment time points for each assembly approach. metaFlye+Racon, metaFlye+Racon+Pilon, and metaFlye+Racon+ntEdit are obscured by the line for metaFlye in each of the plots. (Abbreviations: SR = short read, LR = long read, HY = hybrid).

Additional file 7: Supplementary Figure 7.

The longest contig assembled versus the total number of base pairs sequenced per cumulative batch at each of the enrichment time points for each assembly approach. metaFlye+Racon, metaFlye+Racon+Pilon, and metaFlye+Racon+ntEdit are obscured by the line for metaFlye in each of the plots. (Abbreviations: SR = short read, LR = long read, HY = hybrid).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Commichaux, S., Javkar, K., Ramachandran, P. et al. Evaluating the accuracy of Listeria monocytogenes assemblies from quasimetagenomic samples using long and short reads. BMC Genomics 22, 389 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12864-021-07702-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12864-021-07702-2

Keywords