Awesome
Nanopolish
Software package for signal-level analysis of Oxford Nanopore sequencing data. Nanopolish can calculate an improved consensus sequence for a draft genome assembly, detect base modifications, call SNPs and indels with respect to a reference genome and more (see Nanopolish modules, below).
A note on R10 support
Presently nanopolish does not support R10.4 flowcells as variant and methylation calling is accurate enough to not require signal-level analysis. We intend to support signal exploration through eventalign
but do not currently have a timeline for this as our development time is currently dedicated to other projects.
Release notes
-
0.14.1: added the
compare_methylation.py
script from the methylation example data bundle to thenanopolish
package -
0.14.0: support modification bam files, compile on M1 apple hardware, support SLOW5 files
-
0.13.3: fix conda build issues, better handling of VBZ-compressed files, integration of module for nano-COP
-
0.13.2: fix memory leak when loading signal data
-
0.13.1: fix
nanopolish index
performance issue for some barcoding runs -
0.13.0: modify HMM transitions to allow the balance between insertions and deletions to be changed depending on mode (consensus vs reference variants)
-
0.12.5: make SupportFractionByStrand calculation consistent with SupportFraction
-
0.12.4: add SupportFractionByStrand and SOR to VCF
-
0.12.3: fix hdf5 file handle leak
-
0.12.2: add RefContext info to VCF output of
nanopolish variants
-
0.12.1: improve how
nanopolish index
handles summary files, add support for selecting reads by BAM read group tags (fornanopolish variants
) -
0.12.0: live methylation calling, methylation LLR threshold changes as described here
-
0.11.1:
nanopolish polya
now supports SQK-RNA-002 kits with automatic backwards-compatibility with SQK-RNA-001 -
0.11.0: support for multi-fast5 files.
nanopolish methyltrain
now subsamples input data, improving speed and memory usage -
0.10.2: added new program
nanopolish polya
to estimate the length of poly-A tails on direct RNA reads (by @paultsw) -
0.10.1:
nanopolish variants --consensus
now only outputs a VCF file instead of a fasta sequence. The VCF file describes the changes that need to be made to turn the draft sequence into the polished assembly. A new program,nanopolish vcf2fasta
, is provided to generate the polished genome (this replacesnanopolish_merge.py
, see usage instructions below). This change is to avoid issues when merging segments that end on repeat boundaries (reported by Michael Wykes and Chris Wright).
Dependencies
A compiler that supports C++11 is needed to build nanopolish. Development of the code is performed using gcc-4.8.
By default, nanopolish will download and compile all of its required dependencies. Some users however may want to use system-wide versions of the libraries. To turn off the automatic installation of dependencies set HDF5=noinstall
, EIGEN=noinstall
, HTS=noinstall
or MINIMAP2=noinstall
parameters when running make
as appropriate. The current versions and compile options for the dependencies are:
- libhdf5-1.8.14 compiled with multi-threading support
--enable-threadsafe
- eigen-3.2.5
- htslib-1.15.1
- minimap2-fe35e67
- slow5lib-3680e17
In order to use the additional python3 scripts within /scripts
, install the dependencies via
pip install -r scripts/requirements.txt --user
Installation instructions
Installing the latest code from github (recommended)
You can download and compile the latest code from github as follows:
git clone --recursive https://github.com/jts/nanopolish.git
cd nanopolish
make
Installing a particular release
When major features have been added or bugs fixed, we will tag and release a new version of nanopolish. If you wish to use a particular version, you can checkout the tagged version before compiling:
git clone --recursive https://github.com/jts/nanopolish.git
cd nanopolish
git checkout v0.9.2
make
Nanopolish modules
The main subprograms of nanopolish are:
nanopolish call-methylation: predict genomic bases that may be methylated
nanopolish variants: detect SNPs and indels with respect to a reference genome
nanopolish variants --consensus: calculate an improved consensus sequence for a draft genome assembly
nanopolish eventalign: align signal-level events to k-mers of a reference genome
Analysis workflow examples
Data preprocessing
Nanopolish needs access to the signal-level data measured by the nanopore sequencer. The first step of any nanopolish workflow is to prepare the input data by telling nanopolish where to find the signal files. If you ran Albacore 2.0 on your data you should run nanopolish index
on your input reads (-d can be specified more than once if using multiple runs):
# Index the output of the basecaller
nanopolish index -d /path/to/raw_fast5s/ -s sequencing_summary.txt basecalled_output.fastq # for FAST5 inout
nanopolish index basecalled_output.fastq --slow5 signals.blow5 # for SLOW5 input
The -s
option tells nanopolish to read the sequencing_summary.txt
file from Albacore to speed up indexing. Without this option nanopolish index
is extremely slow as it needs to read every fast5 file individually. If you basecalled your run in parallel, so you have multiple sequencing_summary.txt
files, you can use the -f
option to pass in a file containing the paths to the sequencing summary files (one per line). When using SLOW5 files as the input (FAST5 can be converted to SLOW5 using slow5tools), -s
option is not required and does not affect indexing performance.
Computing a new consensus sequence for a draft assembly
The original purpose of nanopolish was to compute an improved consensus sequence for a draft genome assembly produced by a long-read assembly like canu. This section describes how to do this, starting with your draft assembly which should have megabase-sized contigs. We've also posted a tutorial including example data here.
# Index the draft genome
bwa index draft.fa
# Align the basecalled reads to the draft sequence
bwa mem -x ont2d -t 8 draft.fa reads.fa | samtools sort -o reads.sorted.bam -T reads.tmp -
samtools index reads.sorted.bam
Now, we use nanopolish to compute the consensus sequence (the genome is polished in 50kb blocks and there will be one output file per block). We'll run this in parallel:
python3 nanopolish_makerange.py draft.fa | parallel --results nanopolish.results -P 8 \
nanopolish variants --consensus -o polished.{1}.vcf -w {1} -r reads.fa -b reads.sorted.bam -g draft.fa -t 4 --min-candidate-frequency 0.1
This command will run the consensus algorithm on eight 50kbp segments of the genome at a time, using 4 threads each. Change the -P
and --threads
options as appropriate for the machines you have available.
After all polishing jobs are complete, you can merge the individual 50kb segments together back into the final assembly:
nanopolish vcf2fasta -g draft.fa polished.*.vcf > polished_genome.fa
Calling Methylation
nanopolish can use the signal-level information measured by the sequencer to detect 5-mC as described here. We've posted a tutorial on how to call methylation here.
To run using docker
First build the image from the dockerfile:
docker build .
Note the uuid given upon successful build. Then you can run nanopolish from the image:
docker run -v /path/to/local/data/data/:/data/ -it :image_id ./nanopolish eventalign -r /data/reads.fa -b /data/alignments.sorted.bam -g /data/ref.fa
Credits and Thanks
The fast table-driven logsum implementation was provided by Sean Eddy as public domain code. This code was originally part of hmmer3. Nanopolish also includes code from Oxford Nanopore's scrappie basecaller. This code is licensed under the MPL.
The scripts/compare_methylation.py
was originally provided in the example methylation data bundle which was obtained using:
curl -O warwick.s3.climb.ac.uk/nanopolish_tutorial/methylation_example.tar.gz
tar xvfz methylation_example.tar.gz
ls methylation_example/compare_methylation.py