Awesome
ARCS
Scaffolding genome sequence assemblies using linked or long read sequencing data
Contents
- Description
- Run modes - cheat sheet
- Install
- Dependencies
- Installation
- ARCS+LINKS pipeline
- Running ARCS with linked reads
- Running ARCS with long reads
- Running alignment-free ARKS with linked reads
- Running alignment-free ARKS with long reads
- Simulating pseudo-linked reads from long reads
- Demo
- Using stLFR linked reads
- About ARCS/ARKS
- Citing ARCS/ARKS/LINKS
- License
Description <a name=description></a>
ARCS and ARKS are genome sequence assembly scaffolders using linked and long read sequencing data
Run modes - cheat sheet <a name=modes></a>
ARCS can be run in 4 modes:
- ARCS (default) uses alignments of linked reads to the input contigs
- ARCS-long (
arcs-long
) uses alignments of long reads to the input contigs - ARKS (
--arks
) uses exact k-mer mapping to associate linked reads to input contigs - ARKS-long (
arks-long
) uses exact k-mer mapping to associate long reads to input contigs
Because ARKS is not dependent on read alignments, it is generally much faster than ARCS. However, ARCS is recommended for use with very fragmented assemblies and/or large genomes.
Dependencies <a name=dep></a>
- Boost (tested on 1.61)
- GCC (6+)
- Autotools (if cloning directly from repository)
- LINKS (tested on 1.8)
- Google SparseHash
- ABySS (if using long reads)
- btllib (1.4.3+)
Installation <a name=install></a>
If cloning directly from the repository run:
./autogen.sh
To compile ARCS run:
./configure && make
To install ARCS in a specified directory:
./configure --prefix=/ARCS/PATH && make install
If your boost library headers are not in your PATH you can specify their location:
./configure –-with-boost=/boost/path --prefix=/ARCS/PATH && make install
If you compiled btllib from source (as opposed to installation using conda), you can specify the location of the btllib library files:
export CXXFLAGS+=" -I /path/to/btllib/include"
export LDFLAGS+=" -L /path/to/btllib/install/lib"
./configure && make
If using the arcs-make
Makefile, ensure that the directory where the arcs
binary is located is on your PATH.
ARCS+LINKS pipeline <a name=pipeline></a>
The ARCS+LINKS pipeline requires two input files:
- Draft assembly fasta file
- Reads file in fastq format
*.fq.gz
(or fasta format*.fa.gz
if using long reads)- For linked reads, ARCS expects an interleaved linked reads file (Barcode sequence expected in the BX tag of the read header or in the form "@readname_barcode" ; Run Long Ranger basic on raw chromium reads to produce this interleaved file)
The Makefile located here: bin/arcs-make will run the full ARCS pipeline. It will also optionally run the misassembly corrector Tigmint prior to scaffolding with ARCS. If you are running Tigmint in your pipeline, please ensure that all input files are in your current working directory.
There are three steps to the pipeline:
-
Run ARCS to generate a Graphviz Dot file (.gv). Nodes in the graph are the sequences to scaffold, and edges show that there is evidence to suggest nodes are linked based on the data obtained from the GemCode/Chromium reads.
-
Run the python script bin/makeTSVfile.py to generate a file named XXX.tigpair_checkpoint file from the ARCS graph file. The XXX.tigpair_checkpoint file will be provided to LINKS in step 3.
-
Run LINKS with the XXX.tigpair_checkpoint file as input. To do this, the base name (-b) must be set to the same name as XXX.
When using the -D
/--dist_est
ARCS option to estimate gap sizes, the user is recommended to use LINKS v1.8.6 or later.
Running ARCS with linked reads (default mode) <a name=runlinked></a>
The default mode uses alignments of linked reads to contigs to scaffold the input contigs.
To run the pipeline in default mode, run bin/arcs-make arcs
. For example, to scaffold the assembly my_scaffolds.fa
with the interleaved, longranger processed reads my_reads.fq.gz
, specifying a minimum contig length of 1000bp:
arcs-make arcs draft=my_scaffolds reads=my_reads z=1000
For more info check bin/arcs-make help
.
To run the arcs
executable in default mode, run arcs <alignments>
. For descriptions of all arguments, run arcs --help
.
Running ARCS with long reads ('--arcs-long' mode) <a name=runlong></a>
The arcs-long mode first segments and assigns barcodes to the long reads, yielding pseudo-linked reads. Alignments of the pseudo-linked reads are then used to scaffold the input contigs.
To run the pipeline in arcs-long mode, run bin/arcs-make arks-long
. For example, to scaffold the assembly my_scaffolds.fa
with long reads my_reads.fa.gz
or my_reads.fq.gz
, specifying a minimum contig length of 1000bp:
arcs-make arcs-long draft=my_scaffolds reads=my_reads z=1000
The input long reads can be gzipped or uncompressed. For more info check bin/arcs-make help
.
Parameters: To account for the higher error rates in long reads vs linked reads, we suggest starting with the following values:
m=8-10000
s=70
c=4
l=4
a=0.3
Note that lowering c
, l
and increasing a
may increase contiguity, but will likely increase the number of misassemblies as well.
Running alignment-free ARKS with linked reads ('--arks' mode) <a name=runarkslinked></a>
To run the pipeline in ARKS mode, run bin/arcs-make arcs
. For example, to scaffold the assembly my_scaffolds.fa
with the interleaved, longranger processed reads my_reads.fq.gz
, specifying a kmer size of 60:
arcs-make arks draft=my_scaffolds reads=my_reads k=60
For more info check bin/arcs-make help
.
To run the arcs
executable in ARKS mode, run arcs --arks
. For descriptions of all arguments, run arcs --help
.
Running alignment-free ARKS with long reads ('--arks-long' mode) <a name=runarkslong></a>
The arks-long mode first segments and assigns barcodes to the long reads, yielding pseudo-linked reads. Scaffolding is performed based on exact k-mer mapping of pseudo-linked reads to the input contigs.
To run the pipeline in arks-long mode, run bin/arcs-make arks-long
. For example, to scaffold the assembly my_scaffolds.fa
with long reads my_reads.fa.gz
or my_reads.fq.gz
, specifying a kmer size of 20 and j
of 0.05:
arcs-make arks-long draft=my_scaffolds reads=my_reads k=20 j=0.05
Parameters: To account for the higher error rates in long reads vs linked reads, we suggest starting with the following values:
m=8-10000
j=0.05
k=20
c=4
l=4
a=0.3
The input long reads can be gzipped or uncompressed.
Simulating pseudo-linked reads from long reads for --arks-long
and --arcs-long
modes <a name=pseudo></a>
Demo <a name=demo></a>
You can test your installation by running one of our supplied demos:
- ARCS:
Examples/arcs_test-demo
- ARCS-long:
Examples/arcs-long_test-demo
- ARKS:
Examples/arks_test-demo
- ARKS-long:
Examples/arks-long_test-demo
You can compare your output to the files provided in the output
folders within the above directories.
Using stLFR linked reads <a name=stlfr></a>
To use stLFR linked reads with ARCS, you will need to re-format the reads to have the barcode in a BX:Z:
tag in the read header.
For example, this format
@V100002302L1C001R017000000#0_0_0/1 0 1
TGTCTTCCTGGACAGCTGACATCCCTTTTGTTTTTCTGTTTGCTCAGATGCTGTCTCTTATACACATCTTAGGAAGACAAGCACTGACGACATGATCACC
+
FFFFFFFGFGFFGFDFGFFFFFFFFFFFGFFF@FFFFFFFFFFFF@FFFFFFFFFGGFFEFEFFFF?FFFFGFFFGFFFFFFFGFFEFGFGGFGFFFGFF
should be changed to:
@V100002302L1C001R017000000 BX:Z:0_0_0
TGTCTTCCTGGACAGCTGACATCCCTTTTGTTTTTCTGTTTGCTCAGATGCTGTCTCTTATACACATCTTAGGAAGACAAGCACTGACGACATGATCACC
+
FFFFFFFGFGFFGFDFGFFFFFFFFFFFGFFF@FFFFFFFFFFFF@FFFFFFFFFGGFFEFEFFFF?FFFFGFFFGFFFFFFFGFFEFGFGGFGFFFGFF
About ARCS/ARKS <a name=about></a>
Thank you for your and for using, developing and promoting this free software!
Citing ARCS/ARKS/LINKS <a name=cite></a>
If you use ARCS/ARKS/LINKS in your research, please cite:
Citing ARKS
<pre> ARKS: chromosome-scale scaffolding of human genome drafts with linked read kmers. Coombe L, Zhang J, Vandervalk BP, Chu J, Jackman SD, Birol I, Warren RL. BMC Bioinformatics. 2018 Jun 20;19(1):234. doi: 10.1186/s12859-018-2243-x. </pre>Citing ARCS
<pre> ARCS: scaffolding genome drafts with linked reads. Yeo S, Coombe L, Warren RL, Chu J, Birol I. Bioinformatics. 2018 Mar 1;34(5):725-731. doi: 10.1093/bioinformatics/btx675. </pre>NOTE: The supplementary data and scripts have been moved to http://www.bcgsc.ca/downloads/supplementary/ARCS/
Citing LINKS
<pre> LINKS: Scalable, alignment-free scaffolding of draft genomes with long reads. Warren RL, Yang C, Vandervalk BP, Behsaz B, Lagman A, Jones SJ, Birol I. Gigascience. 2015 Aug 4;4:35. doi: 10.1186/s13742-015-0076-3. eCollection 2015. </pre>License <a name=license></a>
ARCS Copyright (c) 2016-present British Columbia Cancer Agency Branch. All rights reserved.
ARCS is released under the GNU General Public License v3
This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 3.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.
For commercial licensing options, please contact Patrick Rebstein prebstein@bccancer.bc.ca