A fast, lock-free approach for efficient parallel counting of occurrences of k-mers
Guillaume Marçais,Carl Kingsford +1 more
TL;DR: This work proposes a new k-mer counting algorithm and associated implementation, called Jellyfish, which is fast and memory efficient, based on a multithreaded, lock-free hash table optimized for counting k-mers up to 31 bases in length.
read more
Abstract: Motivation: Counting the number of occurrences of every k-mer (substring of length k) in a long string is a central subproblem in many applications, including genome assembly, error correction of sequencing reads, fast multiple sequence alignment and repeat detection. Recently, the deep sequence coverage generated by next-generation sequencing technologies has caused the amount of sequence to be processed during a genome project to grow rapidly, and has rendered current k-mer counting tools too slow and memory intensive. At the same time, large multicore computers have become commonplace in research facilities allowing for a new parallel computational paradigm.
Results: We propose a new k-mer counting algorithm and associated implementation, called Jellyfish, which is fast and memory efficient. It is based on a multithreaded, lock-free hash table optimized for counting k-mers up to 31 bases in length. Due to their flexibility, suffix arrays have been the data structure of choice for solving many string problems. For the task of k-mer counting, important in many biological applications, Jellyfish offers a much faster and more memory-efficient solution.
Availability: The Jellyfish software is written in C++ and is GPL licensed. It is available for download at http://www.cbcb.umd.edu/software/jellyfish.
Contact: [email protected]
Supplementary information:Supplementary data are available at Bioinformatics online.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
RecoverY: k-mer-based read classification for Y-chromosome-specific sequencing and assembly.
Samarth Rangavittal,Robert S. Harris,Monika Cechova,Marta Tomaszkiewicz,Rayan Chikhi,Kateryna D. Makova,Paul Medvedev +6 more
TL;DR: A method is developed, RecoverY, that selects Y-specific reads by automatically choosing the abundance level at which a k-mer is deemed to originate from the Y, demonstrating the power of automatic parameter selection.
Combining OSMAC Approach and Untargeted Metabolomics for the Identification of New Glycolipids with Potent Antiviral Activity Produced by a Marine Rhodococcus .
Fortunato Palma Esposito,Rosa Giugliano,Gerardo Della Sala,Giovanni Andrea Vitale,Carmine Buonocore,Carmine Buonocore,Janardhan Ausuri,Christian Galasso,Daniela Coppola,Gianluigi Franci,Massimiliano Galdiero,Donatella de Pascale,Donatella de Pascale +12 more
TL;DR: In this paper, the whole genome of the marine isolate Rhodococcus sp. I2R was sequenced and analyzed by antiSMASH for the identification of biosynthetic gene clusters.
22
Comparative genomics reveals a unique nitrogen-carbon balance system in Asteraceae
Feiying Shen,Rui-Min Wang,Xin Huang,Ying Wang,Tian-Gang Gao,Junna He,Yue Zhou,Yuannian Jiao,Lei Li,Xiaozeng Yang +9 more
TL;DR: It is shown that Asteraceae originated ~80 million years ago and experienced repeated paleopolyploidization, resulting in enhanced nitrogen uptake and fatty acid biosynthesis and the unique N-C balance system reported for Asteraceae offers a potential crop improvement strategy.
22
Repeated turnovers keep sex chromosomes young in willows
Deyan Wang,Yiling Li,Mengmeng Li,Wenlu Yang,Xinzhi Ma,Lei Zhang,Yubo Wang,Yanlin Feng,Yuanyuan Zhang,Ran Zhou,Brian J. Sanderson,Ken Keefover-Ring,Tongming Yin,Lawrence B. Smart,Stephen P. DiFazio,Jianquan Liu,Matthew S. Olson,Tao-Yan Ma +17 more
TL;DR: Zhang et al. as mentioned in this paper found that the sex determination mechanism of willows may have underlying similarities with poplars, both involving intact and/or partial homologs of a type A cytokinin response regulator (RR) gene.
The yellowtail (Seriola quinqueradiata) genome and transcriptome atlas of the digestive tract.
Motoshige Yasuike,Yuki Iwasaki,Issei Nishiki,Yoji Nakamura,Aiko Matsuura,Kazunori Yoshida,Tsutomu Noda,Tadashi Andoh,Atushi Fujiwara +8 more
TL;DR: The RNA-Seq results highlighted the importance of certain genes in encoding proteolytic enzymes necessary for digestion and absorption in the yellowtail gastrointestinal tract, and this finding will accelerate development of formulated feeds for this species.
22
References
MUSCLE: multiple sequence alignment with high accuracy and high throughput
TL;DR: MUSCLE is a new computer program for creating multiple alignments of protein sequences that includes fast distance estimation using kmer counting, progressive alignment using a new profile function the authors call the log-expectation score, and refinement using tree-dependent restricted partitioning.
45.1K
•Book
Introduction to Algorithms
Thomas H. Cormen,Charles E. Leiserson,Ronald L. Rivest +2 more
- 01 Jan 1990
TL;DR: The updated new edition of the classic Introduction to Algorithms is intended primarily for use in undergraduate or graduate courses in algorithms or data structures and presents a rich variety of algorithms and covers them in considerable depth while making their design and analysis accessible to all levels of readers.
24.8K
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
- 06 Dec 2004
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
A Whole-Genome Assembly of Drosophila
Eugene W. Myers,Granger G. Sutton,Arthur L. Delcher,Ian M. Dew,Dan P. Fasulo,Michael Flanigan,Saul A. Kravitz,Clark M. Mobarry,Knut Reinert,Karin A. Remington,Eric L. Anson,Randall Bolanos,Hui-Hsien Chou,Catherine Jordan,Aaron L. Halpern,Stefano Lonardi,Ellen M. Beasley,Rhonda C. Brandon,Lin Chen,Patrick J. Dunn,Zhongwu Lai,Yong Liang,Deborah R. Nusskern,Ming Zhan,Qing Zhang,Xiangqun Zheng,Gerald M. Rubin,Mark Raymond Adams,J. Craig Venter +28 more
TL;DR: The quality of a whole-genome assembly of Drosophila melanogaster and the nature of the computer algorithms that accomplished it are reported on and should be of substantial value to the scientific community.
1.6K