Nothing Special   »   [go: up one dir, main page]

FQSqueezer: k-mer-based compression of sequencing data

Sci Rep. 2020 Jan 17;10(1):578. doi: 10.1038/s41598-020-57452-6.

Abstract

The amount of data produced by modern sequencing instruments that needs to be stored is huge. Therefore it is not surprising that a lot of work has been done in the field of specialized data compression of FASTQ files. The existing algorithms are, however, still imperfect and the best tools produce quite large archives. We present FQSqueezer, a novel compression algorithm for sequencing data able to process single- and paired-end reads of variable lengths. It is based on the ideas from the famous prediction by partial matching and dynamic Markov coder algorithms known from the general-purpose-compressors world. The compression ratios are often tens of percent better than offered by the state-of-the-art tools. The drawbacks of the proposed method are large memory and time requirements.

Publication types

  • Research Support, Non-U.S. Gov't