Alignment-free methods are one of the mainstays of biological sequence comparison, i.e., the assessment of how similar two biological sequences are to each other, a fundamental and routine task in computational biology and bioinformatics. They have gained popularity since, even on standard desktop machines, they are faster than methods based on alignments. However, with the advent of Next-Generation Sequencing Technologies, datasets whose size, i.e., number of sequences and their total length, is a challenge to the execution of alignment-free methods on those standard machines are quite common. Here, we propose the first paradigm for the computation of k-mer-based alignment-free methods for Apache Hadoop that extends the problem sizes that can be processed with respect to a standard sequential machine while also granting a good time performance. Technically, as opposed to a standard Hadoop implementation, its effectiveness is achieved thanks to the incremental management of a persistent hash table during the map phase, a task not contemplated by the basic Hadoop functions and that can be useful also in other contexts.

Cattaneo, G., Umberto Ferraro, P., Giancarlo, R., & Roscigno, G. (2017). An effective extension of the applicability of alignment-free biological sequence comparison algorithms with Hadoop. THE JOURNAL OF SUPERCOMPUTING, 73(4), 1467-1483 [10.1007/s11227-016-1835-3].

An effective extension of the applicability of alignment-free biological sequence comparison algorithms with Hadoop

Giancarlo, Raffaele;
2017

Abstract

Alignment-free methods are one of the mainstays of biological sequence comparison, i.e., the assessment of how similar two biological sequences are to each other, a fundamental and routine task in computational biology and bioinformatics. They have gained popularity since, even on standard desktop machines, they are faster than methods based on alignments. However, with the advent of Next-Generation Sequencing Technologies, datasets whose size, i.e., number of sequences and their total length, is a challenge to the execution of alignment-free methods on those standard machines are quite common. Here, we propose the first paradigm for the computation of k-mer-based alignment-free methods for Apache Hadoop that extends the problem sizes that can be processed with respect to a standard sequential machine while also granting a good time performance. Technically, as opposed to a standard Hadoop implementation, its effectiveness is achieved thanks to the incremental management of a persistent hash table during the map phase, a task not contemplated by the basic Hadoop functions and that can be useful also in other contexts.
Settore INF/01 - Informatica
Cattaneo, G., Umberto Ferraro, P., Giancarlo, R., & Roscigno, G. (2017). An effective extension of the applicability of alignment-free biological sequence comparison algorithms with Hadoop. THE JOURNAL OF SUPERCOMPUTING, 73(4), 1467-1483 [10.1007/s11227-016-1835-3].
File in questo prodotto:
File Dimensione Formato  
10.1007_s11227-016-1835-3.pdf

accesso aperto

Tipologia: Versione Editoriale
Dimensione 867.24 kB
Formato Adobe PDF
867.24 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/10447/251137
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 18
social impact