Scientific article
Open access

LEMMI: a continuous benchmarking platform for metagenomics classifiers

Published inGenome Research
Publication date2020

Studies of microbiomes are booming, along with the diversity of computational approaches to make sense out of the sequencing data and the volumes of accumulated microbial genotypes. A swift evaluation of newly published methods and their improvements against established tools is necessary to reduce the time between the method's release and its adoption in microbiome analyses. The LEMMI platform offers a novel approach for benchmarking software dedicated to metagenome composition assessments based on read classification. It enables the integration of newly published methods in an independent and centralized benchmark designed to be continuously open to new submissions. This allows developers to be proactive regarding comparative evaluations and guarantees that any promising methods can be assessed side-by-side with established tools quickly after their release. Moreover, LEMMI enforces an effective distribution through software containers to ensure long term availability of all methods. Here, we detail the LEMMI workflow and discuss the performances of some previously unevaluated tools. We see this platform eventually as a community-driven effort where method developers can showcase novel approaches and get unbiased benchmarks for publications, while users can make informed choices and obtain standardized and easy-to-use tools.

Citation (ISO format)
SEPPEY, Mathieu, MANNI, Mose, ZDOBNOV, Evgeny. LEMMI: a continuous benchmarking platform for metagenomics classifiers. In: Genome Research, 2020. doi: 10.1101/gr.260398.119
Main files (1)
Article (Accepted version)
ISSN of the journal1088-9051

Technical informations

Creation07/21/2020 3:02:00 PM
First validation07/21/2020 3:02:00 PM
Update time03/15/2023 10:24:25 PM
Status update03/15/2023 10:24:25 PM
Last indexation10/19/2023 1:18:36 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack