Essential guidelines for computational method benchmarking
Authors:
Lukas M. Weber,
Wouter Saelens,
Robrecht Cannoodt,
Charlotte Soneson,
Alexander Hapfelmeier,
Paul P. Gardner,
Anne-Laure Boulesteix,
Yvan Saeys,
Mark D. Robinson
Abstract:
In computational biology and other sciences, researchers are frequently faced with a choice between several computational methods for performing data analyses. Benchmarking studies aim to rigorously compare the performance of different methods using well-characterized benchmark datasets, to determine the strengths of each method or to provide recommendations regarding suitable choices of methods f…
▽ More
In computational biology and other sciences, researchers are frequently faced with a choice between several computational methods for performing data analyses. Benchmarking studies aim to rigorously compare the performance of different methods using well-characterized benchmark datasets, to determine the strengths of each method or to provide recommendations regarding suitable choices of methods for an analysis. However, benchmarking studies must be carefully designed and implemented to provide accurate, unbiased, and informative results. Here, we summarize key practical guidelines and recommendations for performing high-quality benchmarking analyses, based on our experiences in computational biology.
△ Less
Submitted 3 June, 2019; v1 submitted 3 December, 2018;
originally announced December 2018.
