Why Tuning the Control Parameters of Metaheuristic Algorithms Is So Important for Fair Comparison?
Institute of Automation and Computer Science, Brno University of Technology
Although metaheuristic optimization has become a common practice, new bio-inspired algorithms often suffer from a priori ill reputation. One of the reasons is a common bad practice in metaheuristic proposals. It is essential to pay attention to the quality of conducted experiments, especially when comparing several algorithms among themselves. The comparisons should be fair and unbiased. This paper points to the importance of proper initial parameter configurations of the compared algorithms. We highlight the performance differences with several popular and recommended parameter configurations. Even though the parameter selection was mostly based on comprehensive tuning experiments, the algorithms' performance was surprisingly inconsistent, given various parameter settings. Based on the presented evidence, we conclude that paying attention to the metaheuristic algorithm's parameter tuning should be an integral part of the development and testing processes.
Mendel. 2020 vol. 26, č. 2, s. 9-16. ISSN 1803-3814
Date of access to the full text
Language of document
Date of acceptance
Result of defence
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license