Influence of initialization on the performance of metaheuristic optimizers

Li, Qian, Liu, San-Yang and Yang, Xin-She ORCID: https://orcid.org/0000-0001-8231-5556 (2020) Influence of initialization on the performance of metaheuristic optimizers. Applied Soft Computing, 91 , 106193. ISSN 1568-4946 [Article] (Published online first) (doi:10.1016/j.asoc.2020.106193)

[img] PDF - Final accepted version (with author's formatting)
Restricted to Repository staff and depositor only until 24 February 2021.
Available under License Creative Commons Attribution-NonCommercial-NoDerivatives.

Download (14MB)

Abstract

All metaheuristic optimization algorithms require some initialization, and the initialization for such optimizers is usually carried out randomly. However, initialization can have some significant influence on the performance of such algorithms. This paper presents a systematic comparison of 22 different initialization methods on the convergence and accuracy of five optimizers: differential evolution (DE), particle swarm optimization (PSO), cuckoo search (CS), artificial bee colony (ABC) algorithm and genetic algorithm (GA). We have used 19 different test functions with different properties and modalities to compare the possible effects of initialization, population sizes and the numbers of iterations. Rigorous statistical ranking tests indicate that 43.37% of the functions using the DE algorithm show significant differences for different initialization methods, while 73.68% of the functions using both PSO and CS algorithms are significantly affected by different initialization methods. The simulations show that DE is less sensitive to initialization, while both PSO and CS are more sensitive to initialization. In addition, under the condition of the same maximum number of function evaluations (FEs), the population size can also have a strong effect. Particle swarm optimization usually requires a larger population, while the cuckoo search needs only a small population size. Differential evolution depends more heavily on the number of iterations, a relatively small population with more iterations can lead to better results. Furthermore, ABC is more sensitive to initialization, while such initialization has little effect on GA. Some probability distributions such as the beta distribution, exponential distribution and Rayleigh distribution can usually lead to better performance. The implications of this study and further research topics are also discussed in detail.

Item Type: Article
Keywords (uncontrolled): Initialization, differential evolution, particle swarm optimization, Cuckoo search, probability distribution
Research Areas: A. > School of Science and Technology > Design Engineering and Mathematics
Item ID: 29511
Notes on copyright: © 2020. This manuscript version is made available under the CC-BY-NC-ND 4.0 license
Useful Links:
Depositing User: Xin-She Yang
Date Deposited: 12 Mar 2020 12:13
Last Modified: 14 Mar 2020 00:11
URI: https://eprints.mdx.ac.uk/id/eprint/29511

Actions (login required)

View Item View Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year