Distributed Differential Evolution With Adaptive Resource Allocation

Abstract

Distributed differential evolution (DDE) is an efficient paradigm that adopts multiple populations for cooperatively solving complex optimization problems. However, how to allocate fitness evaluation (FE) budget resources among the distributed multiple populations can greatly influence the optimization ability of DDE. Therefore, this article proposes a novel three-layer DDE framework with adaptive resource allocation (DDE-ARA), including the algorithm layer for evolving various differential evolution (DE) populations, the dispatch layer for dispatching the individuals in the DE populations to different distributed machines, and the machine layer for accommodating distributed computers. In the DDE-ARA framework, three novel methods are further proposed. First, a general performance indicator (GPI) method is proposed to measure the performance of different DEs. Second, based on the GPI, a FE allocation (FEA) method is proposed to adaptively allocate the FE budget resources from poorly performing DEs to well-performing DEs for better search efficiency. This way, the GPI and FEA methods achieve the ARA in the algorithm layer. Third, a load balance strategy is proposed in the dispatch layer to balance the FE burden of different computers in the machine layer for improving load balance and algorithm speedup. Moreover, theoretical analyses are provided to show why the proposed DDE-ARA framework can be effective and to discuss the lower bound of its optimization error. Extensive experiments are conducted on all the 30 functions of CEC 2014 competitions at 10, 30, 50, and 100 dimensions, and some state-of-the-art DDE algorithms are adopted for comparisons. The results show the great effectiveness and efficiency of the proposed framework and the three novel methods.