Evolutionary deep learning: A survey
- Title
- Evolutionary deep learning: A survey
- Author
- Jun Zhang
- Keywords
- Deep learning; Evolutionary computation; Evolutionary algorithm; Swarm intelligence; Evolutionary deep learning; Artificial intelligence
- Issue Date
- 2022-04-28
- Publisher
- ELSEVIER
- Citation
- NEUROCOMPUTING, v. 483, page. 42-58
- Abstract
- As an advanced artificial intelligence technique for solving learning problems, deep learning (DL) has achieved great success in many real-world applications and attracted increasing attention in recent years. However, as the performance of DL depends on many factors such as the architecture and hyperparameters, how to optimize DL has become a hot research topic in the field of DL and artificial intelligence. Evolutionary computation (EC), including evolutionary algorithm and swarm intelligence, is a kind of efficient and intelligent optimization methodology inspired by the mechanisms of biological evolution and behaviors of swarm organisms. Therefore, a large number of researches have proposed EC algorithms to optimize DL, so called evolutionary deep learning (EDL), which have obtained promising results. Given the great progress and rapid development of EDL in recent years, it is quite necessary to review these developments in order to summarize previous research experiences and knowledge, as well as provide references to benefit the development of more researches and applications. For this aim, this paper categorizes existing works in a two-level taxonomy. The higher level includes four categories based on when the EC can be adopted in optimizing the DL, which are the four procedures of the whole DL lifetime, including data processing, model search, model training, and model evaluation and utilization. In the lower level, related works in each category are further classified according to the functionality and the aim of using EC in the corresponding DL procedure, i.e., why using EC in this DL procedure. As a result, the taxonomy can clearly show how an EC algorithm can be used to optimize and improve DL. Moreover, this survey also discusses the potential research directions to provide the prospect of EDL in the future. (c) 2022 Published by Elsevier B.V.
- URI
- https://www.sciencedirect.com/science/article/pii/S0925231222001345https://repository.hanyang.ac.kr/handle/20.500.11754/191934
- ISSN
- 0925-2312
- DOI
- https://doi.org/10.1016/j.neucom.2022.01.099
- Appears in Collections:
- COLLEGE OF ENGINEERING SCIENCES[E](공학대학) > ELECTRICAL ENGINEERING(전자공학부) > Articles
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML