How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics

Fong, Simon, Deb, Suash and Yang, Xin-She ORCID logoORCID: https://orcid.org/0000-0001-8231-5556 (2018) How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics. Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. In: ICACNI 2016: 4th International Conference on Advanced Computing, Networking and Informatics, 22-24 Sept 2016, Odisha , India. ISBN 9789811033728. ISSN 2194-5357 [Conference or Workshop Item] (doi:10.1007/978-981-10-3373-5_1)

[img]
Preview
PDF - Final accepted version (with author's formatting)
Download (1MB) | Preview

Abstract

Deep learning (DL) is one of the most emerging types of contemporary machine learning techniques that mimic the cognitive patterns of animal visual cortex to learn the new abstract features automatically by deep and hierarchical layers. DL is believed to be a suitable tool so far for extracting insights from very huge volume of so-called big data. Nevertheless, one of the three “V” or big data is velocity that implies the learning has to be incremental as data are accumulating up rapidly. DL must be fast and accurate. By the technical design of DL, it is extended from feed-forward artificial neural network with many multi-hidden layers of neurons called deep neural network (DNN). In the training process of DNN, it has certain inefficiency due to very long training time required. Obtaining the most accurate DNN within a reasonable run-time is a challenge, given there are potentially many parameters in the DNN model configuration and high dimensionality of the feature space in the training dataset. Meta-heuristic has a history of optimizing machine learning models successfully. How well meta-heuristic could be used to optimize DL in the context of big data analytics is a thematic topic which we pondered on in this paper. As a position paper, we review the recent advances of applying meta-heuristics on DL, discuss about their pros and cons and point out some feasible research directions for bridging the gaps between meta-heuristics and DL.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Paper published as: Fong S., Deb S., Yang X. (2018) How Meta-heuristic Algorithms Contribute to Deep Learning in the Hype of Big Data Analytics. In: Sa P., Sahoo M., Murugappan M., Wu Y., Majhi B. (eds) Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. Advances in Intelligent Systems and Computing, vol 518. Springer, Singapore
Research Areas: A. > School of Science and Technology > Design Engineering and Mathematics
Item ID: 22276
Notes on copyright: This is a pre-copyedited version of a contribution published in Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. Advances in Intelligent Systems and Computing, vol 518, editors Sa P., Sahoo M., Murugappan M., Wu Y., Majhi B. published by Springer, Singapore. The definitive authenticated version is available online via https://doi.org/10.1007/978-981-10-3373-5_1
Depositing User: Xin-She Yang
Date Deposited: 24 Jul 2017 15:56
Last Modified: 29 Nov 2022 20:18
URI: https://eprints.mdx.ac.uk/id/eprint/22276

Actions (login required)

View Item View Item

Statistics

Activity Overview
6 month trend
679Downloads
6 month trend
829Hits

Additional statistics are available via IRStats2.