How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics

Fong, Simon, Deb, Suash and Yang, Xin-She ORCID: https://orcid.org/0000-0001-8231-5556 (2018) How meta-heuristic algorithms contribute to deep learning in the hype of big data analytics. Progress in Intelligent Computing Techniques: Theory, Practice, and Applications. In: ICACNI 2016: 4th International Conference on Advanced Computing, Networking and Informatics, 22-24 Sept 2016, Odisha , India. ISBN 9789811033728. ISSN 2194-5357 [Conference or Workshop Item] (doi:10.1007/978-981-10-3373-5_1)

Preview

PDF - Final accepted version (with author's formatting) Download (1MB) | Preview

Abstract

Deep learning (DL) is one of the most emerging types of contemporary machine learning techniques that mimic the cognitive patterns of animal visual cortex to learn the new abstract features automatically by deep and hierarchical layers. DL is believed to be a suitable tool so far for extracting insights from very huge volume of so-called big data. Nevertheless, one of the three “V” or big data is velocity that implies the learning has to be incremental as data are accumulating up rapidly. DL must be fast and accurate. By the technical design of DL, it is extended from feed-forward artificial neural network with many multi-hidden layers of neurons called deep neural network (DNN). In the training process of DNN, it has certain inefficiency due to very long training time required. Obtaining the most accurate DNN within a reasonable run-time is a challenge, given there are potentially many parameters in the DNN model configuration and high dimensionality of the feature space in the training dataset. Meta-heuristic has a history of optimizing machine learning models successfully. How well meta-heuristic could be used to optimize DL in the context of big data analytics is a thematic topic which we pondered on in this paper. As a position paper, we review the recent advances of applying meta-heuristics on DL, discuss about their pros and cons and point out some feasible research directions for bridging the gaps between meta-heuristics and DL.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

679Downloads

6 month trend

829Hits

Additional statistics are available via IRStats2.