RA2: predicting simulation execution time for cloud-based design space explorations

Duong, Ta Nguyen Binh, Zhong, Jinghui, Cai, Wentong, Li, Zengxiang and Zhou, Suiping ORCID logoORCID: https://orcid.org/0000-0002-9920-266X (2016) RA2: predicting simulation execution time for cloud-based design space explorations. 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). In: 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications, 21-23 Sept 2016, London. ISBN 9781509035052. ISSN 1550-6525 [Conference or Workshop Item] (doi:10.1109/DS-RT.2016.9)

PDF - Final accepted version (with author's formatting)
Download (352kB) | Preview


Design space exploration refers to the evaluation of implementation alternatives for many engineering and design problems. A popular exploration approach is to run a large number of simulations of the actual system with varying sets of configuration parameters to search for the optimal ones. Due to the potentially huge resource requirements, cloud-based simulation execution strategies should be considered in many cases. In this paper, we look at the issue of running large-scale simulation-based design space exploration problems on commercial Infrastructure-as-a-Service clouds, namely Amazon EC2, Microsoft Azure and Google Compute Engine. To efficiently manage cloud resources used for execution, the key problem would be to accurately predict the running time for each simulation instance in advance. This is not trivial due to the currently wide range of cloud resource types which offer varying levels of performance. In addition, the widespread use of virtualization techniques in most cloud providers often introduces unpredictable performance interference. In this paper, we propose a resource and application-aware (RA2) prediction approach to combat performance variability on clouds. In particular, we employ neural network based techniques coupled with non-intrusive monitoring of resource availability to obtain more accurate predictions. We conducted extensive experiments on commercial cloud platforms using an evacuation planning design problem over a month-long period. The results demonstrate that it is possible to predict simulation execution times in most cases with high accuracy. The experiments also provide some interesting insights on how we should run similar simulation problems on various commercially available clouds.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 23689
Notes on copyright: © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Useful Links:
Depositing User: Suiping Zhou
Date Deposited: 28 Feb 2018 11:24
Last Modified: 29 Nov 2022 21:37
URI: https://eprints.mdx.ac.uk/id/eprint/23689

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.