RA2: predicting simulation execution time for cloud-based design space explorations

Duong, Ta Nguyen Binh, Zhong, Jinghui, Cai, Wentong, Li, Zengxiang and Zhou, Suiping ORCID: https://orcid.org/0000-0002-9920-266X (2016) RA2: predicting simulation execution time for cloud-based design space explorations. 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). In: 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications, 21-23 Sept 2016, London. ISBN 9781509035052. ISSN 1550-6525 [Conference or Workshop Item] (doi:10.1109/DS-RT.2016.9)

Preview

PDF - Final accepted version (with author's formatting) Download (352kB) | Preview

Abstract

Design space exploration refers to the evaluation of implementation alternatives for many engineering and design problems. A popular exploration approach is to run a large number of simulations of the actual system with varying sets of configuration parameters to search for the optimal ones. Due to the potentially huge resource requirements, cloud-based simulation execution strategies should be considered in many cases. In this paper, we look at the issue of running large-scale simulation-based design space exploration problems on commercial Infrastructure-as-a-Service clouds, namely Amazon EC2, Microsoft Azure and Google Compute Engine. To efficiently manage cloud resources used for execution, the key problem would be to accurately predict the running time for each simulation instance in advance. This is not trivial due to the currently wide range of cloud resource types which offer varying levels of performance. In addition, the widespread use of virtualization techniques in most cloud providers often introduces unpredictable performance interference. In this paper, we propose a resource and application-aware (RA2) prediction approach to combat performance variability on clouds. In particular, we employ neural network based techniques coupled with non-intrusive monitoring of resource availability to obtain more accurate predictions. We conducted extensive experiments on commercial cloud platforms using an evacuation planning design problem over a month-long period. The results demonstrate that it is possible to predict simulation execution times in most cases with high accuracy. The experiments also provide some interesting insights on how we should run similar simulation problems on various commercially available clouds.

Actions (login required)

View Item

Statistics

DownloadsShow export options

Export as CSVXMLJSON

Activity Overview

6 month trend

235Downloads

6 month trend

358Hits

Additional statistics are available via IRStats2.