Cost and fault-tolerant aware resource management for scientific workflows using hybrid instances on clouds

K. Vinay, S. M.Dilip Kumar, S. Raghavendra, K. R. Venugopal

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)

Abstract

Cloud service providers are offering computing resources at a reasonable price as a pay-per-use model. Further, cloud service providers have also introduced different pricing models like spot, blockspot and spotfleet instances that are cost effective and user’s have to go through the bidding to balance the reliability and monetary costs. Henceforth, Scientific Workflows (SWf) that are used to model applications of high throughput, computation and complex large-scale data analysis are significantly adopting these computing resources. Nevertheless, spot instances are terminated when the market spot price exceeds the users bid price. Moreover, failures are inevitable in such a large distributed systems and often pose a challenge to design a fault-tolerant scheduling algorithm for SWf. This paper presents an efficient, low-cost and fault-tolerant scheduling algorithm and a bidding strategy to minimize the volatility and cost of resource provisioning for SWf. The proposed algorithm uses spot and blockspot instances as hybrid instances in comparison with on-demand instance to reduce the execution cost and fault-tolerant while meeting the SWf deadline. The results obtained reveal the promising potential of the proposed scheduling algorithm and are demonstrated through empirical simulation study that is robust under short deadlines with minimal makespan and cost.

Original languageEnglish
Pages (from-to)10171-10193
Number of pages23
JournalMultimedia Tools and Applications
Volume77
Issue number8
DOIs
Publication statusPublished - 01-04-2018

All Science Journal Classification (ASJC) codes

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Cost and fault-tolerant aware resource management for scientific workflows using hybrid instances on clouds'. Together they form a unique fingerprint.

Cite this