Personal tools
You are here: Home Publications Fault Tolerance and Recovery of Scientific Workflows on Computational Grids
Document Actions

Gopi Kandaswamy, Anirban Mandal, and Daniel Reed (2008)

Fault Tolerance and Recovery of Scientific Workflows on Computational Grids

In: Workshop on Resiliency in High Performance Computing, in Proceedings of the IEEE International Symposium on Cluster Computing and the Grid, 2008 (CCGrid'08).

In this paper, we describe the design and implementation of two mechanisms for fault-tolerance and recovery for complex scientific workflows on computational grids. We present our algorithms for over-provisioning and migration, which are our primary strategies for fault-tolerance. We consider application performance models, resource reliability models, network latency and bandwidth and queue wait times for batch-queues on compute resources for determining the correct fault-tolerance strategy. Our goal is to balance reliability and performance in the presence of soft real-time constraints like deadlines and expected success probabilities, and to do it in a way that is transparent to scientists. We have evaluated our strategies by developing a Fault-Tolerance and Recovery (FTR) service and deploying it as a part of the Linked Environments for Atmospheric Discovery (LEAD) production infrastructure. Results from real usage scenarios in LEAD show that the failure rate of individual steps in workflows decreases from about 30% to 5% by using our fault-tolerance strategies.

by Anirban Mandal last modified 2008-05-16 10:58
« September 2010 »
Su Mo Tu We Th Fr Sa
1234
567891011
12131415161718
19202122232425
2627282930
 

VGrADS Collaborators include:

Rice University UCSD UH UCSB UTK ISI UTK

Powered by Plone