A genetic algorithm based approach for scheduling decomposable Data Grid applications

Seonho Kim, Jon B Weissman

Research output: Contribution to journalConference articlepeer-review

75 Scopus citations

Abstract

Data Grid technology promises geographically distributed scientists to access and share physically distributed resources such as compute resource, networks, storage, and most importantly data collections for large-scale data intensive problems. Because of the massive size and distributed nature of these datasets, scheduling Data Grid applications must consider communication and computation simultaneously to achieve high performance. In many Data Grid applications, Data can be decomposed into multiple independent sub datasets and distributed for parallel execution and analysis. In this paper, we exploit this property and propose a novel Genetic Algorithm based approach that automatically decomposes data onto communication and computation resources. The proposed GA-based scheduler takes advantage of the parallelism of decomposable Data Grid applications to achieve the desired performance level. We evaluate the proposed approach comparing with other algorithms. Simulation results show that the proposed GA-based approach can be a competitive choice for scheduling large Data Grid applications in terms of both scheduling overhead and the relative solution quality as compared to other algorithms.

Original languageEnglish (US)
Pages (from-to)406-413
Number of pages8
JournalProceedings of the International Conference on Parallel Processing
StatePublished - Dec 17 2004
EventProceedings - 2004 International Conference on Parallel Processing, ICPP 2004 - Montreal, Que, Canada
Duration: Aug 15 2004Aug 18 2004

Fingerprint Dive into the research topics of 'A genetic algorithm based approach for scheduling decomposable Data Grid applications'. Together they form a unique fingerprint.

Cite this