TY - CONF T1 - Query planning for the grid: adapting to dynamic resource availability T2 - Cluster Computing and the Grid, IEEE International Symposium on Y1 - 2005 A1 - Zhang,K. A1 - Andrade,H. A1 - Raschid, Louiqa A1 - Sussman, Alan AB - The availability of massive datasets, comprising sensor measurements or the results of scientific simulations, has had a significant impact on the methodology of scientific reasoning. Scientists require storage, bandwidth and computational capacity to query and analyze these datasets, to understand physical phenomena or to test hypotheses. This paper addresses the challenge of identifying and selecting resources to develop an evaluation plan for large scale data analysis queries when data processing capabilities and datasets are dispersed across nodes in one or more computing and storage clusters. We show that generating an optimal plan is hard and we propose heuristic techniques to find a good choice of resources. We also consider heuristics to cope with dynamic resource availability; in this situation we have stale information about reusable cached results (datasets) and the load on various nodes. JA - Cluster Computing and the Grid, IEEE International Symposium on PB - IEEE Computer Society CY - Los Alamitos, CA, USA VL - 2 SN - 0-7803-9074-1 M3 - http://doi.ieeecomputersociety.org/10.1109/CCGRID.2005.1558638 ER -