Batch Resizing Policies and Techniques for Fine-Grain Grid Tasks: The Nuts and Bolts
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
The overhead of processing fine-grain tasks on a grid induces the need for batch processing or task group deployment in order to minimise overall application turnaround time. When deciding the granularity of a batch, the processing requirements of each task should be considered as well as the utilisation constraints of the interconnecting network and the designated resources. However, the dynamic nature of a grid requires the batch size to be adaptable to the latest grid status. In this paper, we describe the policies and the specific techniques involved in the batch resizing process. We explain the nuts and bolts of these techniques in order to maximise the resulting benefits of batch processing. We conduct experiments to determine the nature of the policies and techniques in response to a real grid environment. The techniques are further investigated to highlight the important parameters for obtaining the appropriate task granularity for a grid resource.
Abstract
The overhead of processing fine-grain tasks on a grid induces the need for batch processing or task group deployment in order to minimise overall application turnaround time. When deciding the granularity of a batch, the processing requirements of each task should be considered as well as the utilisation constraints of the interconnecting network and the designated resources. However, the dynamic nature of a grid requires the batch size to be adaptable to the latest grid status. In this paper, we describe the policies and the specific techniques involved in the batch resizing process. We explain the nuts and bolts of these techniques in order to maximise the resulting benefits of batch processing. We conduct experiments to determine the nature of the policies and techniques in response to a real grid environment. The techniques are further investigated to highlight the important parameters for obtaining the appropriate task granularity for a grid resource.
참고문헌 (21)
- F. Berman, "Grid Computing - Making the Global Infrastructure a Reality" (2003), Wiley and Sons
- R. Buyya, "Neuroscience Instrumentation and Distributed Analysis of Brain Activity Data: A Case for e-Science on Global Grids", Concurrency and Computation: Practice and Experience (CCPE), 17(15), pp.1783~1798 (2005)
- M. Baker, "Grids and Grid Technologies for Wide-Area Distributed Computing", Software: Practice and Experience (SPE), 32(15), pp.1437~1466 (2002)
- B. Jacob, "Introduction to Grid Computing" (2005), IBM Publication
- S. Venugopal, "A Grid Service Broker for Scheduling e-Science Applications on Global Data Grids", Concurrency and Computation: Practice and Experience (CCPE), 18, pp.685~699 (2006)
- H. James, "Scheduling Independent Tasks on Meta-Computing Systems", Proceedings of Parallel and Distributed Computing Systems, Fort Lauderdale, pp.156~162 (1999)
- E. G. Coffman, Jr, "Batch Sizing and Job Sequencing on a Single Machine", Annals of Operation Research, 26(1), pp.135~147 (1990)
- T. Cheng, "Single Machine Batch Scheduling with Sequential Job Processing", IIE Transactions, 33(5), pp.413~420 (2001)
- G. Mosheiov, "A Single Machine Batch Scheduling Problem with Bounded Batch Size", European Journal of Operational Research, 187(3), pp.1069~1079 (2008)
- K. E. Maghraoui, "The Internet Operating System: Middleware for Adaptive Distributed Computing", International Journal of High Performance Computing Applications, 20(4), pp.467~480 (2006)
- A. C. Sodan, "Group-based Optimisation for Parallel Job Scheduling with Scojo-PECT-O", Proceedings of the 22nd International Symposium on High Performance Computing Systems and Applications, pp.102~109 (2008), IEEE Computer Society.
- N. Muthuvelu, "A Dynamic Job Groupingbased Scheduling for Deploying Applications with Fine-Grained Tasks on Global Grids", Proceedings of the Australasian Workshop on Grid Computing and E-Research, pp.41~48 (2005), Australian Computer Society, Inc
- W. K. Ng, "Scheduling Framework for Bandwidth-Aware Job Groupingbased Scheduling in Grid Computing", Malaysian Journal of Computer Science, 19(2), pp.117~126 (2006)
- "Behind the Benchmarks: Spec" (2000)[URL]
- N. Muthuvelu, "An Adaptive and Parameterized Job Grouping Algorithm for Scheduling Grid Jobs", Proceedings of the 10th International Conference on Advanced Communication Technology, 통권 : 2, pp.975~980 (2008)
- N. Muthuvelu, "On-line Task Granularity Adaptation for Dynamic Grid Applications", Proceedings of the 10th International Conference on Algorithms and Architectures for Parallel Processing, 통권 : 6081, pp.266~277 (2010)
- A. Ghobadi, "An Adaptive Wrapper Algorithm for File Transfer Applications to Support Optimal Large File Transfers", Proceedings of the 11th International Conference on Advanced Communication Technology, p.315-320, Piscataway, NJ, USA (2009), IEEE Press
- J. Feng, "Resource Usage Policy Expression and Enforcement in Grid Computing", Proceedings of the 8th IEEE, 2007, 66~73[DOI]
- "Fallacies of Distributed Computing Explained" (2007)[URL]
- B. Lowekamp, "A Hierarchy of Network Performance Characteristics for Grid Applications and Services", Global Grid Forum (2003)
- P. Huang, "Static Strategy and Dynamic Adjustment: An Effective Method for Grid Task Scheduling", Future Generation Computer Systems (FGCS), 25(8), pp.884~892 (2009)