An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The cloud environment makes it possible to analyze large data sets in a scalable computing infrastructure. In the bioinformatics field, the applications are composed of the complex workflow tasks, which require huge data storage as well as a computing-intensive parallel workload. Many approaches have been introduced in distributed solutions. However, they focus on static resource provisioning with a batchprocessing scheme in a local computing farm and data storage. In the case of a largescale workflow system, it is inevitable and valuable to outsource the entire or a part of their tasks to public clouds for reducing resource costs. The problems, however, occurred at the transfer time for huge dataset as well as there being an unbalanced completion time of different problem sizes. In this paper, we propose an adaptive resourceprovisioning scheme that includes run-time data distribution and collection services for hiding the data transfer time. The proposed adaptive resource-provisioning scheme optimizes the allocation ratio of computing elements to the different datasets in order to minimize the total makespan under resource constraints. We conducted the experiments with a well-known sequence alignment algorithm and the results showed that the proposed scheme is efficient for the cloud environment.
Abstract
The cloud environment makes it possible to analyze large data sets in a scalable computing infrastructure. In the bioinformatics field, the applications are composed of the complex workflow tasks, which require huge data storage as well as a computing-intensive parallel workload. Many approaches have been introduced in distributed solutions. However, they focus on static resource provisioning with a batchprocessing scheme in a local computing farm and data storage. In the case of a largescale workflow system, it is inevitable and valuable to outsource the entire or a part of their tasks to public clouds for reducing resource costs. The problems, however, occurred at the transfer time for huge dataset as well as there being an unbalanced completion time of different problem sizes. In this paper, we propose an adaptive resourceprovisioning scheme that includes run-time data distribution and collection services for hiding the data transfer time. The proposed adaptive resource-provisioning scheme optimizes the allocation ratio of computing elements to the different datasets in order to minimize the total makespan under resource constraints. We conducted the experiments with a well-known sequence alignment algorithm and the results showed that the proposed scheme is efficient for the cloud environment.
참고문헌 (16)
- C. H. Youn, "A Cooperative Metabolic Syndrome Estimation with High Precision Sensing Unit", IEEE Transaction on Biomedical Engineering, 58(3), pp.809~813 (2011)
- G. O. Young, "Synthetic Structure of Industrial Plastics, in Plastics, 2nd ed. vol. 3", pp.1564~ (1964), McGraw-Hill
- D. Sulakhe, "GNARE - A Grid-based Server for the Analysis of User Submitted Genomes", Nucleic Acids Res, NAR-00335-Web-B-2007.Rl (2007)
- Maltsev N., "PUMA2Grid-based High-throughput Analysis of Genomes and Metabolic Pathways", Nucleic Acids Res, 34 (2006)
- C. S. Schuster, "Next-generation Sequencing Transforms Today’s Biology", Nature Methods, 5 (2008)
- "Apache Hadoop"[URL]
- Li, H., "A Survey of Sequence Alignment Algorithms for Next-Generation Sequencing", Briefings in Bioinformatics, 11(5) (2010)
- Li H., "Fast and Accurate Long-read Alignment with Buffows-Wheeler Transform" (2010), Bioinformatics, Epub
- Ahn. S, "The first Korean Genome Sequence and Analysis: Full Genome Sequencing for a Socio-ethnic Group" (2009), Genome Research
- Altschul, S.F., "Basic Local Alignment Search Tool", Journal of Molecular Biology, 215(3) (1990)
- "Kepler Project"[URL]
- Li H, "The Sequence Alignment", Map format and SAMtools, 2009
- "DNA Sequencing"[URL]
- Shengzhong Deng, "(A)Study on policy adjuster integrated grid workflow management system", 석사, pp.2008
- C. H Han, "Web-Based System for Advanced Heart Disease Identification Using Grid Computing Technology", 21st IEEE International Symposium on Computer-Based Medical Systems (2008)
- 윤찬현, "Resource reconfiguration scheme based on temporal quorum status estimation for grid management", IEICE TRANSACTIONS ON COMMUNICATIONS, E88B(11), pp.4378~4381, IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG