Concurrency Control Method to Provide Transactional Processing for Cloud Data Management System
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
As new applications of cloud data management system (CDMS) such as online games, cooperation edit, social network, and so on, are increasing, transaction processing capabilities for CDMS are required. Several transaction processing methods for cloud data management system (CDMS) have been proposed. However, existing transaction processing methods have some problems. Some of them provide limited transaction processing capabilities. Some of them are hard to be integrated with existing CDMSs. In this paper, we proposed a new concurrency control method to support transaction processing capability for CDMS to solve these problems. The proposed method was designed and implemented based on Spark, an in-memory distributed processing framework. It uses RDD (Resilient Distributed Dataset) model to provide fault tolerant to data in the main memory. In our proposed method, database stored in CDMS is loaded to main memory managed by Spark. The loaded data set is then transformed to RDD. In addition, we proposed a multi-version concurrency control method through immutable characteristics of RDD. Finally, we performed experiments to show the feasibility of the proposed method.
Abstract
As new applications of cloud data management system (CDMS) such as online games, cooperation edit, social network, and so on, are increasing, transaction processing capabilities for CDMS are required. Several transaction processing methods for cloud data management system (CDMS) have been proposed. However, existing transaction processing methods have some problems. Some of them provide limited transaction processing capabilities. Some of them are hard to be integrated with existing CDMSs. In this paper, we proposed a new concurrency control method to support transaction processing capability for CDMS to solve these problems. The proposed method was designed and implemented based on Spark, an in-memory distributed processing framework. It uses RDD (Resilient Distributed Dataset) model to provide fault tolerant to data in the main memory. In our proposed method, database stored in CDMS is loaded to main memory managed by Spark. The loaded data set is then transformed to RDD. In addition, we proposed a multi-version concurrency control method through immutable characteristics of RDD. Finally, we performed experiments to show the feasibility of the proposed method.
참고문헌 (16)
- Y. Shi, "Benchmarking Cloud-based Data Management Systems", Proc. CloudDB '10, pp.47~54 (2010)
- F. Chang, "Bigtable: A Distributed Storage System for Structured Data", ACM Transactions on Computer Systems, 26(2), pp.4~ (2008)
- A. Lakshman, "Cassandra: A Decentralized Structured Storage System", ACM SIGOPS Operating Systems Review, 44(2), pp.35~40 (2010)
- A. Khetrapal, "HBase and Hypertable for Large Scale Distributed Storage Systems", Dept. of Computer Science, pp.2006
- M. Brantner, "Building a Database on S3", Proc. ACM SIGMOD ’08, pp.251~264 (2008)
- D. Lomet, "Locking Key Ranges with Unbundled Transaction Services", Proc. VLDB Endowment, pp.265~276 (2009)
- S. Das, "ElasTraS: An Elastic Transactional Data Store in the Cloud", Proc. USENIX HotCloud Workshop, pp.131~142 (2009)
- S. Das, "G-store: A Scalable Data Store for Transactional Multi Key Access in the Cloud", Proc. 1st ACM Symposium on Cloud Computing, pp.163~174 (2010)
- Z. Wei, "Scalable Transactions for Web Applications in the Cloud", Proc. Euro-Par 2009Parallel Processing, pp.442~453 (2009)
- J. Baker, "Megastore: Providing Scalable, Highly Available Storage for Interactive Services", Proc. CIDR, pp.223~234 (2011)
- J. J. Levandoski, "Deuteronomy: Transaction Support for Cloud Data", Proc. CIDR, pp.123~133 (2011)
- T. Kim, "Dynamic Partition Lock Method to Reduce Transaction Abort Rates in Cloud Data Management Systems", Cluster Computing Journal, 18(1), pp.233~242 (2014)
- H. A. Mahmoud, "MaaT: Effective and Scalable Coordination of Distributed Transactions in the Cloud", Proc. VLDB Endowment, 7(5), pp.329~340 (2014)
- A. Dey, "Scalable Distributed Transactions across Heterogeneous Store", Proc. ICDE, pp.125~136 (2014)
- M. Zaharia, "Spark: Cluster Computing with Working Sets", Proc. the 2nd USENIX Conference on Hot Topics in Cloud Computing, pp.10~ (2010)
- A. Adya, "Generalized Isolation Level Definitions", Proc. IEEE Conference on Data Engineering, pp.67~78 (2000)