스파크 분산 환경 기반 효율적인 K-익명화 기법 연구
Efficient K-Anonymization Implementation with Apache Spark
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Today, we are living in the era of data and information. With the advent of Internet of Things (IoT), the popularity of social networking sites, and the development of mobile devices, a large amount of data is being produced in diverse areas. The collection of such data generated in various area is called big data. As the importance of big data grows, there has been a growing need to share big data containing information regarding an individual entity. As big data contains sensitive information about individuals, directly releasing it for public use may violate existing privacy requirements. Thus, privacy-preserving data publishing (PPDP) has been actively studied to share big data containing personal information for public use, while preserving the privacy of the individual. K-anonymity, which is the most popular method in the area of PPDP, transforms each record in a table such that at least k records have the same values for the given quasi-identifier attributes, and thus each record is indistinguishable from other records in the same class. As the size of big data continuously getting larger, there is a growing demand for the method which can efficiently anonymize vast amount of dta. Thus, in this paper, we develop an efficient k-anonymity method by using Spark distributed framework. Experimental results show that, through the developed method, significant gains in processing time can be achieved.
Abstract
Today, we are living in the era of data and information. With the advent of Internet of Things (IoT), the popularity of social networking sites, and the development of mobile devices, a large amount of data is being produced in diverse areas. The collection of such data generated in various area is called big data. As the importance of big data grows, there has been a growing need to share big data containing information regarding an individual entity. As big data contains sensitive information about individuals, directly releasing it for public use may violate existing privacy requirements. Thus, privacy-preserving data publishing (PPDP) has been actively studied to share big data containing personal information for public use, while preserving the privacy of the individual. K-anonymity, which is the most popular method in the area of PPDP, transforms each record in a table such that at least k records have the same values for the given quasi-identifier attributes, and thus each record is indistinguishable from other records in the same class. As the size of big data continuously getting larger, there is a growing demand for the method which can efficiently anonymize vast amount of dta. Thus, in this paper, we develop an efficient k-anonymity method by using Spark distributed framework. Experimental results show that, through the developed method, significant gains in processing time can be achieved.
참고문헌 (13)
- A. Narayanan, "Robust De-anonymi zation of Large Sparse Datasets", Proceedings of the 2008 IEEE Symposium on Security and Privacy Page (2008)
- 김종선, "프라이버시 보호 데이터 배포를 위한 모델 조사", 정보과학회논문지, 44(2), pp.195~207 (2017), 한국정보과학회
- B.C.M. Fung, "Privacy-pres erving data publishing: A survey of recent developments", ACM Computing Surveys, 42(4) (2010)
- N. Mohammed, "Centralized and distributed anonymization for high-dimensional healthcare data", ACM Transactions on Knowledge Discovery from Data, 4(4) (2010)
- L. Sweeney, "k-anonymity: A model for protecting privacy", International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 10(5), pp.557~570 (2002)
- L. Sweeney, "Achieving k-Anonymity Privacy Protection using Generalization and Suppression", International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 10(5), pp.571~588 (2002)
- K. LeFevre, "Incognito:Efficient full domain k-anonymity", Proceedings of the ACM SIGMOD International Conference on Management of Data (2005)
- J. Byun, "Efficient k-Anonym ization Using Clustering Technique", DASFAA 2007:Advances in Databases: Concepts, Systems and Applications, pp.188~200 (2007)
- S. Kim, "Privacy-preserving data cub for electronic medical records: An experimental evaluation", International Journal of medical Informatics (2017)
- "Apache Hadoop 2.8.4 API docs" (2018)[URL]
- Jens Dittrich, "Efficient big data processing in Hadoop MapReduce", Proceedings of the VLDB Endowment, 5(12), pp.2014~2015 (2012)
- "Apache Spark 2.3.0 API docs" (2018)[URL]
- "Health Insurance Review and Assessment Service in Korea" (2012)[URL]