A Brief Survey into the Field of Automatic Image Dataset Generation through Web Scraping and Query Expansion

키워드

참고문헌 (40)

1. "How to create a deep learning dataset using google images" (2017)[URL]
2. D. M. Thomas, "Data analysis by web scraping using Python", Proceedings of 2019 3rd International Conference on Electronics, Communication and Aerospace Technology (ICECA), pp.450~454 (2019)
3. Daniel Glez-Peña, "Web scraping technologies in an API world", Briefings in Bioinformatics, 15(5), pp.788~797 (2013), Oxford University Press (OUP)[DOI]
4. F Schroff, "Harvesting Image Databases from the Web", IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(4), pp.754~766 (2011), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
5. Y. Yao, "Automatic image dataset construction with multiple textual metadata", Proceedings of 2016 IEEE International Conference on Multimedia and Expo (ICME), pp.1~6 (2016)
6. Y. Lin, "Syntactic annotations for the Google Books Ngram Corpus", Proceedings of the ACL 2012 System Demonstrations, pp.169~174 (2012)
7. "Automated dataset generation for image recognition using the example of taxonomy" (2018)[URL]
8. George A. Miller, "WordNet: a lexical database for English", Communications of the ACM, 38(11), pp.39~41 (1995), Association for Computing Machinery (ACM)[DOI]
9. "Word2Vec documentation" (2013)[URL]
10. A. Handler, "An empirical study of semantic similarity in WordNet and Word2Vec", Master, pp.2014
11. "LSUN: construction of a large-scale image dataset using deep learning with humans in the loop" (2015)[URL]
12. "Hardening of acception links through vectorized lexical functions" (2002)[URL]
13. B. Zhao, "Encyclopedia of Big Data", pp.1~3 (2017), Springer
14. "A comparative study on web scraping" (2015)[URL]
15. S. Upadhyay, "Articulating the construction of a web scraper for massive data extraction", Proceedings of 2017 2nd International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp.1~4 (2017)
16. Leo L. Pipino, "Data quality assessment", Communications of the ACM, 45(4), pp.211~218 (2002), Association for Computing Machinery (ACM)[DOI]
17. "7 steps to ensure and sustain quality data" (2019)[URL]
18. "Data Quality FAQ" (2022)[URL]
19. "5 Characteristics of data quality" (2022)[URL]
20. "Data Quality" (2022)[URL]
21. S. Dodge, "Understanding how image quality affects deep neural networks", Proceedings of 2016 8th International Conference on Quality of Multimedia Experience (QoMEX), pp.1~6 (2016)
22. "Image quality assessment guided deep neural networks training" (2017)[URL]
23. Z. Chen, "Image quality assessment based label smoothing in deep neural network learning", Proceedings of 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.6742~6746 (2018)
24. "How to ensure image dataset quality for image classification" (2023)[URL]
25. "Deep image quality assessment" (2021)[URL]
26. Weixia Zhang, "Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network", IEEE Transactions on Circuits and Systems for Video Technology, 30(1), pp.36~47 (2020), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
27. "Detect and remove duplicate images from a dataset for deep learning" (2020)[URL]
28. "Find and remove duplicate images in your dataset" (2021)[URL]
29. Lei Zhang, "Image search—from thousands to billions in 20 years", ACM Transactions on Multimedia Computing, Communications, and Applications, 9(1s), pp.1~20 (2013), Association for Computing Machinery (ACM)[DOI]
30. "Q&A about image search (reply: Bluequoll)" (2020)[URL]
31. Xingquan Zhu, "Class Noise vs. Attribute Noise: A Quantitative Study", Artificial Intelligence Review, 22(3), pp.177~210 (2004), Springer Science and Business Media LLC[DOI]
32. Shivani Gupta, "Dealing with Noise Problem in Machine Learning Data-sets: A Systematic Review", Procedia Computer Science, 161, pp.466~474 (2019), Elsevier BV[DOI]
33. "Guide to data cleaning: definition, benefits, components, and how to clean your data" (2023)[URL]
34. Liwen Vaughan, "Search engine coverage bias: evidence and possible causes", Information Processing & Management, 40(4), pp.693~707 (2004), Elsevier BV[DOI]
35. Abbe Mowshowitz, "Measuring search engine bias", Information Processing & Management, 41(5), pp.1193~1205 (2005), Elsevier BV[DOI]
36. "Google Guide: basic search tips" (2023)[URL]
37. "Labrador synonyms" (2023)[URL]
38. "To scrape or not to scrape: the potential legal implications of using web scraping for market research" (2021)[URL]
39. "is web scraping legal? A guide to understanding legality on web scraping" (2020)[URL]
40. "Removing content on Google" (2023)[URL]

관련 논문AI추천