An Exploratory Study of Generative AI Service Quality using LDA Topic Modeling and Comparison with Existing Dimensions
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Artificial Intelligence (AI), especially in the domain of text-generative services, has witnessed a significant surge, with forecasts indicating the AI-as-a-Service (AIaaS) market reaching a valuation of $55.0 Billion by 2028. This research set out to explore the quality dimensions characterizing synthetic text media software, with a focus on four key players in the industry: ChatGPT, Writesonic, Jasper, and Anyword. Drawing from a comprehensive dataset of over 4,000 reviews sourced from a software evaluation platform, the study employed the Latent Dirichlet Allocation (LDA) topic modeling technique using the Gensim library. This process resulted the data into 11 distinct topics. Subsequent analysis involved comparing these topics against established AI service quality dimensions, specifically AICSQ and AISAQUAL. Notably, the reviews predominantly emphasized dimensions like availability and efficiency, while others, such as anthropomorphism, which have been underscored in prior literature, were absent. This observation is attributed to the inherent nature of the reviews of AI services examined, which lean more towards semantic understanding rather than direct user interaction. The study acknowledges inherent limitations, mainly potential biases stemming from the singular review source and the specific nature of the reviewer demographic. Possible future research includes gauging the real-world implications of these quality dimensions on user satisfaction and to discuss deeper into how individual dimensions might impact overall ratings.
Abstract
Artificial Intelligence (AI), especially in the domain of text-generative services, has witnessed a significant surge, with forecasts indicating the AI-as-a-Service (AIaaS) market reaching a valuation of $55.0 Billion by 2028. This research set out to explore the quality dimensions characterizing synthetic text media software, with a focus on four key players in the industry: ChatGPT, Writesonic, Jasper, and Anyword. Drawing from a comprehensive dataset of over 4,000 reviews sourced from a software evaluation platform, the study employed the Latent Dirichlet Allocation (LDA) topic modeling technique using the Gensim library. This process resulted the data into 11 distinct topics. Subsequent analysis involved comparing these topics against established AI service quality dimensions, specifically AICSQ and AISAQUAL. Notably, the reviews predominantly emphasized dimensions like availability and efficiency, while others, such as anthropomorphism, which have been underscored in prior literature, were absent. This observation is attributed to the inherent nature of the reviews of AI services examined, which lean more towards semantic understanding rather than direct user interaction. The study acknowledges inherent limitations, mainly potential biases stemming from the singular review source and the specific nature of the reviewer demographic. Possible future research includes gauging the real-world implications of these quality dimensions on user satisfaction and to discuss deeper into how individual dimensions might impact overall ratings.
참고문헌 (23)
- Barnes, S. J., "An evaluation of cyber-bookshops: the WebQual method", International Journal of Electronic Commerce, pp.11~30 (2001)
- Barnes, S. J., "An integrative approach to the assessment of e-commerce quality", J. Electron. Commer. Res, 3(3), pp.114~127 (2002)
- Chen, Q., "Classifying and measuring the service quality of AI chatbot in frontline service", Journal of Business Research, 145, pp.552~568 (2022)
- Davenport, T., "How artificial intelligence will change the future of marketing", Journal of the Academy of Marketing Science, 48(1), pp.24~42 (2020)
- "How to manage customer service technology innovation" (2019)[URL]
- "Gartner identifies the top strategic technology trends for 2022" (2021)[URL]
- Hacker, P., "Regulating ChatGPT and other large generative AI models", arXiv preprint arXiv:2302.02337, ~ (2023)
- "IBM Global AI Adoption Index 2022" (2022)[URL]
- "The evolution of chatbots from ELIZA to Bard. TechTarget" (2023)[URL]
- "Generative AI Ethics: 8 biggest concerns" (2023)[URL]
- Lee, S., "An Empirical Comparison of Four Text Mining Methods", Proceedings of the 43rd Hawaii International Conference on System Sciences, pp.1~10 (2010)
- "AI as a service market size & analysis, trends, growth, Revenue Forecast - 2028 &Opportunities: MarketsandMarketsTM" (2023)[URL]
- Noor, N., "Developing a service quality scale for artificial intelligence service agents", European Journal of Marketing, 56(5), pp.1301~1336 (2022)
- "Introducing chatgpt. Introducing ChatGPT" (2023)[URL]
- Poole, D. L., "Artificial Intelligence: Foundations of Computational Agents" (2010), Cambridge University Press
- Sievert, C., "LDAvis: A method for visualizing and interpreting topics", ~ (2014)
- Steyvers, M., "Latent Semantic Analysis: A Road to Meaning" (2007), Laurence Erlbaum
- "Ai in 2020:From experimentation to adoption" (2020)[URL]
- "Rate of generative AI adoption in the workplace in the United States 2023, by industry" (2023)[URL]
- Weizenbaum, J., "Eliza-a computer program for the study of natural language communication between man and Machine", Communications of the ACM, 9(1), pp.36~45 (1966)
- Wolfinbarger, M., "eTailQ : Dimensionalizing, measuring and predicting retail quality", Journal of Retailing, 79(3), pp.183~198 (2003)
- Yang, Z., "Consumer perception of e-service quality : from internet purchaser and non-purchaser perspectives", Journal of Business Strategies, 19(1), pp.19~42 (2002)