본문 바로가기
KERD
논문KCI 등재

AI 자동 뉴스 추천 서비스 사용자가 인지하는 정보 편향성에 대한 연구: AI 서비스의 윤리 원칙 수립을 중심으로

A Study on Information Bias Perceived by Users of AI-driven News Recommendation Services: Focusing on the Establishment of Ethical Principles for AI Services

박민정|채상미
한국지식경영학회 (The Knowledge Management Society of Korea)|2024.09|지식경영연구 (Knowledge Management Research)|제25권 제3호|pp. 47-71|DOI 10.15813/kmr.2024.25.3.003

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

인공지능지식경영Artificial Intelligence (AI)Knowledge managementInformation biasAI 윤리 원칙AI 뉴스 추천 시스템정보 편향AI ethical principlesAI news recommendation system
주제분류경영학

초록

오늘날 대중화된 AI 뉴스 추천 시스템은 개인화된 뉴스 소비 경험을 제공하여 뉴스 등 다양한 콘텐츠를 사용자가 소 비하는 과정에서 효율성을 향상시킨 반면에 특정 관점의 정보만을 제공하여 사용자의 정보 편향성을 심화할 수 있다는 우려가 제기되고 있다. 이는 사용자의 다양한 정보 접근을 제한하는 동시에 특정 사안에 대한 올바른 시각의 형성을 방 해하여 필터 버블, 에코 챔버 등의 사회적 문제 현상을 강화하여 사회적 격차 및 정보 불균형을 심화시킬 수 있다. 이에 본 연구는 AI 기반 뉴스 추천 서비스 사용자가 인지하는 정보 편향성에 미치는 영향을 탐색하여 AI 서비스의 윤리 원칙 수립을 위한 기반을 제공하고자 한다. 이를 위하여 AI 뉴스 추천 시스템에 대하여 사용자가 기대하는 책무성, 설명요구 권, 선택권, 프라이버시 보호 지원의 윤리적 원칙이 사용자가 인지하는 정보 편향성에 영향을 미치는지 확인하였다. 이를 통해 AI 제공기업의 윤리적 원칙 강화 필요성을 제기하는 동시에 서비스 품질의 향상을 통한 사용자의 신뢰 기반 지속 적 사용을 촉진할 수 있을 것으로 예상된다. 또한, AI 서비스를 설계하는 과정에서 우선적으로 고려하여야 하는 윤리 원 칙을 본 연구에서 확인함에 따라 본 연구의 결과는 기업의 윤리 원칙 프레임워크 및 내부 정책 수립 및 국내 AI 윤리 가이드라인 등 관련 정책 수립의 토대가 될 것으로 판단된다.

Abstract

AI-driven news recommendation systems are widely used today, providing personalized news consumption experiences. However, there are significant concerns that these systems might increase users' information bias by mainly showing information from limited perspectives. This lack of diverse information access can prevent users from forming well-rounded viewpoints on specific issues, leading to social problems like Filter bubbles or Echo chambers. These issues can deepen social divides and information inequality. This study aims to explore how AI-based news recommendation services affect users' perceived information bias and to create a foundation for ethical principles in AI services. Specifically, the study looks at the impact of ethical principles like accountability, the right to explanation, the right to choose, and privacy protection on users' perceptions of information bias in AI news systems. The findings emphasize the need for AI service providers to strengthen ethical standards to improve service quality and build user trust for long-term use. By identifying which ethical principles should be prioritized in the design and implementation of AI services, this study aims to help develop corporate ethical frameworks, internal policies, and national AI ethics guidelines.

참고문헌 (68)

  1. 김준영, "누가 보안에 더 신경을 쓰는가? : 성격특성이 pc 보안의도에 미치는 영향", 경영정보학연구, 20(1), pp.99~114 (2018)
  2. 김형지, "가짜뉴스와 팩트체크 뉴스 노출 집단의 미디어 이용과 뉴스 인식, 그리고리터러시 관계", 한국언론정보학보, 101, pp.231~267 (2020)
  3. 박승택, "기계학습기반의 뉴스 추천 서비스 구조와 그 효과에 대한 고찰 : 카카오의루빅스를 중심으로", 사이버커뮤니케이션학보, 34(1), pp.5~48 (2017)
  4. 염정윤, "가짜뉴스 노출과 전파에 영향을 미치는요인 : 성격, 뉴미디어 리터러시, 그리고 이용 동기", 한국언론학보, 63(1), pp.7~45 (2019)
  5. Aboutorab, H., "Reinforcement learning-based news recommendation system", IEEE Transactions on Services Computing (2023)
  6. Albahri, A. S., "A systematic review of trustworthy and explainable artificial intelligence in healthcare : Assessment of quality, bias risk, and data fusion", Information Fusion, 96, pp.156~191 (2023)
  7. Alufaisan, Y., "Does explainable artificial intelligence improve human decision-making?", Paper presented at the Proceedings of the AAAI Conference on Artificial Intelligence, 35(8), pp.6618~6626 (2021)
  8. Amir, N., "On the current state of deep learning for news recommendation", Artificial Intelligence Review, 56(2), pp.1101~1144 (2023)
  9. Areeb, Q. M, "Filter bubbles in recommender systems: Fact or fallacy—A systematic review", Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 13(6), pp.e1512~ (2023)
  10. Balasubramaniam, N., "Transparency and explainability of AI systems: Ethical guidelines in practice", Paper presented at the International Working Conference on Requirements Engineering: Foundation for Software Quality, pp.3~18 (2022)
  11. Binns, R., "'It's reducing a human being to a percentage' perceptions of justice in algorithmic decisions", Paper presented at the Proceedings of the 2018Chi Conference on Human Factors in Computing Systems, pp.1~14 (2018)
  12. Borenstein, J., "Emerging challenges in AI and the need for AI ethics education", AI and Ethics, 1, pp.61~65 (2021)
  13. Branley-Bell, D., "User trust and understanding of explainable ai: Exploring algorithm visualisations and user biases", Paper presented at the International Conference on Human-Computer Interaction, pp.382~399 (2020)
  14. Cheng, L., "Socially responsible ai algorithms : Issues, purposes, and challenges", Journal of Artificial Intelligence Research, 71, pp.1137~1181 (2021)
  15. Cheong, B. C., "Transparency and accountability in AI systems : Safeguarding wellbeing in the age of algorithmic decision-making", Frontiers in Human Dynamics, 6, pp.1421273~ (2024)
  16. DeCamp, M., "Mitigating bias in AI at the point of care", Science, 381(6654), pp.150~152 (2023)
  18. Felzmann, H., "Transparency you can trust : Transparency requirements for artificial intelligence between legal norms and contextual concerns", Big Data & Society, 6(1) (2019)
  19. Feng, C., "News recommendation systems-accomplishments, challenges & future directions", IEEE Access, 8, pp.16702~16725 (2020)
  20. Fornell, C., "Evaluating structural equation models with unobservable variables and measurement error", Journal of Marketing Research, 18(1), pp.39~50 (1981)
  21. Gao, R., "Addressing bias and fairness in search systems", Paper presented at the Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.2643~2646 (2021)
  22. Gena, C., "When personalization is not an option : An in-the-wild study on persuasive news recommendation", Information, 10(10), pp.300~ (2019)
  23. Ghial, R., "Right to be forgotten: A human rights-based approach for governance in generative AI", Paper presented at the International Conference on Smart Computing and Communication, pp.23~33 (2024)
  24. Gilpin, L. H., "Explaining explanations: An overview of interpretability of machine learning", Paper presented at the 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), pp.80~89 (2018)
  25. Giovanola, B., "Beyond bias and discrimination : Redefining the AI ethics principle of fairness in healthcare machine-learning algorithms", AI & Society, 38(2), pp.549~563 (2023)
  26. Graves, L., "Does AI remember? neural networks and the right to be forgotten", ~ (2020)
  27. Hallamaa, J., "AI ethics as applied ethics", Frontiers in Computer Science, 4, pp.776837~ (2022)
  28. Haque, R., "Factors of information literacy preventing fake news : A case study of libraries in developing countries", International Journal of Religion, 5(7), pp.804~817 (2024)
  29. Heiss, R., "Social media information literacy : Conceptualization and associations with information overload, news avoidance and conspiracy mentality", Computers in Human Behavior, 148, pp.107908~ (2023)
  30. Hu, Y., "The dark side of artificial intelligence in service : The"watching-eye"effect and privacy concerns", International Journal of Hospitality Management, 110, pp.103437~ (2023)
  31. Jc, N., "Psychometric theory", pp.35~ (1994), New York
  32. Jeon, Y., "HearHere: Mitigating echo chambers in news consumption through an AI-based web system", Proceedings of the ACM on Human-Computer Interaction, 8, pp.1~34 (2024)
  33. Jobin, A., "The global landscape of AI ethics guidelines", Nature Machine Intelligence, 1(9), pp.389~399 (2019)
  34. Konow, J., "Blind spots : The effects of information and stakes on fairness bias and dispersion", Social Justice Research, 18, pp.349~390 (2005)
  35. Kumar, A., "Artificial intelligence bias in medical system designs : A systematic review", Multimedia Tools and Applications, 83(6), pp.18005~18057 (2024)
  36. Larsson, S., "Transparency in artificial intelligence", Internet Policy Review, 9(2) (2020)
  37. Lechterman, T. M, "The Oxford Handbook of AI Governance" (2022), Oxford University Press
  39. Lin, C., "Personalized news recommendation via implicit social experts", Information Sciences, 254, pp.1~18 (2014)
  40. Lin, C., "Premise:Personalized news recommendation via implicit social experts", Paper presented at the Proceedings of the 21st ACM International Conference on Information and Knowledge Management, pp.1607~1611 (2012)
  41. Liu, J., "A survey on heterogeneous information network based recommender systems : Concepts, methods, applications and resources", AI Open, 3, pp.40~57 (2022)
  42. Liu, K., "The roles of trust, personalization, loss of privacy, and anthropomorphism in public acceptance of smart healthcare services", Computers in Human Behavior, 127, pp.107026~ (2022)
  43. Memarian, B., "Fairness, accountability, transparency, and ethics(FATE)in artificial intelligence(AI), and higher education : A systematic review", Computers and Education : Artificial Intelligence, pp.100152~ (2023)
  44. Mensah, G. B., "Artificial intelligence and ethics : A comprehensive review of bias mitigation, transparency, and accountability in AI systems", Preprint, November, 10 (2023)
  45. Mukherjee, A. N., "Application of artificial intelligence : Benefits and limitations for human potential and labor-intensive economy–an empirical investigation into pandemic ridden indian industry", Management Matters, 19(2), pp.149~166 (2022)
  46. Nazer, L. H., "Bias in artificial intelligence algorithms and recommendations for mitigation", PLOS Digital Health, 2(6), pp.e0000278~ (2023)
  47. Newman, A. L., "What the"right to be forgotten"means for privacy in a digital age", Science, 347(6221), pp.507~508 (2015)
  48. Novelli, C., "Accountability in artificial intelligence: What it is and how it works", Ai & Society, pp.1~12 (2023)
  49. Papakyriakopoulos, O., "Political communication on social media : A tale of hyperactive users and bias in recommender systems", Online Social Networks and Media, 15, pp.100058~ (2020)
  50. Raza, S., "News recommender system:A review of recent progress, challenges, and opportunities", Artificial Intelligence Review, pp.1~52 (2022)
  51. Shani, G., "Evaluating recommendation systems, Recommender Systems Handbook", 257~297 (2011)
  52. Shneiderman, B., "Bridging the gap between ethics and practice : Guidelines for reliable, safe, and trustworthy human-centered AI systems", ACM Transactions on Interactive Intelligent Systems(TiiS), 10(4), pp.1~31 (2020)
  53. Stahl, B. C., "Ethics and privacy in AI and big data : Implementing responsible research and innovation", IEEE Security & Privacy, 16(3), pp.26~33 (2018)
  54. Sureephong, P., "Enhancing information literacy for spotting fake news : A study on the efficacy of a serious game for M-learning across different age groups", International Journal of Interactive Mobile Technologies, 17(15) (2023)
  55. Vainio-Pekka, H., "The role of explainable AI in the research field of AI ethics", ACM Transactions on Interactive Intelligent Systems, 13(4), pp.1~39 (2023)
  56. Vainio-Pekka, H., "The role of explainable AI in the research field of AI ethics", ACM Transactions on Interactive Intelligent Systems, 13(4), pp.1~39 (2023)
  57. Van Swol, L. M., "Perceived importance of information : The effects of mentioning information, shared information bias, ownership bias, reiteration, and confirmation bias", Group Processes & Intergroup Relations, 10(2), pp.239~256 (2007)
  58. Villaronga, E. F., "Humans forget, machines remember : Artificial intelligence and the right to be forgotten", Computer Law & Security Review, 34(2), pp.304~313 (2018)
  59. Voigt, P., "A Practical Guide" (2017), Springer International Publishing
  60. Wu, C., "Personalized news recommendation: Methods and challenges", ACM Transactions on Information Systems, 41(1), pp.1~50 (2023)
  61. Wu, C., "Personalized news recommendation : Methods and challenges", ACM Transactions on Information Systems, 41(1), pp.1~50 (2023)
  62. Xiao, B., "Designing warning messages for detecting biased online product recommendations : An empirical investigation", Information Systems Research, 26(4), pp.793~811 (2015)
  63. Yanisky-Ravid, S., "‘Equality and privacy by design’: Ensuring artificial intelligence (AI)is properly trained & fed: A new model of AI data transparency & certification as safe harbor procedures", ~ (2018)
  64. Yu, B., "Multi-source news recommender system based on convolutional neural networks", Paper presented at the Proceedings of the 3rd International Conference on Intelligent Information Processing, pp.17~23 (2018)
  65. Zhang, Y., "Ethics and privacy of artificial intelligence : Understandings from bibliometrics", Knowledge-Based Systems, 222, pp.106994~ (2021)
  66. Zhou, J., "AI ethics : From principles to practice", Ai & Society, 38(6), pp.2693~2703 (2023)
  67. Zhu, Z., "Scalable neural contextual bandit for recommender systems", Paper presented at the Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pp.3636~3646 (2023)
  68. "아마존 채용 AI는 왜 남성을 우대했나" (2021), 한국일보[URL]

관련 논문AI추천

AI와 윤리: 문헌의 종합적 분석과 정보시스템 분야의 향후 연구 방향민진영한국지식경영학회 · 지식경영연구2024 · 제25권 제3호인공지능 추천서비스에서 신뢰와 공정성 인식이 지속이용 의도에 미치는 영향: 알고리즘 투명성의 조절효과와 조절된 매개효과김형민한국컴퓨터정보학회 · 한국컴퓨터정보학회논문지2026 · 제31권 제1호데이터 윤리 관점에서 데이터 편향에 미치는 요인 탐색이광수한국사물인터넷학회 · 사물인터넷융복합논문지2025 · 제11권 제6호인공지능 윤리에 대한 탐색적 연구: 토픽 모델링을 활용한 뉴스 기사 분석이정, 한진영, 함주연지식경영연구원 · 기업과혁신연구2024 · 제47권 제3호AI 윤리 기준을 활용한 AI 윤리교육 방안 연구이인재한국초등도덕교육학회 · 초등도덕교육2022 · 제76호공영미디어 AI 윤리원칙의 동형화 분석최선욱언론정보연구소 · 언론정보연구2024 · 제61권 제4호

이 간행물의 다른 논문 (12건)

AI와 윤리: 문헌의 종합적 분석과 정보시스템 분야의 향후 연구 방향민진영pp. 1-22근로가치관이 플랫폼 노동자의 직무 태도에 미치는 영향에 관한 연구박상철, 류성열, 김경규pp. 23-45챗봇과의 대화에서 의도적인 부정확한 정보 제공에 대한 영향 요인 연구: 온라인 데이팅 서비스 이용 상황에서최한별, 이준영, 민진영, 곽찬희pp. 73-98지식 기반 QA개선을 위한 Advanced RAG 시스템 구현 방법: Graph Agent 활용정천수pp. 99-119데이터기반 아동·청소년 정책: 정서관리서비스 제안과 법적 쟁점 검토김형진, 배건규, 한진영, 정원준pp. 121-143
원문 보기