온라인상 자기주도 학습을 위한 생성형AI 파라미터 튜닝
Generative AI parameter tuning for online self-directed learning
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
본 연구는 온라인 원격교육에서 코딩 교육 활성화를 위해, 생성형 AI 기반의 학습 지원 도구개발에 필요한 하이퍼 파라미터 설정을 제안한다. 연구를 위해 세 가지 다른 학습 맥락에 따라하이퍼 파라미터를 설정할 수 있는 실험 도구를 구현하고, 실험 도구를 통해 생성형 AI의 응답품질을 평가하였다. 생성형 AI 자체의 기본 하이퍼 파라미터 설정을 유지한 실험은 대조군으로, 연구에서 설정한 하이퍼 파라미터를 사용한 실험은 실험군으로 하였다. 실험 결과, 첫 번째 학습맥락인 “학습 지원”에서는 실험군과 대조군 사이의 유의한 차이가 관찰되지 않았으나, 두 번째와세 번째 학습 맥락인 “코드생성”과 “주석생성”에서는 실험군의 평가점수 평균이 대조군보다 각각11.6% 포인트, 23% 포인트 높은 것으로 나타났다. 또한, system content에 응답이 학습 동기에 미칠 수 있는 영향을 제시하면 학습 정서를 고려한 응답이 생성되는 것이 관찰되었다.
Abstract
This study proposes hyper-parameter settings for developing a generative AI-based learning support tool to facilitate programming education in online distance learning. We implemented an experimental tool that can set research hyper-parameters according to three different learning contexts, and evaluated the quality of responses from the generative AI using the tool. The experiment with the default hyper-parameter settings of the generative AI was used as the control group, and the experiment with the research hyper-parameters was used as the experimental group. The experiment results showed no significant difference between the two groups in the “Learning Support” context. However, in other two contexts (“Code Generation” and “Comment Generation”), it showed the average evaluation scores of the experimental group were found to be 11.6% points and 23% points higher than those of the control group respectively. Lastly, this study also observed that when the expected influence of response on learning motivation was presented in the ‘system content’, responses containing emotional support considering learning emotions were generated.
참고문헌 (11)
- Gyeng Suk Jeong, "College Students’ Recognitions toward Online Tutoring and Factor Analysis on Class Satisfaction", Journal of Extra-curricular Research, 1(3), pp.25~41 (2020)
- Seo Il Bo, "Differences in Perceptions of Non-face-to-face Liberal Arts Classes at Universities and their Effect on Satisfaction", Korean Journal of General Education, 15(6), pp.288~299 (2021)
- Lee Ssang-cheol, "Factors that affect student satisfaction with online courses", The Journal of Educational Administration, 36(2), pp.115~138 (2018)
- Ramazan Yilmaz, "The effect of generative artificial intelligence(AI)-based tool use on student’s computational thinking skills, programming self-efficacy and motivation", Computers and Education : Artificial Intelligence, 4, pp.100147~ (2023)[DOI]
- "Two minutes NLP – Most used Decoding Methods for Language Models"[URL]
- "ChatGPT API Reference"[URL]
- "Stackoverflow"[URL]
- Randal W. Engle, "Working Memory Capacity as Executive Attention", Current Directions in Psychological Science, 11(1), pp.19~23 (2002)[DOI]
- Wulf. Tom, "Constructivist approaches for teaching computer programming", Proceedings of the 6th conference on Information technology education SIGITE ’05, pp.245~248 (2005)