본문 바로가기
KERD
논문KCI 등재

비대면 팀 프로젝트 기반 수업 평가를 위한 분석 방법 및평가환경

An Analysis Method and Environment for Team Project-Based Learning in Non-Face-to-Face Situation for Student Evaluation

0

조회

0

다운로드

2

인용

0

참고문헌

키워드

주제분류학제간연구

초록

An educator may utilize various pedagogies such as hands-on practice, practicum, and project-based learning to enhance a student's competency. Among various pedagogies, project-based learning is one of the well-known pedagogies that may provide similar on-the-job experience. In general, an educator may divide the students into small groups and assign tasks to check students' cooperation skills and achievements during project-based learning. However, an educator may experience difficulties operating project-based learning due to the COVID-19 pandemic. Most of the team activities are done in non-face-to-face meetings, and as a consequence, the educator may not find an underachieving team easily and cannot intervene appropriately. This study introduces a rigorous analysis method to evaluate team activities to analyze individual students' participation and contributions. First, this study develops evaluation rubrics by conducting questionnaires to professors and students to find an appropriate weight value for the evaluation scale. Then, this research introduces an analysis environment to evaluate students automatically. The analysis environment collects dialog data from social network services and measures interactions among students in a team. After measuring interactions, the environment generates a report to visualize the team activities. We applied the proposed method and environment to the capstone design course to show the effectiveness of the method and environment. Based on the case study, the environment showed that the analysis method could easily indicate the teams’ activities and check the level of participation.

Abstract

An educator may utilize various pedagogies such as hands-on practice, practicum, and project-based learning to enhance a student's competency. Among various pedagogies, project-based learning is one of the well-known pedagogies that may provide similar on-the-job experience. In general, an educator may divide the students into small groups and assign tasks to check students' cooperation skills and achievements during project-based learning. However, an educator may experience difficulties operating project-based learning due to the COVID-19 pandemic. Most of the team activities are done in non-face-to-face meetings, and as a consequence, the educator may not find an underachieving team easily and cannot intervene appropriately. This study introduces a rigorous analysis method to evaluate team activities to analyze individual students' participation and contributions. First, this study develops evaluation rubrics by conducting questionnaires to professors and students to find an appropriate weight value for the evaluation scale. Then, this research introduces an analysis environment to evaluate students automatically. The analysis environment collects dialog data from social network services and measures interactions among students in a team. After measuring interactions, the environment generates a report to visualize the team activities. We applied the proposed method and environment to the capstone design course to show the effectiveness of the method and environment. Based on the case study, the environment showed that the analysis method could easily indicate the teams’ activities and check the level of participation.

참고문헌 (23)

  1. 구정호, "프로젝트 중심 학습(PBL)에서 의사소통능력, 문제해결능력, 자기주도학습능력이 회계 학습효과에 미치는 영향", Korea Business Review, 21(4), pp.119~140 (2017), 한국경영학회[DOI]
  2. 김경천, "실험실습 강화를 위한 기계공학교육모델", 대한기계학회 기계저널, 40(7), pp.68~70 (2000)
  3. 김미라, "팀워크와 동료학습이 전문대학 물리학 수업의 학업성취도에 미치는 영향", 공학교육연구, 23(6), pp.68~76 (2020), 한국공학교육학회[DOI]
  4. 박종혁, "팀 프로젝트 무임승차 방지 방안에 관한 연구", 한국컴퓨터정보학회논문지, 18(2), pp.141~147 (2013), 한국컴퓨터정보학회
  5. 신선희, "공학교육에서의 개념학습을 위한 온라인 학습 커뮤니티의 설계와 탐구활동 지원도구의 평가", 공학교육연구, 16(1), pp.3~14 (2013), 한국공학교육학회[DOI]
  6. 안부영, "평가자와 피평가자의 친밀 정도가 쓰기의 동료 평가 신뢰성에 미치는 영향 분석", 청람어문교육, (52), pp.143~163 (2014), 청람어문교육학회[DOI]
  7. 윤선희, "효율적인 팀 프로젝트 기반 학습 운영을 위한 데이터 기반 교수법", 2021 공학교육학술대회 자료집, pp.22~22 (2021)
  8. 이송희, "대학 산림교육의 웹기반 프로젝트 학습법(e-PBL) 적용 사례와 학습성과", 한국산림과학회지, 110(2), pp.266~279 (2021), 한국산림과학회[DOI]
  9. 이시복, "기계공학 실험실습교육강화-부산대 기계공학부", 공학교육연구, 3(1), pp.73~83 (2000)
  10. 이은철, "온라인 협력학습에서 무임승차 학습자의 특성 분석", 한국콘텐츠학회 논문지, 19(10), pp.385~396 (2019), 한국콘텐츠학회[DOI]
  11. 이재윤, "실시간 참여도 평가 소프트웨어를 활용한데이터 기반 팀 프로젝트 학습 운영 및 평가", 2021 공학교육학술대회 자료집, pp.86~86 (2021)
  12. 장용철, "창의설계입문의 PBL(Problem-Based Learning) 적용: 충남대학교 환경공학분야 사례", 공학교육연구, 16(2), pp.78~85 (2013), 한국공학교육학회[DOI]
  13. 한세영, "팀 프로젝트 학습의 효율적인 운영을 위한데이터 획득 플랫폼", 2021공학교육학술대회 자료집, pp.87~87 (2021)
  14. 황순희, "공과대학생의 팀 기반 수업에서 동료평가와 자기평가의 관계", 공학교육연구, 19(5), pp.3~12 (2016), 한국공학교육학회[DOI]
  15. 황윤자, "온라인 교육 환경에서 공학 설계 교과목의 팀 프로젝트 수업 사례 및 요구 분석", 디지털콘텐츠학회논문지, 22(7), pp.1039~1047 (2021), 한국디지털콘텐츠학회[DOI]
  16. Abernethy, M. A., "You Are Fired! A Method to Control and Sanction Free Riding in Group Assignments", Marketing Education Review, 15(1), pp.47~54 (2005)
  17. Blake, M. B., "A Student-Enacted Simulation Approach to Software Engineering Education", IEEE Transactions on Education, 46(1), pp.124~132 (2003)
  18. Blumenfeld, P. C., "Motivating Project-Based Learning: Sustaining the Doing, supporting the Learning", Education Psychologist, 26(3&4), pp.369~398 (1991)
  19. B. Turhan, "A Template for Real World Team Projects for Highly Populated Software Engineering Classes", 29th International Conference on Software Engineering (ICSE'07), 2007, pp.748~753 (2007)
  20. Mercede, F. J., "Hands-on projects to introduce Electrical and Computer Engineering", 2008 38th Annual Frontiers in Education Conference, 2008, pp.F1F-9~F1F-14 (2008)
  21. "TEAMate" (2022)[URL]
  22. Tomayko, J. R., "Teaching Software Development in a Studio Environment", Proceedings of the 22 SIGCSE Technical Symposium on Computer Science Education, pp.300~303 (1991), ACM Press
  23. Wikstrand G., "Success Factors for Team Project Courses", Proceedings of the 19th Conference on Software Engineering Education & Training, (Cseet'06), pp.95~102 (2006)

관련 논문AI추천

이 간행물의 다른 논문 (3건)