Network-based AR education framework using Python and Unity 3D Engine
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
VR and AR are not technologies that are difficult for the public to access, but can be experienced and used with a single personal smartphone. Recently, AR content using various sensors of these personal smartphones has been developed and serviced. As the demand for AR content grew, so did the demand for software education. However, although SW education has become active around Python languages that are easy for non-majors to learn, Python cannot be actively used in AR content development. AR content is actively used not only in the technical field but also in the interactive art field. Recently, interactive artists have been developing and exhibiting works using artificial intelligence using Python. SW education through Python is not only necessary for employment in the SW field, but has also become necessary education in the art field. This paper proposes a network-based AR framework using Python and Unity 3D Engine for AR content development education. The proposed AR framework accesses the camera of a personal smartphone from a web-based browser, transmits camera information to the Main Server, and analyzes Mark on Python. It renders 3D objects in Unity 3D Engine according to Mark information, synthesizes camera informatization, and renders them on personal smartphone screens with MJPEG streaming. The AR framework proposed in this paper reflects the requirements of SW education platforms and non-face-to-face education platforms, and is expected to lower the technical limitations required for various challenges of interactive artists..
Abstract
VR and AR are not technologies that are difficult for the public to access, but can be experienced and used with a single personal smartphone. Recently, AR content using various sensors of these personal smartphones has been developed and serviced. As the demand for AR content grew, so did the demand for software education. However, although SW education has become active around Python languages that are easy for non-majors to learn, Python cannot be actively used in AR content development. AR content is actively used not only in the technical field but also in the interactive art field. Recently, interactive artists have been developing and exhibiting works using artificial intelligence using Python. SW education through Python is not only necessary for employment in the SW field, but has also become necessary education in the art field. This paper proposes a network-based AR framework using Python and Unity 3D Engine for AR content development education. The proposed AR framework accesses the camera of a personal smartphone from a web-based browser, transmits camera information to the Main Server, and analyzes Mark on Python. It renders 3D objects in Unity 3D Engine according to Mark information, synthesizes camera informatization, and renders them on personal smartphone screens with MJPEG streaming. The AR framework proposed in this paper reflects the requirements of SW education platforms and non-face-to-face education platforms, and is expected to lower the technical limitations required for various challenges of interactive artists..
참고문헌 (27)
- MYSTAKIDIS, Stylianos, "Metaverse", Encyclopedia, 2(1), pp.486~497 (2022)
- BURDEA, Grigore C, "Virtual reality technology" (2003), John Wiley & Sons
- AZUMA, Ronald T, "A survey of augmented reality", Presence : teleoperators & virtual environments, 6(4), pp.355~385 (1997)
- SHIBATA, Takashi, "Head mounted display", Displays, 23(1-2), pp.57~64 (2002)
- ALLOUCH, Azza, "Roadsense : Smartphone application to estimate road conditions using accelerometer and gyroscope", IEEE Sensors Journal, 17(13), pp.4231~4238 (2017)
- BARANOWSKI, Tom, "Pokémon Go, go, go, gone?", Games for Health Journal (2016)
- 한동숭, "4차 산업 혁명 시대, 대학 교육과 콘텐츠", 인문콘텐츠, (42), pp.9~24 (2016), 인문콘텐츠학회[DOI]
- GLOVER, Jesse, "Unity 2018 augmented reality projects: build four immersive and fun AR applications using ARKit, ARCore, and Vuforia" (2018), Packt Publishing Ltd
- ANTUNES, João Luís, "AR With Cloud Anchors: A Way to Improve HCI and Interactive Art", International Journal of Creative Interfaces and Computer Graphics (IJCICG), 10(2), pp.29~40 (2019)
- 박휴용, "COVID-19로 촉발된 ‘비대면 교육’의 교육적 의미와 미래적 전망", 교육비평, (46), pp.30~64 (2020), 교육비평[DOI]
- 남현우, "초.중등학생을 위한 VR", AR 코딩 교육 프레임워크 연구, 2018, pp.36, 85~97[DOI]
- 이지혜, "비대면 교육에서의 실감형 콘텐츠(AR,VR,,360°) 활용현황 및 개선방향 -초등학교 교육 중심으로-", 한국디자인문화학회지, 26(3), pp.369~377 (2020), 한국디자인문화학회
- 이은진, "얼굴 인식 기술을 활용한 실감형 인터랙티브 콘텐츠의 구현 - (르네마그리트 특별전) AR포토존을 중심으로", 한국게임학회 논문지, 20(5), pp.13~20 (2020), 한국게임학회[DOI]
- Young-Ae Kim, "Development of interactive media art contents based on Unity3D using Leap Motion", Journal of Korean Information Science Society, pp.1969~1971 (2015)
- 전지윤, "위치기반 AR 인터랙티브 콘텐츠의 활용 가능성: 한양도성 사례를 중심으로", 융합관광콘텐츠연구, 7(3), pp.63~74 (2021), 융합관광콘텐츠학회[DOI]
- KESSENICH, John, "The opengl shading language" (2004)
- GU, Bon-woo, "GLSL-Driven Background Subtraction Framework Using Particle Filter to Apply Special Effects without Chroma Key", INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 11, pp.71~86 (2018)
- BIENER, Monika M, "Revisiting the S− Au(111) Interaction: Static or Dynamic?", Langmuir, 21(5), pp.1668~1671 (2005)
- 이광진, "COVID-19에 따른 비대면 수업이 청소년의 건강관련체력 및 균형감각에 미치는 영향", 운동과학, 30(2), pp.229~236 (2021), 한국운동생리학회
- SONG, Yangyang, "New Horizons in Computational Chemistry Software", pp.181~236 (2022)
- LAWSON, Bruce, "Introducing html5" (2011), New Riders
- JENSEN, Simon Holm, "Type analysis for javascript", SAS, pp.238~255 (2009)
- VIEGA, John, "Network security with openSSL:cryptography for secure communications" (2002), O'Reilly Media, Inc
- NAYLOR, David, "The cost of the"s"in https", Proceedings of the 10th ACM International on Conference on emerging Networking Experiments and Technologies, pp.133~140 (2014)
- BRADSKI, Gary, "OpenCV. Dr", Dobb’s journal of software tools, ~ (2000)
- CHEN, Lei, "Scalable secure MJPEG video streaming", 2012 26th International Conference on Advanced Information Networking and Applications Workshops, pp.111~115 (2012), IEEE
- MITA, Takeshi, "Joint haar-like features for face detection", IEEE International Conference on Computer Vision (ICCV'05), 1, pp.1619~1626 (2005), IEEE