Dynamic Computation Offloading Based on Q-Learning for UAV-Based Mobile Edge Computing
4
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Emerging mobile edge computing (MEC) can be used in battery-constrained Internet of things (IoT). The execution latency of IoT applications can be improved by offloading computation-intensive tasks to an MEC server. Recently, the popularity of unmanned aerial vehicles (UAVs) has increased rapidly, and UAV-based MEC systems are receiving considerable attention. In this paper, we propose a dynamic computation offloading paradigm for UAV-based MEC systems, in which a UAV flies over an urban environment and provides edge services to IoT devices on the ground. Since most IoT devices are energy-constrained, we formulate our problem as a Markov decision process considering the energy level of the battery of each IoT device. We also use model-free Q-learning for time-critical tasks to maximize the system utility. According to our performance study, the proposed scheme can achieve desirable convergence properties and make intelligent offloading decisions.
Abstract
Emerging mobile edge computing (MEC) can be used in battery-constrained Internet of things (IoT). The execution latency of IoT applications can be improved by offloading computation-intensive tasks to an MEC server. Recently, the popularity of unmanned aerial vehicles (UAVs) has increased rapidly, and UAV-based MEC systems are receiving considerable attention. In this paper, we propose a dynamic computation offloading paradigm for UAV-based MEC systems, in which a UAV flies over an urban environment and provides edge services to IoT devices on the ground. Since most IoT devices are energy-constrained, we formulate our problem as a Markov decision process considering the energy level of the battery of each IoT device. We also use model-free Q-learning for time-critical tasks to maximize the system utility. According to our performance study, the proposed scheme can achieve desirable convergence properties and make intelligent offloading decisions.
참고문헌 (18)
- S. M. A. Huda, "Survey on computation offloading in UAV- enabled mobile edge computing", Journal of Network and Computer Applications, 201, pp.1~26 (2022)
- S. Poudel, "Task assignment algorithms for unmanned aerial vehicle networks: A comprehensive survey", Vehicular Communications, 35, pp.1~29 (2022)
- S. Mao, "Fair energy-efficient scheduling in wireless powered full-duplex mobile-edge computing systems", Proc. of 2017 IEEE Global Communications Conf, pp.1~6 (2017)
- C. You, "Energy-efficient resource allocation for mobile-edge computation offloading", IEEE Trans. on Wireless Communications, 16(3), pp.1397~1411 (2016)
- Y. Zeng, "Wireless communications with unmanned aerial vehicles : Opportunities and challenges", IEEE Communications Magazine, 54(5), pp.36~42 (2016)
- 김사웅, "무인항공기 기반 빅데이터 처리 시스템의 프로토타입 설계", 스마트미디어저널, 5(2), pp.51~58 (2016), (사)한국스마트미디어학회
- 김남호, "드론을 이용한 대기환경정보 수집장치 개발 및 응용 연구", 스마트미디어저널, 7(4), pp.44~51 (2018), (사)한국스마트미디어학회[DOI]
- 장예예, "딥러닝 기반 소나무 재선충 피해목 탐색", 스마트미디어저널, 9(3), pp.46~51 (2020), (사)한국스마트미디어학회[DOI]
- S. Garg, "UAV-empowered edge computing environment for cyber-threat detection in smart vehicles", IEEE Network, 32(3), pp.42~51 (2018)
- F. Zhou, "Computation rate maximization in UAV-enabled wireless-powered mobile-edge computing systems", IEEE Journal on Selected Areas in Communications, 36(9), pp.1927~1941 (2018)
- L. Yang, "Multi-UAV-enabled load-balance mobile-edge computing for IoT networks", IEEE Internet of Things Journal, 7(8), pp.6898~6908 (2020)
- Q. Liu, "Path planning for UAV-mounted mobile edge computing with deep reinforcement learning", IEEE Trans. on Vehicular Technology, 69(5), pp.5723~5728 (2020)
- S. Jeong, "Mobile edge computing via a UAV-mounted cloudlet : Optimization of bit allocation and path planning", IEEE Trans. on Vehicular Technology, 67(3), pp.2049~2063 (2017)
- Q. Hu, "Joint offloading and trajectory design for UAV-enabled mobile edge computing systems", IEEE Internet of Things Journal, 6(2), pp.1879~1892 (2018)
- T. Zhang, "Joint computation and communication design for UAV-assisted mobile edge computing in IoT", IEEE Trans. on Industrial Informatics, 16(8), pp.5505~5516 (2019)
- J. Zhang, "Stochastic computation offloading and trajectory scheduling for UAV-assisted mobile edge computing", IEEE Internet of Things Journal, 6(2), pp.3688~3699 (2018)
- S. Zhu, "Learning-based computation offloading approaches in UAVs-assisted edge computing", IEEE Trans. on Vehicular Technology, 70(1), pp.928~944 (2021)
- A. Al-Hourani, "Optimal LAP altitude for maximum coverage", IEEE Wireless Communications Letters, 3(6), pp.569~572 (2014)