자동화 물류시스템 내 차량 혼잡도를 고려한 무인운반차량의 동적 경로 결정 알고리즘
A Dynamic OHT Routing Algorithm in Automated Material Handling Systems
1
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
An automated material handling system (AMHS) has been emerging as an important factor in the semiconductor wafer manu- facturing industry. In general, an automated guided vehicle (AGV) in the Fab’s AMHS travels hundreds of miles on guided paths to transport a lot through hundreds of operations. The AMHS aims to transfer wafers while ensuring a short delivery time and high operational reliability. Many linear and analytic approaches have evaluated and improved the performance of the AMHS under a deterministic environment. However, the analytic approaches cannot consider a non-linear, non-convex, and black-box performance measurement of the AMHS owing to the AMHS’s complexity and uncertainty. Unexpected vehicle con- gestion increases the delivery time and deteriorates the Fab’s production efficiency. In this study, we propose a Q-Learning based dynamic routing algorithm considering vehicle congestion to reduce the delivery time. The proposed algorithm captures time-variant vehicle traffic and decreases vehicle congestion. Through simulation experiments, we confirm that the proposed algorithm finds an efficient path for the vehicles compared to benchmark algorithms with a reduced mean and decreased standard deviation of the delivery time in the Fab’s AMHS.
Abstract
An automated material handling system (AMHS) has been emerging as an important factor in the semiconductor wafer manu- facturing industry. In general, an automated guided vehicle (AGV) in the Fab’s AMHS travels hundreds of miles on guided paths to transport a lot through hundreds of operations. The AMHS aims to transfer wafers while ensuring a short delivery time and high operational reliability. Many linear and analytic approaches have evaluated and improved the performance of the AMHS under a deterministic environment. However, the analytic approaches cannot consider a non-linear, non-convex, and black-box performance measurement of the AMHS owing to the AMHS’s complexity and uncertainty. Unexpected vehicle con- gestion increases the delivery time and deteriorates the Fab’s production efficiency. In this study, we propose a Q-Learning based dynamic routing algorithm considering vehicle congestion to reduce the delivery time. The proposed algorithm captures time-variant vehicle traffic and decreases vehicle congestion. Through simulation experiments, we confirm that the proposed algorithm finds an efficient path for the vehicles compared to benchmark algorithms with a reduced mean and decreased standard deviation of the delivery time in the Fab’s AMHS.
참고문헌 (20)
- Bartlett, K, "Congestion-aware dynamic routing in automated material handling systems", Computers &Industrial Engineering, 70, pp.176~182 (2014)
- Farahnakian, F, "Q-learning based congestion-aware routing algorithm for on-chip network", IEEE 2nd International Conference on Networked Embedded Systems for Enterprise Applications, pp.1~7 (2011)
- Ganesharajah, T, "Design and operational issues in AGV-served manufacturing systems", Annals of operations Research, 76, pp.109~154 (1998)
- Ghiani, G, "Anticipatory algorithms for same-day courier dispatching", Transportation Research Part E: Logistics and Transportation Review, 45(1), pp.96~106 (2009)
- 한광욱, "유전알고리즘 기반 로트 타겟팅 최적화 연구: 반도체 포토공정을 대상으로", 대한산업공학회지, 48(5), pp.477~485 (2022), 대한산업공학회[DOI]
- Hong, S, "Practical Q-learning-based Route-guidance and Vehicle Assignment for OHT Systems in Semiconductor Fabs", IEEE Transactions on Semiconductor Manufacturing (2022)
- eon, S.M, "Routing automated guided vehicles in container terminals through the Q-learning technique", Logistics Research, 3(1), pp.19~27 (2011)
- 강재호, "자동화 컨테이너 터미널에서의 AGV 충돌 방지 및 교착 해결 방안", 지능정보연구, 11(3), pp.25~43 (2005), 한국지능정보시스템학회
- Kim, B.-I, "Assignment Problem Based Vehicle Dispatching for a Semiconductor FAB", Proceedings of the Korean Operations and Management Science Society Conference, pp.525~528 (2006)
- 김동소, "효율적인 OLED FAB 경유 반송 개선 알고리즘", 한국산업경영시스템학회지, 41(3), pp.120~128 (2018), 한국산업경영시스템학회[DOI]
- 김해중, "반도체 FAB에서 웨이퍼 로트 적기운반을 위한 재공 저장 위치 선정 연구", 경영과학, 38(1), pp.47~55 (2021), 한국경영과학회[DOI]
- 김해중, "반도체 제조라인 내 물류자동화시스템의 처리능력 향상을 위한 딥러닝 기반 디스패칭 방법론", 한국경영공학회지, 24(2), pp.73~83 (2019), 한국경영공학회[DOI]
- 김호원, "Q-learning을 이용한 이동 로봇의 실시간 경로 계획", 전기전자학회논문지, 24(4), pp.991~997 (2020), 한국전기전자학회[DOI]
- Lim, J.K, "Routing Automated Guided Vehicles Using Q-Learning", Journal of Japan Industrial Management Association, 54(1), pp.1~10 (2003)
- Maxwell, W.L, "Design of automatic guided vehicle systems", IIE Transactions, 14(2), pp.114~124 (1982)
- Min, K.H, "A study on Distance Allocation Method of the Faster Move Logistics between the Semiconductor Production Equipment", Proceedings of the Korean Society of Precision Engineering Conference, pp.1102~1103 (2014)
- Siebert, M, "Lot targeting and lot dispatching decision policies for semiconductor manufacturing: Optimisation under uncertainty with simulation validation", International Journal of Production Research, 56(1-2,), pp.629~641 (2018)
- "The Korea Society for Simulation"[URL]
- Wan, J, "Predictive vehicle dispatching method for overhead hoist transport systems in semiconductor fabs", International Journal of Production Research, 60(10), pp.3063~3077 (2022)
- Watkins, C.J, "Q-learning", Machine learning, 8(3), pp.279~292 (1992)