A deep reinforcement learning method for job shop scheduling integrated with automated guided vehicles

Shuting Huang; Baigang Du; Yuying Rong

doi:10.1117/12.3025432

28 February 2024 A deep reinforcement learning method for job shop scheduling integrated with automated guided vehicles

Shuting Huang, Baigang Du, Yuying Rong

Proceedings Volume 13071, International Conference on Mechatronic Engineering and Artificial Intelligence (MEAI 2023); 1307123 (2024) https://doi.org/10.1117/12.3025432
Event: International Conference on Mechatronic Engineering and Artificial Intelligence (MEAI 2023), 2023, Shenyang, China

Abstract

With the emergence of the smart factory concept, Automated Guided Vehicles have been widely utilized in job shop transportation systems, drawing increased attention to the job shop scheduling problem integrated with multiple AGVs. In this problem, the sequential-logic constraint between transportation and processing tasks in each operation complicates the problem's decoupling compared to traditional job shop scheduling problems. In this paper, a deep reinforcement learning-based method is proposed to address this integrated scheduling problem. The problem is initially formulated as a Markov Decision Process, with state features designed from the perspectives of jobs and AGVs. Furthermore, a novel reward function is designed to maximize job shop resource utilization. The primary objective of the scheduling is to obtain an optimal solution that maximizes resource utilization, thereby enhancing the core competitiveness of the factory. Benchmark experiments demonstrate the effectiveness and competitiveness of this method in obtaining solutions for the integrated problems.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Shuting Huang, Baigang Du, and Yuying Rong "A deep reinforcement learning method for job shop scheduling integrated with automated guided vehicles", Proc. SPIE 13071, International Conference on Mechatronic Engineering and Artificial Intelligence (MEAI 2023), 1307123 (28 February 2024); https://doi.org/10.1117/12.3025432

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available