PUBLIKATIONSSERVER

Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production

A. Müller, F. Grumbach, F. Kattenstroth, IEEE Access 12 (2024) 11388–11399.

Download
OA 1.21 MB
Download (ext.)
OA
Artikel | Veröffentlicht | Englisch
Autor*in
Müller, Arthur; Grumbach, FelixFH Bielefeld ; Kattenstroth, Fiona
Abstract
Solving production scheduling problems is a difficult and indispensable task for manufacturers with a push-oriented planning approach. In this study, we tackle a novel production scheduling problem from a household appliance production at the company Miele & Cie. KG, namely a two-stage permutation flow shop scheduling problem (PFSSP) with a finite buffer and sequence-dependent setup efforts. The objective is to minimize idle times and setup efforts in lexicographic order. In extensive and realistic data, the identification of exact solutions is not possible due to the combinatorial complexity. Therefore, we developed a reinforcement learning (RL) approach based on the Proximal Policy Optimization (PPO) algorithm that integrates domain knowledge through reward shaping, action masking, and curriculum learning to solve this PFSSP. Benchmarking of our approach with a state-of-the-art genetic algorithm (GA) showed significant superiority. Our work thus provides a successful example of the applicability of RL in real-world production planning, demonstrating not only its practical utility but also showing the technical and methodological integration of the agent with a discrete event simulation (DES). We also conducted experiments to investigate the impact of individual algorithmic elements and a hyperparameter of the reward function on the overall solution.
Erscheinungsjahr
Zeitschriftentitel
IEEE Access
Band
12
Seite
11388-11399
eISSN
FH-PUB-ID

Zitieren

Müller, Arthur ; Grumbach, Felix ; Kattenstroth, Fiona: Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production. In: IEEE Access Bd. 12, Institute of Electrical and Electronics Engineers (IEEE) (2024), S. 11388–11399
Müller A, Grumbach F, Kattenstroth F. Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production. IEEE Access. 2024;12:11388-11399. doi:10.1109/ACCESS.2024.3355269
Müller, A., Grumbach, F., & Kattenstroth, F. (2024). Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production. IEEE Access, 12, 11388–11399. https://doi.org/10.1109/ACCESS.2024.3355269
@article{Müller_Grumbach_Kattenstroth_2024, title={Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production}, volume={12}, DOI={10.1109/ACCESS.2024.3355269}, journal={IEEE Access}, publisher={Institute of Electrical and Electronics Engineers (IEEE)}, author={Müller, Arthur and Grumbach, Felix and Kattenstroth, Fiona}, year={2024}, pages={11388–11399} }
Müller, Arthur, Felix Grumbach, and Fiona Kattenstroth. “Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production.” IEEE Access 12 (2024): 11388–99. https://doi.org/10.1109/ACCESS.2024.3355269.
A. Müller, F. Grumbach, and F. Kattenstroth, “Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production,” IEEE Access, vol. 12, pp. 11388–11399, 2024.
Müller, Arthur, et al. “Reinforcement Learning for Two-Stage Permutation Flow Shop Scheduling—A Real-World Application in Household Appliance Production.” IEEE Access, vol. 12, Institute of Electrical and Electronics Engineers (IEEE), 2024, pp. 11388–99, doi:10.1109/ACCESS.2024.3355269.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2024-01-29T08:13:30Z


Link(s) zu Volltext(en)
URL
Access Level
Restricted Closed Access

Export

Markierte Publikationen

Open Data LibreCat

Suchen in

Google Scholar