Contribution to a conference proceedings

GSI-2024-00472

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Injection optimization via reinforcement learning at the cooler synchrotron COSY

Pretz, J. ; Awal, A. A. H. A. (Corresponding author)GSI* ; Hetzel, J.

2023
JACoW Publishing

Please use a persistent id in citations: doi:10.18429/JACOW-IPAC2023-WEPA098  doi:10.15120/GSI-2024-00472

Abstract: It is crucial to have a particle beam with high intensity and small emittance in a timely manner. The main challenges restraining the availability of the beam to the user and limiting the beam intensity in storage rings are a lengthy optimization process, and the injection losses. The setup of the Injection Beam Line (IBL) depends on a large number of configurations in a complex, non-linear, and time-dependent way. Reinforcement Learning (RL) methods have shown great potential in optimizing various complex systems. However, unlike other optimization methods, RL agents are sample inefficient and have to be to be trained in simulation before running them on the real IBL. In this research, we train RL agents to learn the optimal injection strategy of the IBL for the Cooler Synchrotron (COSY) at Forschungszentrum Jülich. We address the challenge of sim-to-real transfer, where the RL agent trained in simulation does not perform well in the real world, by incorporating domain randomization. The goal is to increase the beam intensity inside COSY while decreasing the setup time required. This method has the potential to be applied in future accelerators like the FAIR facility.

Keyword(s): Accelerator Physics ; mc5-beam-dynamics-and-em-fields - MC5: Beam Dynamics and EM Fields ; mc5-d13-machine-learning - MC5.D13: Machine Learning

Note: "Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license."

---

Contributing Institute(s):

1. FAIR Forschung NRW (FFN)

Research Program(s):

1. 612 - Cosmic Matter in the Laboratory (POF4-612) (POF4-612)

Experiment(s):

1. External experiment at external facility/ no experiment at GSI (other)

Appears in the scientific report 2024

---

Database coverage:
;

---