Gast ::
| Hauptseite > Publikationsdatenbank > From terabytes to petabyte: scaling of the archiving system for FAIR > print |
| 001 | 365277 | ||
| 005 | 20260130090845.0 | ||
| 020 | _ | _ | |a 978-3-95450-255-4 |
| 024 | 7 | _ | |a 10.18429/JACOW-ICALEPCS2025-TUPD109 |2 doi |
| 024 | 7 | _ | |a 10.15120/GSI-2026-00371 |2 datacite_doi |
| 037 | _ | _ | |a GSI-2026-00371 |
| 041 | _ | _ | |a English |
| 100 | 1 | _ | |a Rapp, Vitaliy |0 P:(DE-Ds200)OR6411 |b 0 |e Corresponding author |
| 111 | 2 | _ | |a 20th Int. Conf. Accel. Large Exp. Phys. Control Syst. |g ICALEPCS'25 |c Chicago, IL |d 2026-09-20 - 2026-09-26 |w USA |
| 245 | _ | _ | |a From terabytes to petabyte: scaling of the archiving system for FAIR |
| 260 | _ | _ | |a Geneva, Switzerland |c 2025 |b JACoW Publishing |
| 300 | _ | _ | |a 747-751 |
| 336 | 7 | _ | |a CONFERENCE_PAPER |2 ORCID |
| 336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
| 336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
| 336 | 7 | _ | |a conferenceObject |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Conference Paper |2 DataCite |
| 336 | 7 | _ | |a Contribution to a conference proceedings |b contrib |m contrib |0 PUB:(DE-HGF)8 |s 1769611286_1002862 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a Contribution to a book |0 PUB:(DE-HGF)7 |2 PUB:(DE-HGF) |m contb |
| 500 | _ | _ | |a Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license. |
| 520 | _ | _ | |a With the recent rise of AI and various machine learning models, the importance of storing and managing data generated by control systems is greater than ever before. In 2016, GSI began developing an archiving system to collect, store, and retrieve data from the diverse accelerator devices managed by the GSI control infrastructure. The system was successfully deployed in production in 2021. To evaluate its capabilities and suitability for operational needs, the system was initially launched with a limited storage capacity of 50 TB and reduced computing power. With a current data volume of over 100 GB per day, the archiving system quickly exceeded its initial limits. However, the experience gained in day-to-day operations thus far has allowed us to better understand our use-cases and identify areas for further improvement. In preparation for the anticipated start of FAIR operations in 2027, the system will require significant scaling to meet future demands. Therefore, this is an opportune moment to review and refine the system’s architecture based on the experience gained so far. This paper outlines the challenges encountered with the current implementation and presents the solutions that will be incorporated into the system for FAIR operations. |
| 536 | _ | _ | |a 621 - Accelerator Research and Development (POF4-621) |0 G:(DE-HGF)POF4-621 |c POF4-621 |f POF IV |x 0 |
| 536 | _ | _ | |a FAIR Phase-0 - FAIR Phase-0 Research Program (GSI-FAIR-Phase-0) |0 G:(Ds200)GSI-FAIR-Phase-0 |c GSI-FAIR-Phase-0 |x 1 |
| 588 | _ | _ | |a Dataset connected to DataCite |
| 650 | _ | 7 | |a Accelerator Physics |2 Other |
| 650 | _ | 7 | |a MC16 - MC16: Data Management and Analytics |2 Other |
| 693 | _ | _ | |a theory |e no experiment theory work (theory) |1 EXP:(DE-Ds200)theory-20200803 |0 EXP:(DE-Ds200)no_experiment-20200803 |5 EXP:(DE-Ds200)no_experiment-20200803 |x 0 |
| 700 | 1 | _ | |a Kerssemakers, Jules |0 P:(DE-Ds200)OR14055 |b 1 |
| 700 | 1 | _ | |a Klimczyk, Krzysztof |0 P:(DE-HGF)0 |b 2 |
| 700 | 1 | _ | |a Salabura, Piotr |0 P:(DE-Ds200)OR1070 |b 3 |
| 773 | _ | _ | |a 10.18429/JACOW-ICALEPCS2025-TUPD109 |
| 856 | 4 | _ | |y OpenAccess |u https://repository.gsi.de/record/365277/files/TUPD109.pdf |
| 856 | 4 | _ | |y OpenAccess |x pdfa |u https://repository.gsi.de/record/365277/files/TUPD109.pdf?subformat=pdfa |
| 909 | C | O | |o oai:repository.gsi.de:365277 |p openaire |p open_access |p VDB |p driver |p dnbdelivery |
| 910 | 1 | _ | |a GSI Helmholtzzentrum für Schwerionenforschung GmbH |0 I:(DE-Ds200)20121206GSI |k GSI |b 0 |6 P:(DE-Ds200)OR6411 |
| 910 | 1 | _ | |a GSI Helmholtzzentrum für Schwerionenforschung GmbH |0 I:(DE-Ds200)20121206GSI |k GSI |b 1 |6 P:(DE-Ds200)OR14055 |
| 913 | 1 | _ | |a DE-HGF |b Forschungsbereich Materie |l Materie und Technologie |1 G:(DE-HGF)POF4-620 |0 G:(DE-HGF)POF4-621 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-600 |4 G:(DE-HGF)POF |v Accelerator Research and Development |x 0 |
| 914 | 1 | _ | |y 2025 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 920 | _ | _ | |l yes |
| 920 | 1 | _ | |0 I:(DE-Ds200)ACO-20051214OR053 |k ACO |l Accelerator Controls |x 0 |
| 980 | _ | _ | |a contrib |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a UNRESTRICTED |
| 980 | _ | _ | |a contb |
| 980 | _ | _ | |a I:(DE-Ds200)ACO-20051214OR053 |
| 980 | 1 | _ | |a FullTexts |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|