Title: Archi: Agentic Operations at the CMS Experiment

Abstract:

This paper introduces Archi, an open-source, end-to-end framework designed for scientific collaborations. The system integrates the structured ingestion and organization of diverse data sources with the deployment of configurable, private, and extensible agents capable of retrieving and reasoning across this information. Since February 2026, an instance of Archi has been operational for the Computing Operations team at CERN’s Large Hadron Collider (LHC). It serves as a support tool for technical operators, leveraging documentation, historical records, and live monitoring systems to provide retrieval and analytical capabilities.

We assessed the framework’s performance using operator feedback and a question set gathered from actual production use, which was evaluated by both human and automated panels. The results demonstrate that Archi is effective in handling operational tasks, successfully addressing real-world queries raised by CMS operators. Furthermore, our findings indicate that locally hosted, open-weight models deliver competitive performance, thereby facilitating the fully private management of sensitive data.

Source: arXiv Generated at: 2026-06-04 00:00:00 UTC