DIRAC Project meeting

mardi 30 sept. 2025, 14:00 → 16:20 Europe/Paris

Vanessa Hamar (CC-IN2P3 / CNRS)

https://etherpad.in2p3.fr/p/DIRAC%40IN2P330092025

---

Topic: DIRAC@IN2P3
Time: Sep 30, 2025 02:00 PM Paris
Join Zoom Meeting
https://cnrs.zoom.us/j/92344822373?pwd=KdBLhgNyiQ0RF6YPbypCe1GudYcOoJ.1

Meeting ID: 923 4482 2373
Passcode: h9wLkm

---

One tap mobile
+33170950103,,92344822373#,,,,*427051# France
+33170950350,,92344822373#,,,,*427051# France

---

Join by SIP
• 92344822373@zoomcrc.com

Join instructions
https://cnrs.zoom.us/meetings/92344822373/invitations?signature=A8FW940rijz7OAnoqxZ60d5ilgQwK5r_Lwh4rFmCoys

Compte rendu réunion DIRAC@IN2P3

Mardi 30 Septembre 2025

 

Atendees: Andrei, Axel, Bertrand, Natthan, Sorina, Vanessa
Excused: Luisa
 

Agenda:

1.    Project Status

2.   Projects

3.   DiracX

4.  Publications / Conferences

5.   Consortium news

6.  AOB

 

1. Project Status

 

·    The 11th Dirac User's Workshop

·     See multiple presentations at https://indico.cern.ch/event/1433941/

 

·    Some highlights

 

·     2 years from the first DiracX demo

·     Moving towards the first DiracX 0.0.1 release

·    framework, extensions support

·    charts

·    sandboxes in an object store (CEPH/S3)

·    Documentation

·     Kubernetes is a must for the deployment, but...

·    Concerns expressed about the level of complexity which exceeds the human resources for multiple DIRAC installations. This was recognized as a problem. GridPP team volunteers to explore a "Kubernetes-free" installation

·     The need for a K3s general solution is important

·    Stateless K3s diracx installation is necessary (production, not demo/development)

·    The state of the service is kept in external resources: MySQL, Opensearch, S3 storage, MQ

·     DiracX roadmap (current view): https://fstagni.github.io/2025_DUW_main/#/1

·    9.0/0.0.1 "now"

·    9.1/0.1(2).0 Q3 2026

·     First DiracX only service

·     task management, Pilot

·     First replacement for agents, executors by DiracX tasks

·    DIRAC 8.0 EOL Q4 2026

·    DiracX 1.0 Q4 2027

 

·     WMS in DiracX (https://indico.cern.ch/event/1433941/contributions/6650477/attachments/3136888/5566302/wms.pdf)

·    CWL on all levels (Production/Transformation/Job) as of 0.0.2d

 

·     Tokens

·    DIRAC minted tokens for storage access concept is being accepted

 

·     AI tools

·    DiracX MCP server to run AI agents - smart job selection/submission, what else ?

·    Development/administration assistance

 

·     LHCb experience with DiracX

·    peaking at ~400K concurrent jobs

·    Openshift with CERN provided external services

·    Currently only sandboxes in an S3 storage and JobStateUpdate

·     at full LHCb load

·    lhcbdiracx extension 

·    OpenTelemetry/Grafana monitoring

 

·    Next DIRAC User's Workshop: October 2026 in FZU, Prague

    

1.1 Versions :

 

·    DIRAC v8.0.76

·     NTR

 

·    DIRAC Prerelease  v9.0.a69

·     dirac-commons - Stateless utilities extracted from DIRAC for use by DiracX and other projects without triggering DIRAC's global state initialization. DiracX will depend from it (and not anymore from DIRAC)

·     pip install DIRACCommon

 

·    DIRACX Prerelease v0.0.1

·     See Project tasks: https://github.com/orgs/DIRACGrid/projects/2

 

1.2 Developments :

 

·     Bild meetings https://indico.cern.ch/event/1569649/

 

·    DIRAC documentation

·     A major update of the DiracX documentation

·     See https://diracx.diracgrid.org

 

·    Development at CC (Bertrand)

·     minIO installed, connection is to be sorted out, configure users, etc

·     Opensearch installed to have the version which works with OpenTelemetry

 

1.3. EGI Services:

 

·    Smooth running in general but (Vanessa)

·     Problems with user's certificates

·     Site status to be examined and fixed

·     Access to IN2P3-CC with the DIRAC tokens still fails matching

·    KM3NeT

·     Sites not available

·    Auger

·     File catalog

·    General 

·     NTR

 

1.4. European/National Projects : 

 

·    GreenDIGIT 

·     All Hands Meeting in UvA right now

·     DIRAC agent to send per job metrics records is set up and working

·    CPU and consumed energy per job

·     New engineer, Mazen Ezzedine, is starting from the 1st October for GreenDIGIT/EGI/DIRAC

 

·    PEPR STEEL 

·     NTR

 

·    SpectrumCoP-WP[1,2,3]

·      https://www.spectrumproject.eu

 

·    EOSC-01 call : Foundational EOSC Nodes with federating capabilities for the EOSC Federation

 

·    ENSURE TECH-01 call : à la GreenDIGIT

·     Proposal submitted

·    CNRS participation: Creatis, CPPM, 27 PM in total

·    Sorina is the CNRS project leader

 

·    MesoClouds RI proposal

·     NTR

 

2. Projects

 

2.1 CTAO (Luisa, Natthan)

 

·    Stagiaire BAC+3 shared with the LUPM

·    Engineer to work with Alexandre on the CWL

·    CTAO want everything to be defined in K8s. CI based on Kind. Work on integration of DIRAC/DiracX and Rucio is ongoing. The data taking is soon- will test the DIRAC installation with the real data.  

 

2.2 Biomed (Sorina, Axel)

 

 

2.3. Juno  

 

·    Fixed the File Catalog structure

·     Challenge: old data in the new FC structure

 

2.4 KM3NeT.org

 

·    Sites to be updated

4. Conference, workshop, publications

 

·    JCAD'25 15-17 Sep

·     Poster presentation (Axel) well received

 
 

5. Consortium

 

·    The DIRAC/DiracX roadmap is realistic but will wide involvement of the communities

·    HSF affiliation program update

·     Reviewers nominated, review process started without DIRAC developers involved so far

·     First feedback in October

·    https://diracgrid.org pages moved to Github

·     Automatic building, deployment

·     First PRs with contributions are merged

·    GridPP: concern on kubernetes-induced complexities

·     Consortium Board recognizes the need to evaluate Kubernetes-free solution

·    A.Tsaregorodtsev and F.Stagni reelected as the Consortium Coordinator and Technical Coordinator for the next two-years term.

 

6. AOB

 

·    The next meeting date: 28.10.2025

·    CentOS7 must be migrated towards 9 asap. 

 

 

14:00 → 14:40 Etat du projet

• Tour de table

Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Vanessa Hamar (CC-IN2P3 / CNRS)

14:40 → 15:20 Projets

Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Axel BONNET ({CNRS}UMR5220), M. Bertrand Rigaud (CC-IN2P3), Luisa Arrabito (LUPM), Natthan Pigoux (LUPM), Sorina POP (CNRS)

15:20 → 15:25 Publications / Conférences

Publications

Conferences

Orateur: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France)

15:25 → 15:35 Consortium news

Orateur: Dr Andrei Tsaregorodtsev (CPPM-CNRS)

15:35 → 15:45 AOB