DIRAC Project meeting

Europe/Paris
Vanessa Hamar (CC-IN2P3 / CNRS)
Description
Indico
 
 
Etherpad
 
 
 
 
Zoom
 
Vanessa HAMAR vous invite à une réunion Zoom programmée.

Sujet: DIRAC@IN2P3
Heure: 25 févr. 2026 02:00 PM Paris
Participer à la réunion Zoom
https://cnrs.zoom.us/j/93869704565?pwd=od11aodF9MrbByKcduakyMXZ7DeLbq.1 

ID de réunion: 938 6970 4565
Code secret: M0hgg2

---

Une seule pression sur l’appareil mobile
+33170372246,,93869704565#,,,,*122802# France
+33170379729,,93869704565#,,,,*122802# France

---

Participez à l’aide d’un protocole SIP
• 93869704565@zoomcrc.com
Code secret: 122802

Instructions pour participer
https://cnrs.zoom.us/meetings/93869704565/invitations?signature=TG6iDcQoJw9IEJCXQ0umHpYX3ozvfY1Grly1LmyM2ik
Participants
  • Andrei Tsaregorodtsev
  • Axel BONNET
  • Bertrand Rigaud
  • Heloïse JOFFE
  • Loris VAN KATWIJK
  • Luc Guyard
  • Luisa Arrabito
  • Mazen Ezzeddine
  • Natthan Pigoux
  • Sorina POP
  • Stella Maria Renucci
  • Vanessa Hamar

Compte rendu réunion DIRAC@IN2P3

Mardi 31 mars 2026

 
 

Atendees:  Andrei, Axel, Bertrand, Héloïse, Loris, Luisa, Mazen, Natthan, Stella-Maria, Sorina, Vanessa

 

Agenda:

 
  1. Project Status
  1. Projects
  1. DiracX
  1. Publications / Conferences
  1. Consortium news
  1. AOB
 

1. Project Status

Partial budget received (75%)
  • Missions (DUW'26, Prague)
  • DUW organization (cattering, etc)
  • Try to avoid participation fees
    

1.1 Versions :

 
  • DIRAC v8.0.78
  • No changes
 
  • DIRAC v9.1.3 (from 9.0.20)
  • Database schema updates
  • RSS optimization
  • Other minor changes
 
  • DIRACX Release v0.0.11 (from 0.0.9)
  • Minor (authdb, sandbox optimization)
 

 1.2 DiracX Hackathon (24-25 March)

Less participation than usual, dominated by French participants :)
Main news
  • First introduction of the diracx tasks
  • Main stumbling block on the way of DIRAC->diracx migration
  • Replacement for
  • Agents, Executors, RMS
  • Database+Logic+Tasks+Routers+Testing
  • Well documented
  • Can be exercised locally
  • pixi environment
  • Very useful for everybody interested in the diracx migration development - you are welcome to follow it
  • CWL based WMS is advancing (Alexandre, Ryan, Natthan, Luisa, ...)
  • Close to be released ?...
  • Web interface updates
  • Some change in the choice of the underlying libraries
  • Next DIRAC Hackathon 
  • Date to be fixed - preliminarily end of June
 
 

1.3 Current Developments :

 
 
  • Sprints (Natthan, Luisa, Stella, Loris, Heloise, Mazen)
  • Heloise, Loris: Sprint related to the RSS
 
  • IN2P3 contributions
  • DMS/File Catalog porting (Andrei, Heloise, Bertrand ? )
  • Goal: come up with the single configuration, best performing based on the acquired experience
  • To be used in DIRAC9
  • To be used as the starting point for the diracx migration
  • Testing 3 FileCatalog DB schemas
  • Currently used by default (split tables, DirectoryLevelTree)
  • "Consolidated" (merged tables, DirectoryLevelTree)
  • "LHCb" (merged tables, DirectoryClosure)
  • Metadata support to be confirmed, updates might be needed
  • 3 File Catalog services are set up per DB schema
  • Performance Tests :
  • Population 
  • using client server communication
  • same script for all the schemas
  • filling in about 1M files/100K directories with metadata 
  • ~4hours
  • Queries
  • Simple look-ups in parallel
  • Various bulk queries - to be defined
  • Status
  • Services and databases are defined:
  • Might need some optimization
  • Population scripts are ready
  • Adding about 70files/sec in a single thread
  • Some minor improvements might be need
  • Population test can be done this week
  • Query tests can start afterwards
  • Procedure to migrate current catalogs to be defined
  • Better data consistency (Foreign Keys, less tables)
  • Optimizations based on the LHCb and other's experience
  • Directory usage
  • Some plug-ins can still be there
  • E.g. Multi-VO metadata
 
 
  • diracx-cwl (Luisa, Natthan, Loris, Stella)
  • How to accelerate the diracx WMS full-fledged system ?
  • Status
  •  
 
  • Deployment with K8s (Bertrand)
  • Status
  • Opensearch
  • Common prefix a tous les indexes
  • Utilisation des certificats
  • Utilisation des certificats
  • Still way to be found for the case with multiple databases
  • DataStream - how to use ? To be solved hopefully
  • Replacement of MinIO:
  • SEA
  • RustFS (?)
 
 
 

1.4. EGI Services:

 
  • The service itself is running smoothly
  • NTR
 
  • Service splitting (Vanessa)
  • Hosts are ready with DIRAC8 software installed
  • DIRAC@IN2P3 service 
  • Operational (DIRAC8)
  • KM3NeT configuration done
  • Sites
  • Site local configuration to be updated - a GGUS campaign to be done (Mazen, Luc ?)
  • SEs - to be confirmed
  • Jobs with Check-In tokens are running
  • IAM token configuration to be done
  • Needs help of the IAM managers to set up DIRAC clients
 
  • DIRAC4EGI service
  • Servers are in place
  • Have to plan migration
  • DIRAC9/diracx ?
  • FITS DIRAC service
  • ...
 

1.4. European/National Projects : 

 
  • GreenDIGIT (Mazen)
  • Site Ranking criteria is defined
  • GreenScore
  • Taking into account also the Site congestion
  • Monitoring criteria are defined
  • Useful work per unit of gCO2
  • Working on Simulation
  • Using traces of real jobs (since 2023)
  • Mimicking real scheduling algorithms
  • Other resources to be included in consideration (HPC)
  •  
  • PEPR STEEL (Andrei)
  • Intermediate report submitted 
  • Still low profile contribution
 
  • SpectrumCoP-WP[1,2,3] (Andrei, Vanessa)
  • Final report in preparation
 
  • ENSURE TECH-01 call (Sorina): 
  • Status
  •  
  • MesoClouds RI proposal
  • NTR
 

2. Projects

2.1 CTAO (Luisa, Natthan)

  • NTR
  •  
 

2.2 Biomed (Sorina, Axel)

  • Status
  • NTRf
 

2.3. Juno (Andrei)

  • Status
  • Running production with real data
  • Some File Catalog fixes are necessary
  • File corruption due to overly long filenames
  • Need schema update :(
  • Fixes to be done are defined
  • Waiting for the database backup and a window for a short service shutdown
 

2.4 KM3NeT.org (Vanessa)

  • Status
  •  
  •  
 

4. Conference, workshop, publications

  • CHEP'26, Bangkok, 25-29 May
  • 2 DIRAC related contributions
  • ISGC, Taipei, 15-20 March
 
 

5. Consortium

 
  • Advancing with the HSF affiliation program
  • Hope to conclude in few weeks
 

6. AOB

  • The next meeting date: 28.04.26 at 14pm
  • JCAD'26, Nantes, 5-7 October, deadline 22 May
 
 
 
 
 
Il y a un compte-rendu associé à cet événement. Les afficher.
    • 14:00 14:40
      Etat du projet 40m
      • Tour de table
      Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Vanessa Hamar (CC-IN2P3 / CNRS)
    • 14:40 15:20
      Projets 40m
      Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Axel BONNET ({CNRS}UMR5220), M. Bertrand Rigaud (CC-IN2P3), Luisa Arrabito (LUPM), Natthan Pigoux (LUPM), Sorina POP (CNRS)
    • 15:20 15:25
      Publications / Conférences 5m

      Publications

      Conferences

      Orateur: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France)
    • 15:25 15:35
      Consortium news 10m
      Orateur: Dr Andrei Tsaregorodtsev (CPPM-CNRS)
    • 15:35 15:45
      AOB 10m