Compte rendu réunion DIRAC@IN2P3
Mardi 31 mars 2026
Atendees: Andrei, Axel, Bertrand, Héloïse, Loris, Luisa, Mazen, Natthan, Stella-Maria, Sorina, Vanessa
Agenda:
- Publications / Conferences
1. Project Status
Partial budget received (75%)
- Missions (DUW'26, Prague)
- DUW organization (cattering, etc)
- Try to avoid participation fees
1.1 Versions :
- DIRAC v9.1.3 (from 9.0.20)
- DIRACX Release v0.0.11 (from 0.0.9)
- Minor (authdb, sandbox optimization)
1.2 DiracX Hackathon (24-25 March)
Less participation than usual, dominated by French participants :)
Main news
- First introduction of the diracx tasks
- Main stumbling block on the way of DIRAC->diracx migration
- Database+Logic+Tasks+Routers+Testing
- Very useful for everybody interested in the diracx migration development - you are welcome to follow it
- CWL based WMS is advancing (Alexandre, Ryan, Natthan, Luisa, ...)
- Close to be released ?...
- Some change in the choice of the underlying libraries
- Date to be fixed - preliminarily end of June
1.3 Current Developments :
- Sprints (Natthan, Luisa, Stella, Loris, Heloise, Mazen)
- Heloise, Loris: Sprint related to the RSS
- DMS/File Catalog porting (Andrei, Heloise, Bertrand ? )
- Goal: come up with the single configuration, best performing based on the acquired experience
- To be used as the starting point for the diracx migration
- Testing 3 FileCatalog DB schemas
- Currently used by default (split tables, DirectoryLevelTree)
- "Consolidated" (merged tables, DirectoryLevelTree)
- "LHCb" (merged tables, DirectoryClosure)
- Metadata support to be confirmed, updates might be needed
- 3 File Catalog services are set up per DB schema
- using client server communication
- same script for all the schemas
- filling in about 1M files/100K directories with metadata
- Simple look-ups in parallel
- Various bulk queries - to be defined
- Services and databases are defined:
- Might need some optimization
- Population scripts are ready
- Adding about 70files/sec in a single thread
- Some minor improvements might be need
- Population test can be done this week
- Query tests can start afterwards
- Procedure to migrate current catalogs to be defined
- Better data consistency (Foreign Keys, less tables)
- Optimizations based on the LHCb and other's experience
- Some plug-ins can still be there
- diracx-cwl (Luisa, Natthan, Loris, Stella)
- How to accelerate the diracx WMS full-fledged system ?
- Deployment with K8s (Bertrand)
- Common prefix a tous les indexes
- Utilisation des certificats
- Utilisation des certificats
- Still way to be found for the case with multiple databases
- DataStream - how to use ? To be solved hopefully
1.4. EGI Services:
- The service itself is running smoothly
- Service splitting (Vanessa)
- Hosts are ready with DIRAC8 software installed
- KM3NeT configuration done
- Site local configuration to be updated - a GGUS campaign to be done (Mazen, Luc ?)
- Jobs with Check-In tokens are running
- IAM token configuration to be done
- Needs help of the IAM managers to set up DIRAC clients
1.4. European/National Projects :
- Site Ranking criteria is defined
- Taking into account also the Site congestion
- Monitoring criteria are defined
- Useful work per unit of gCO2
- Using traces of real jobs (since 2023)
- Mimicking real scheduling algorithms
- Other resources to be included in consideration (HPC)
- Intermediate report submitted
- Still low profile contribution
- SpectrumCoP-WP[1,2,3] (Andrei, Vanessa)
- Final report in preparation
- ENSURE TECH-01 call (Sorina):
2. Projects
2.1 CTAO (Luisa, Natthan)
2.2 Biomed (Sorina, Axel)
2.3. Juno (Andrei)
- Running production with real data
- Some File Catalog fixes are necessary
- File corruption due to overly long filenames
- Fixes to be done are defined
- Waiting for the database backup and a window for a short service shutdown
2.4 KM3NeT.org (Vanessa)
4. Conference, workshop, publications
- CHEP'26, Bangkok, 25-29 May
- 2 DIRAC related contributions
- ISGC, Taipei, 15-20 March
5. Consortium
- Advancing with the HSF affiliation program
- Hope to conclude in few weeks
6. AOB
- The next meeting date: 28.04.26 at 14pm
- JCAD'26, Nantes, 5-7 October, deadline 22 May
Il y a un compte-rendu associé à cet événement.
Les afficher.