DIRAC Project meeting

Europe/Paris
Visio Zoom

Visio Zoom

Join Zoom Meeting https://univ-grenoble-alpes-fr.zoom.us/j/95783652062?pwd=THhMYkdoWEdQQTNnRlpiQnlpQ1Bvdz09 Meeting ID: 957 8365 2062 Passcode: 212053 One tap mobile +33170950350,,95783652062# France +33186995831,,95783652062# France
Johan Bregeon (IN2P3 LSPC)
Description


Join Zoom Meeting
https://univ-grenoble-alpes-fr.zoom.us/j/95783652062?pwd=THhMYkdoWEdQQTNnRlpiQnlpQ1Bvdz09

Meeting ID: 957 8365 2062
Passcode: 212053
One tap mobile
+33170950350,,95783652062# France
+33186995831,,95783652062# France

Participants
  • Andrei Tsaregorodtsev
  • Andrii Lytovchenko
  • Fabio Hernandez
  • Gino Marchetti
  • Jerome Pansanel
  • Johan Bregeon
  • Luisa Arrabito
  • Paul MUSSET
  • Pierre Gay
  • Sorina POP
  • Vanessa Hamar
  • Yannick Patois

----------------------
Update Dirac Andrei
+ v7 : 8 patch releases v7r2p47, v7r3p24
  ARC6ComputingElement -> Transition to ARC REST Interface
    à noter CTA utilise déjà un ARC6 CE à Lugano au CSCS
  CloudComputingElement -> potentially VMDIRAC replacement
    config comme un CE normal, avec metadata en plus pour image cloud
    Andrei a vérifié que l'authentification par toke fonctionne
    -> à tester pour biomed ou eNMR
    
+ 8.0.0a26
  WebAppDIRAC 5.0.0a10
  python3 only
  OAuth2/OIDC AAI, user management
  12 hackathons to tests non-token related functionality
  dedicated certification instance for OAuth tokens by Andrii
  => undefined state : broken OAuth machinery, differencies in opinions of key developers
  next hackathon on July 21st !
  EGI
    ccdiracli06.in2p3.fr installed with 8.0.0a25
    -> handles EGI token etc...
  On Going Developments
    Access by token to HTCondorCE
      -> demonstrated to work with the HTCondorCE at CC (Vanessa!)
         integration with SiteDirector/TokenManager, issue with packaging condor software
    WebAppDIRAC
      Updated framework based on the TornadoREST class
      AuthHandler - example REST implementation
      Framework for the implementation of the new REST interface (long standing issue)
    COMDIRAC
      discussion with GridPP developers -> merge into DIRAC, overall revision, adding new commands
    Datasets in the CTA context
      further developments: search by metadata, use in Transformation/jobs

+ EGI service
  8M jobs since Jan 2022, up to 4k concurrent jobs
  servers installation
    all servers are at v7r3p15 (but ccdiracli06 at 8.0.0a23)
    next steps: python3 servers
  documentation update by Gino
    review risk assessment (added risk for CE/SE becomes unavailable)
  VMDIRAC new sites configured but few used, most work with token
  Jupyter
    setting up DIRAC to access in Jupyter notebooks, successful dues to the CVMFS mount
    getting user proxy in the notebooks
      > source /cvmfs/dirac.egi.edu/dirac/bashrc_egi_dev
      > dirac-login SERVICE

+ Concordia project
  magor upgrade of the EscapeDIRAC extension ongoing

+ ESAP
  integration with DIRAC

+ Recognizing DIRAC as the base workload manager for ESCAPE
+ EOSC Core Exchange -> avec EGI

+ Conseil Scientifique de l'IN2P3
  présentation de Luisa, including DIRAC@IN2P3

+ Conferences
  EGI 19-23 Septembre à Prague, includes DIRAC sessions (with Eiscat 3D)
    => mardi 20 septembre le matin
  ACAT 2022 Bari ?

+ Consortium agreement amendment is pending
  University of Montpellier slow approval...

+ PNNL left the consortium (people moved...)
  but Jefferson Lab is a likely candidate

+ TSPaper to be revived
  => make a plan, take advantage of Alice on-going work on workflows for CTA

+ Sorina
  use case HPC, MPI sur 200 noeuds !
 
---------------------------
+ singularity bug => microdocker = udocker
  institutionaliser utilisation container dans DIRAC ?
  udocker -> udockerComputingElement
  => prévoir réunion dédiée Dirac containers : use cases etc...
 

+ prochaine réunio le 23 août à 14h

 

Il y a un compte-rendu associé à cet événement. Les afficher.
    • 10:00 10:15
      Etat du projet 15m
      • Update Dirac v7 et v8
      • Changement de nuage des machines virtuelles des serveurs
      • EGI, ESCAPE, EOSC
      • Tour de table
      Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Johan Bregeon (IN2P3 LSPC)
    • 10:15 10:25
      Update CTA 10m
      Orateur: Luisa Arrabito (LUPM)
    • 10:25 10:30
      ELK & Monitoring 5m
      • CTA Instance - filling CPU, and WMS monitoring
      • FG-Dirac/DIRAC4EGI configuration
      Orateur: Luisa Arrabito (LUPM)
    • 10:50 11:00
      Publications / Conférences 10m

      Publications

      • Transformation System
      • Meta Query

      Conferences

      • ACAT 2022, Oct 24-28, Bari, https://indico.cern.ch/event/1106990/
      Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Johan Bregeon (IN2P3 LSPC)