WP2 fortnightly meeting

Europe/Paris
Xavier Espinal (CERN)
    • 11:00 11:10
      News 10m
      Orateurs: Rosie Bolton (Square Kilometre Array Organisation), Xavier Espinal (CERN)
      • ESCAPE General Assembly extended to two days: 28 and 29 September (possibly a hybrid at CERN, covid measures allowing it) 
        • 28th September, full day for technical discussions (Ian, TC). Deeper technical understanding project progress and RI’s needs.
        • 29th morning will be dedicated to WP presentations (prototypes, technical progress with demonstrations, etc), TSPs and in the afternoon the GA presentation.
      • FENIX project (https://fenix-ri.eu/) progress: agreed to start addressing common AAI by using ESCAPE/IAM as Identity provider on the FENIX AAI structure, prototype/testing data delivery using FTS3 with swift endpoints (Ian, Andrea and Rizart present at the last meeting.) 
      • DAC21 Activities moving forward at good pace, preparing the scenario to start strong after the summer break. 
      • WP2 meetings through the summer:
        • 14th July - Confirmed
        • 28th July - Propose to keep but need a chair
        • 11th August - Propose to Cancel
        • 25th August - Confirmed
      • WP5 workshop: https://doodle.com/poll/74n7vucisds5ein3  (doodle closes 1 July)
      • HDF5 meeting proposed by PANOSC (HDF5 is a file format widely used in PaNOSC and also in some of our communities): https://www.hdfgroup.org/hug/europeanhug21/ (July 7-8)
        • Abstract submitted by Paul Millar
      • EGI conference 19-21st October: https://www.egi.eu/egi-conference/2021-beyond-the-horizon/call-for-abstracts/ (abstract submission deadline: tomorrow 1st of July)
       
       
    • 11:10 11:25
      Advancements towards the token-based authentication 15m
      Orateur: Rizart Dona (CERN)

      Current Status

      Storages

      • CNAF-STORM accepts ESCAPE IAM issued tokens → Users encouraged to try it

      • The rest  → Unknown

      • Storage Providers are kindly asked to update https://wiki.escape2020.de/index.php/WP2_-_DIOS#Datalake_Status in order to reflect the actual status of the storage → First test, and if it works, indicate “Token Based Auth/Z” as “YES”

      FTS3 - Pilot Instance [https://fts3-pilot.cern.ch:8446]

      • Accepts ESCAPE IAM issued tokens → Users encouraged to try it

      Rucio Instance

      • Accepts ESCAPE IAM issued tokens

      • Some technicalities still to be resolved (WiP) → Nevertheless users encouraged to try it

      Testing Effort

      User Documentation

      GFAL2: https://dmc-docs.web.cern.ch/dmc-docs/developers/bearer-tokens.html

      FTS3: https://fts3-docs.web.cern.ch/fts3-docs/fts-rest/docs/cli/index.html#ftsresttransfersubmit

      Rucio: http://rucio.cern.ch/documentation/using-rucio-client/#open-id-connect-authentication-examples

    • 11:25 11:45
      Activity-One progress update: Data Injection, Replication and Processing 20m
      Orateurs: Riccardo Di Maria (CERN), Yan Grange (ASTRON, the Netherlands Institute for Radio Astronomy), frederic gillardo

      ActivityOne had 3 gatherings. Minutes at: https://docs.google.com/document/d/1DFtmVtBHxPISdYKnk0iRZ-wdXGG7hEi_iuLAUDdIb1s/edit?usp=sharing .

      QoS discussion and reports are being hosted during the last part of the meeting.

      Agnostic scenario: only SKA showed a strong interest wrt this topic (which, however, is not excluded by KM3Net and EGO-Virgo a-priori). SKA is expected to follow up on their progress/activity/tests on the topic.

      Deterministic vs not-deterministic RSEs:  almost all experiments are interested to consider and assess both scenarios.

      Kick-starting DL-as-a-S: JupyterLab-Rucio integration fully-flagged service. Started at CERN and proceeding to be integrated into the cluster hosting ESCAPE Rucio instance. 

       

      M1 and M2 achieved with the exception of:

      • Benchmarking data/dataset size and volume effect on namespace, tape-disk moving behaviour, etc.

      M3 (July 31, 2021):

      • Standardise DL-as-a-S in WP2 (evaluating integration in WP5), deterministic vs. non-deterministic RSEs, and agnostic scenario
      • Start supporting data life-cycle aka QoS (cross-task activity with T2.2) ETA would not depend on T2.1
      • External resources (cloud)
    • 11:45 12:00
      Short updates from DAC21 Activity Groups 15m
      Orateurs: M. Agustin Bruzzese (PIC), Andrea Ceccanti (INFN), Marek Szuba (GSI), Paul Millar (DESY), Dr Riccardo Di Maria (CERN), Rizart Dona (CERN), Rosie Bolton (Square Kilometre Array Organisation), Yan Grange (ASTRON, the Netherlands Institute for Radio Astronomy), frederic gillardo
    • 12:00 12:05
      Depops hot topics 5m
      Orateur: Depops weekly chair
    • 12:10 12:15
      AOB 5m

      Astronomy presence at Rucio community workshop (28 Sep (Tuesday) to 30 Sep (Thursday) + 01 Oct (Friday) optionally too). Encourage good ESCAPE WP2 presence in general, but in particular please get in touch with Rosie if you have an astronomy Rucio use case  / experience to present - we are planning an astronomy-specific session in the Workshop