WP5 Monthly meeting 20 September 2021


Meeting with all partners involved in WP5/ESAP

You are invited to attend a videocon taking place in virtual meeting room:

Join Zoom Meeting

Meeting ID: 973 0834 7310
Password: Will be provided via email*

One tap mobile
+31202410288,,97308347310# Netherlands
+31207940854,,97308347310# Netherlands

    • 11:00 AM 11:03 AM
      Roll call 3m
      Speaker: John Swinbank (ASTRON)
      • Dominique Boutigny (CNRS-LAPP)
      • Maisam M. Dadkan (RUG)
      • Hugh Dickinson (Open University)
      • Rizart Dona (CERN)
      • Matthias Füßling (CTAO)
      • Raffaele Grosso (FAIR)
      • Gareth Hughes (CTAO)
      • Aard Keimpema (JIVE)
      • Klaas Kliffen (ASTRON)
      • Riccardo Di Maria (CERN)
      • Valentin Pestel (Nikhef)
      • Jose Ramón Rodón (CSIC)
      • Mathieu Servillat (CTAO)
      • John Swinbank (ASTRON)
      • Harro Verkouter (JIVE)
    • 11:03 AM 11:05 AM
      Minutes of the last meeting 2m

      Minutes of thelast meeting can be found at the previous meeting.
      Overview of meetings: https://indico.in2p3.fr/category/906/

      Speaker: John Swinbank (ASTRON)
    • 11:05 AM 11:25 AM
      Announcements, news and general updates 20m

      Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
      Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.

      • ASTRON 1m
        • Klaas Kliffen joined the team at ASTRON.
          • Expect to see him making various contributions to ESCAPE-relevant work over the next few weeks and months.
        • Reminder: meetings next week!
          • Extended technical discussions on 28 September: https://indico.in2p3.fr/event/24690/
            • All day meeting, with multiple sessions involving WP5.
            • Please try to participate as much as you can, and in particular in the WP5-focused sessions.
          • “General Assembly” on 29 September: https://indico.in2p3.fr/event/24500/
            • Morning session open to all; afternoon is closed/invitation-only
        • August WP5 workshop
          • Thanks to everybody who participated and contributed to making this workshop a success!
          • Those who were on holiday or were otherwise unavailable can refer to the meeting materials at https://indico.in2p3.fr/event/24716/
        • Milestone & deliverable over the summer.
          • Following the August workshop, we claimed completion of Milestone MS31, “Second WP5 workshop to analyse prototype performance”.
          • In late August, I submitted deliverable D5.3, “Performance Assessment of Initial Science Platform Prototype” — document as submitted attached to this page for your reference.
          • We are still waiting for confirmation from the EC that these have been accepted (but on past performance, that can take months).
          • Huge thanks to everybody who contributed to this work!
        • WP3+WP5 discussion.
          • Very useful meeting last week; notes at https://indico.in2p3.fr/event/24885/
          • We will follow-up on these discussions at the extended discussion day next week.
          • Check the notes of that meeting: there are some unclaimed actions. Please take this opportunity to step up and volunteer to help out with them!
        • Apologies (to Marie in particular) for delay in restarting tech talks; I'm on it.
      • CERN 1m

        Finished Data Lake as a Service; presented in various forums, including https://indico.in2p3.fr/event/25039/.

      • CNRS-LAPP 1m
        • Maintain 2 Rubin Science Platform instances up to date (1 on premise and 1 using Proxmox) 
        • Deployment is ~stable and fully functional
        • Continue testing on small datasets
        • Intend to test it on CTA data
        • Ready for a tech talk with demo


        • Test Dask as a parallel data access system to Parquet files
          • Test Dask interface to SGE (hundreds of workers connected to your notebook !)
          • Impressive performance


      • CSIC 1m

        We revised the D5.3 deliverable and provided some comments/suggestions

      • CTAO 1m

        Zenodo Arhive on ESAP landing page

        • will add eOSSR to routines
        • add some search options e.g. software

        ESAP backend and DIRAC container

        • initial testing 
        • more volunteers
      • EGO 1m
      • FAIR 1m

        No news.

      • FAU 1m
      • IFAE 1m
      • INAF 1m
      • JIVE 1m


      • KIS 1m
      • Nikhef 1m

        Working with WP2 to make KM3Net data available on the data lake.

      • RUG 1m
        • The RUG-FAIR Jupyterhub has been deployed (on Swarm cluster) on the RUG cloud server.
        • The IAM-ESCAPE enabled for the Jupyterhub.
        • The scripts for running during DAC21 are underway.
        • Integration of the user-notebooks with Datalake-as-a-service (the new rucio-JNB extension) is in the plan.
      • SKAO 1m
      • UCM 1m
      • UEDIN 1m
    • 11:25 AM 11:30 AM
      Emergent issues 5m
    • 11:30 AM 11:35 AM
      Upcoming meetings 5m

      Technical meetings continue Monday at 16:00 (https://indico.in2p3.fr/event/24908/).

      Extended discussion day (https://indico.in2p3.fr/event/24690/) and GA (https://indico.in2p3.fr/event/24500/) next week.

      Next monthly meeting 18 October; no Indico page at time of writing (I'm on it...).