WP5 Monthly meeting 19 July 2021


Meeting with all partners involved in WP5/ESAP

You are invited to attend a videocon taking place in virtual meeting room:

Join Zoom Meeting

Meeting ID: 973 0834 7310
Password: Will be provided via email*

One tap mobile
+31202410288,,97308347310# Netherlands
+31207940854,,97308347310# Netherlands

    • 11:00 AM 11:03 AM
      1. Roll call 3m
      • Pierre Chanial (EGO)
      • James Collinson (SKAO)
      • Maisam  M. Dadkan (RUG)
      • Hugh Dickinson (Open University)
      • Matthias Fuessling (CTAO)
      • Raffaele Grosso (FAIR)
      • Marie Paturel (CNRS-LAPP)
      • Stefano Russo (INAF)
      • Susana Sánchez (CSIC)
      • Killian Schwarz (FAIR)
      • Mathieu Servillat (CTAO)
      • John Swinbank (ASTRON)
      • Nico Vermaas (ASTRON)
      • Stelios Voutsinas (U. Edinburgh)
    • 11:03 AM 11:05 AM
      2. Last meeting minutes 2m

      Minutes of last meeting can be found at the previous meeting.
      Overview of meetings: https://indico.in2p3.fr/category/906/

    • 11:05 AM 11:15 AM
      3. Announcements, news and general updates 10m

      Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
      Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.

      • ASTRON 1m
        • Preparation for the upcoming Second WP5 workshop (see following agenda item).
        • Multiple improvements to ESAP, including:
          • Use of the “shopping basket” to enable users to select query results for further processing (#6#7, #8)
          • Enable access to the ASTRON ESAP instance over standard ports to work around firewalls limiting access from some institutions (#13)
          • Several user experience improvements and minor bugfixes to ESAP (#12)
          • fixed the ESAP-GUI usability issues and bugs with the shopping basket that were identified
          • improved (and understood) the token expiration issue (not fully solved, because it was not on the board for this iteration)
          • added very basic connectors for apertif, astron_vo and SAMP to the python client (for use in the Jupyter notebook)
      • CERN 1m
      • CNRS-LAPP 1m
        • Rubin Science Platform successfully deployed at LAPP
        • WP5 Tech talk to present it soon
      • CSIC 1m

        We have met with members of the WP4, in order to discuss about the IVOA model for provenance data. The minutes of this meeting can be found in https://wiki.escape2020.de/index.php/WP4_-_CEVO (search for "SKAO CEVO provenance meeting")

      • CTAO 1m
      • EGO 1m

        Work on ESAP-DB:

        • new repo for the server
        • CI pipeline
        • user space to store the shapping basket as a database table
      • FAIR 1m
      • FAU 1m
      • IFAE 1m
      • INAF 1m

        Working on preparing a use case for a LOFAR analysis pipeline and investigating how to integrate it into ESAP.


      • JIVE 1m
      • KIS 1m
      • Nikhef 1m
      • RUG 1m
        • Deploying the JupyterHub service for R3B and CBM use-cases on the RUG cloud server
        • Developing data analysis and data handling scripts of R3B for DAC21
        • To do:
          • Configure the JupyterHub to being able to handle tokens from ESCAPE-IAM and propagate them to be used by RUCIO
          • Integration of the JupyterHub with the ESAP
      • SKAO 1m
      • UCM 1m
      • UEDIN 1m
    • 11:15 AM 11:30 AM
      5. Upcoming Workshop 15m

      The Second WP5 Workshop will take place on Thursday 5 August from 09:00 until 12:00 CEST.

      Details are starting to appear on Indico at https://indico.in2p3.fr/event/24716/

      As a reminder, this workshop is required to satisfy the project milestone MS31, “Second WP5 workshop to analyse prototype performance”.

      I interpret this as being a charge to invite various ESCAPE stakeholders to the workshop, to present the work which as been done to date, to give them a chance to experiment with it, and to ask them for their feedback. (I regard “performance” as describing the holistic design and concept of the ESAP — “how well does it do its job?” — rather than some limited definition which regards purely computation/query performance.)

      The draft agenda at the Indico page linked above includes:

      - An overview of the ESAP “vision”, together with some discussion of how it relates to the expressed use cases.

      - Discussion of current and upcoming work in interactive data analysis, batch processing, and managed databases.

      - Interactions with other work packages.

      - Time for discussion.

      Your feedback on what else should be added to the agenda, and — in particular — on what you could contribute would be much appreciated.

    • 11:30 AM 11:35 AM
      8. Emergent issues 5m
    • 11:35 AM 11:40 AM
      9. Upcoming meetings 5m
      • No WP5 monthly meeting in August. Regular schedule of third Monday in the month resumes in September: next meeting on Monday 20 September: https://indico.in2p3.fr/event/24800/
      • WP5 workshop on Thursday 5 August discussed above: https://indico.in2p3.fr/event/24716/
      • Major project meeting 28 & 29 September. All virtual (plans for a physical location have been abandoned).
        • Technical material on 28 Sept, details will be forthcoming
        • General assembly on 29 Sept
      • IDA discussion continues on Monday afternoons: https://indico.in2p3.fr/event/24708/