WP5 Monthly meeting 19 July 2021

Europe/Paris
Description

Meeting with all partners involved in WP5/ESAP

You are invited to attend a videocon taking place in virtual meeting room:


Join Zoom Meeting
https://astron.zoom.us/j/97308347310?pwd=Q0xCdkQ3R2lESEtQMjcybnpQZXRzZz09

Meeting ID: 973 0834 7310
Password: Will be provided via email*

One tap mobile
+31202410288,,97308347310# Netherlands
+31207940854,,97308347310# Netherlands

    • 1
      1. Roll call
      • Pierre Chanial (EGO)
      • James Collinson (SKAO)
      • Maisam  M. Dadkan (RUG)
      • Hugh Dickinson (Open University)
      • Matthias Fuessling (CTAO)
      • Raffaele Grosso (FAIR)
      • Marie Paturel (CNRS-LAPP)
      • Stefano Russo (INAF)
      • Susana Sánchez (CSIC)
      • Killian Schwarz (FAIR)
      • Mathieu Servillat (CTAO)
      • John Swinbank (ASTRON)
      • Nico Vermaas (ASTRON)
      • Stelios Voutsinas (U. Edinburgh)
    • 2
      2. Last meeting minutes

      Minutes of last meeting can be found at the previous meeting.
      Overview of meetings: https://indico.in2p3.fr/category/906/

    • 3
      3. Announcements, news and general updates

      Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
      Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.

      • a) ASTRON
        • Preparation for the upcoming Second WP5 workshop (see following agenda item).
        • Multiple improvements to ESAP, including:
          • Use of the “shopping basket” to enable users to select query results for further processing (#6#7, #8)
          • Enable access to the ASTRON ESAP instance over standard ports to work around firewalls limiting access from some institutions (#13)
          • Several user experience improvements and minor bugfixes to ESAP (#12)
          • fixed the ESAP-GUI usability issues and bugs with the shopping basket that were identified
          • improved (and understood) the token expiration issue (not fully solved, because it was not on the board for this iteration)
          • added very basic connectors for apertif, astron_vo and SAMP to the python client (for use in the Jupyter notebook)
      • b) CERN
      • c) CNRS-LAPP
        • Rubin Science Platform successfully deployed at LAPP
        • WP5 Tech talk to present it soon
      • d) CSIC

        We have met with members of the WP4, in order to discuss about the IVOA model for provenance data. The minutes of this meeting can be found in https://wiki.escape2020.de/index.php/WP4_-_CEVO (search for "SKAO CEVO provenance meeting")

      • e) CTAO
      • f) EGO

        Work on ESAP-DB:

        • new repo for the server
        • CI pipeline
        • user space to store the shapping basket as a database table
      • g) FAIR
      • h) FAU
      • i) IFAE
      • j) INAF

        Working on preparing a use case for a LOFAR analysis pipeline and investigating how to integrate it into ESAP.

         

      • k) JIVE
      • l) KIS
      • m) Nikhef
      • n) RUG
        • Deploying the JupyterHub service for R3B and CBM use-cases on the RUG cloud server
        • Developing data analysis and data handling scripts of R3B for DAC21
        • To do:
          • Configure the JupyterHub to being able to handle tokens from ESCAPE-IAM and propagate them to be used by RUCIO
          • Integration of the JupyterHub with the ESAP
      • o) SKAO
      • p) UCM
      • q) UEDIN
    • 4
      5. Upcoming Workshop

      The Second WP5 Workshop will take place on Thursday 5 August from 09:00 until 12:00 CEST.

      Details are starting to appear on Indico at https://indico.in2p3.fr/event/24716/

      As a reminder, this workshop is required to satisfy the project milestone MS31, “Second WP5 workshop to analyse prototype performance”.

      I interpret this as being a charge to invite various ESCAPE stakeholders to the workshop, to present the work which as been done to date, to give them a chance to experiment with it, and to ask them for their feedback. (I regard “performance” as describing the holistic design and concept of the ESAP — “how well does it do its job?” — rather than some limited definition which regards purely computation/query performance.)

      The draft agenda at the Indico page linked above includes:

      - An overview of the ESAP “vision”, together with some discussion of how it relates to the expressed use cases.

      - Discussion of current and upcoming work in interactive data analysis, batch processing, and managed databases.

      - Interactions with other work packages.

      - Time for discussion.

      Your feedback on what else should be added to the agenda, and — in particular — on what you could contribute would be much appreciated.

    • 5
      8. Emergent issues
    • 6
      9. Upcoming meetings
      • No WP5 monthly meeting in August. Regular schedule of third Monday in the month resumes in September: next meeting on Monday 20 September: https://indico.in2p3.fr/event/24800/
      • WP5 workshop on Thursday 5 August discussed above: https://indico.in2p3.fr/event/24716/
      • Major project meeting 28 & 29 September. All virtual (plans for a physical location have been abandoned).
        • Technical material on 28 Sept, details will be forthcoming
        • General assembly on 29 Sept
      • IDA discussion continues on Monday afternoons: https://indico.in2p3.fr/event/24708/