S'authentifier

WP5 monthly meeting 22 June meeting 2020

→ Europe/Paris
Description

Meeting with all partners involved in WP5/ESAP

You have been invited to attend a videocon taking place in virtual meeting room:

Join Zoom Meeting
https://astron.zoom.us/j/7999431526

Meeting ID: 799 943 1526

Meeting Password: Will be provided via email.

One tap mobile
+31207947345,,7999431526# Netherlands
+31202410288,,7999431526# Netherlands

 

Contact
Cacher

● 1. Roll call

ASTRON: Zheng Meyer-Zhao, Michiel van Haarlem

CERN:

CNRS:

CSIC: Susana Sanchez

CTAO: Matthias Fuessling

EGO: Pierre Chanial

FAIR: Raffaele Grosso

FAU:  Jutta Schnabel

INAF:

IFAE: 

JIVE: Harro Verkouter

KIS:

Nikhef:

OU:

RUG: Maisam Mohammadi-Dadkan

SKAO: Rosie Bolton

UCM: Daniel Nieto

UEDIN: Stelios Voutsinas

● 3. Announcements, news and general updates

Overview Milestones

  • 31-Jul-20: Initial science platform prototype with discovery and data staging
    • Delayed ~3 months due to COVID-19
  • 30-Sep-20: Deployment of initial set of ESFRI software on prototype platform
  • 30-Nov-20: Second WP5 workshop to analyse prototype performance

Overview Deliverables

  • 31-Jan-2021:Performance assessment of initial Science Platform prototype
  • 31-Jul-2022:  Final assessment of the performance of the Science Platform prototype and plan for deployment of production version within the EOSC.

● ASTRON

  • Preparing ESAP Focused months
  • Structuring the code base such that more developers can contribute
  • Updating ESAP code base documentation

● CSIC

Finalising the OpenStack deployment on our cluster. Telecon with UEDIN (Stelios) to discuss specific things about Science platform and Jupyter notebooks. 

● FAIR

Testing the retrieval of data by the containerised Jupyter Notebook from the Data Lake instead of the current access from local file system.

● FAU

Interlink to WP3:

  • Upcoming software workshop (WOSSL - Workshop on the Open Source Software Lifecycle), probably 23rd-28th July, includes part on Interoperability of software in workflows (more info in WP3 indico)

● JIVE

Ilse van Bemmel and Aard Keimpema are working hard to create a Jupyter notebook running on a Jupyter-CASA image to do data processing of EVN experiments and investigating Jupyter notebook version control. Aard is also working on a Jupyterlab extension to load data from the EVN archive into an are reachable by the image.

 

● RUG

The Docker image of R3BRoot is almost ready. It needs some effort to implement a deep neural network (DNN) algorithm for the Neuland detector in that. We are working on developing a Jupyter NB for analyzing data of the Neuland detector.

● SKAO

We have been continuing to work on our Kubernetes-supported compute provision, looking into persistence of storage and external user access for JupyterHub. We are also working on a host of related technologies aimed at giving users access to compute instances spun up to meet their needs.

We are ready and willing to actively participate in the development of the SAP, but struggling to know where to begin because the busy week did not happen.

We'd also like to better understand the road map for ESAP development - we will engage with the "busy months" as much as possible.

● UCM

* Expanding use cases in coordination with CTAO.

* Studying how to implement use cases into ESAP.

● UEDIN

Our recent effort has been focused on:

- Initial development effort with the ESAP prototype

  • Building and deploying a Docker container with the API & Adex GUI locally
  • Extend the VO Registry Connector and Adex GUI to allow a keyword-based search for VO (TAP) services. 

- Telecons with other ESCAPE WP5 teams to discuss our Science Platform & JupyterHub activities as well as ESAP development.

- Tech Talk with updates on our work with ESAP & Science Platforms (JupyterHub & Notebook focused)

● 7. WP5 Tech meetings Topics

https://indico.in2p3.fr/category/907/

22 June: Stefano A. Russo (INAF)
6 July: Marek Szuba (GSI / FAIR)
20 July: Zheng Meyer-Zhao (ASTRON)

Partners still to be scheduled from September:

CERN:

CNRS:

CSIC: will schedule a tech talk when prototype is ready

CTAO:

EGO:

FAU:

JIVE:

KIS:

Nikhef:

OU:

RUG:

SKAO:

UCM:

Il y a un compte-rendu associé à cet événement. Les afficher.
    • 1
      1. Roll call

      ASTRON: Zheng Meyer-Zhao, Michiel van Haarlem

      CERN:

      CNRS:

      CSIC: Susana Sanchez

      CTAO: Matthias Fuessling

      EGO: Pierre Chanial

      FAIR: Raffaele Grosso

      FAU:  Jutta Schnabel

      INAF:

      IFAE: 

      JIVE: Harro Verkouter

      KIS:

      Nikhef:

      OU:

      RUG: Maisam Mohammadi-Dadkan

      SKAO: Rosie Bolton

      UCM: Daniel Nieto

      UEDIN: Stelios Voutsinas

    • 2
      2. Last meeting minutes

      Minutes of last meeting can be found at the previous meeting.
      Overview of meetings: https://indico.in2p3.fr/category/906/

    • 3
      3. Announcements, news and general updates

      Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
      Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.

      If you are unable to add the information please send it to werkhoven@astron.nl. We will then add it for you.

      For the current prototype platform development (code base) go to:
      Back end: https://git.astron.nl/vermaas/esap-gateway
      ESAP GUI: https://git.astron.nl/vermaas/adex-gui
      Please note that, these are under development, a stable version will be announced on 30th of June.

      Overview Milestones

      • 31-Jul-20: Initial science platform prototype with discovery and data staging
        • Delayed ~3 months due to COVID-19
      • 30-Sep-20: Deployment of initial set of ESFRI software on prototype platform
      • 30-Nov-20: Second WP5 workshop to analyse prototype performance

      Overview Deliverables

      • 31-Jan-2021:Performance assessment of initial Science Platform prototype
      • 31-Jul-2022:  Final assessment of the performance of the Science Platform prototype and plan for deployment of production version within the EOSC.
      • a) ASTRON
        • Preparing ESAP Focused months
        • Structuring the code base such that more developers can contribute
        • Updating ESAP code base documentation
      • b) CERN
      • c) CNRS-LAPP
      • d) CSIC

        Finalising the OpenStack deployment on our cluster. Telecon with UEDIN (Stelios) to discuss specific things about Science platform and Jupyter notebooks. 

      • e) CTAO
      • f) EGO
      • g) FAIR

        Testing the retrieval of data by the containerised Jupyter Notebook from the Data Lake instead of the current access from local file system.

      • h) FAU

        Interlink to WP3:

        • Upcoming software workshop (WOSSL - Workshop on the Open Source Software Lifecycle), probably 23rd-28th July, includes part on Interoperability of software in workflows (more info in WP3 indico)
      • i) IFAE
      • j) INAF
      • k) JIVE

        Ilse van Bemmel and Aard Keimpema are working hard to create a Jupyter notebook running on a Jupyter-CASA image to do data processing of EVN experiments and investigating Jupyter notebook version control. Aard is also working on a Jupyterlab extension to load data from the EVN archive into an are reachable by the image.

         

      • l) KIS
      • m) Nikhef
      • n) RUG

        The Docker image of R3BRoot is almost ready. It needs some effort to implement a deep neural network (DNN) algorithm for the Neuland detector in that. We are working on developing a Jupyter NB for analyzing data of the Neuland detector.

      • o) SKAO

        We have been continuing to work on our Kubernetes-supported compute provision, looking into persistence of storage and external user access for JupyterHub. We are also working on a host of related technologies aimed at giving users access to compute instances spun up to meet their needs.

        We are ready and willing to actively participate in the development of the SAP, but struggling to know where to begin because the busy week did not happen.

        We'd also like to better understand the road map for ESAP development - we will engage with the "busy months" as much as possible.

      • p) UCM

        * Expanding use cases in coordination with CTAO.

        * Studying how to implement use cases into ESAP.

      • q) UEDIN

        Our recent effort has been focused on:

        - Initial development effort with the ESAP prototype

        • Building and deploying a Docker container with the API & Adex GUI locally
        • Extend the VO Registry Connector and Adex GUI to allow a keyword-based search for VO (TAP) services. 

        - Telecons with other ESCAPE WP5 teams to discuss our Science Platform & JupyterHub activities as well as ESAP development.

        - Tech Talk with updates on our work with ESAP & Science Platforms (JupyterHub & Notebook focused)

    • 4
      4. Focus Months (formerly known as Busy week)

      Change of format -> change of name
      Start: 30 June - End: September

      We want to invite more developers from WP5 to join the code base introduction meeting and form ESAP service (e.g. Data query, Rucio, Jupyter Notebook on clusters) working groups.

      The goal of these working groups will be to coordinate similar works done by WP5 partners and integrate with ESAP API Gateway.
      More info and registration is on:
      https://indico.in2p3.fr/event/21650/

      The first code base introduction is planned on 30 June 13:00-16:00. This will be repeated 2-3 times for people who cannot make to the first one. A doodle poll will be sent out to vote for the next code base introduction.

      Suggetions are welcome:
      Tools for communication
      method of code development and review

    • 5
      5. News items

      ESAP services / technology
      - Frontend: React, React Bootstrap
      - Backend: Django, Django REST Framework
      Partner input for 18 months report
      - Needs input from partners for WP5 18 months report to the EC.
      - Partners will get an email to provide input.

      INFRA-EOSC03: EXPAND proposal
      - ESCAPE got 2.2 M out of 40 M budget for implementing Science Use cases using ESAP
      - 3 TSPs (Test Science Projects): Dark Matter, Gravitational Waves, FRBs
      - Start from January 2021 for 30 months

    • 6
      6. Second WP5 workshop to analyze prototype performance & F2F meeting : 26-30 October @ Virtual meeting
      • Let's keep the dates
      • Maybe change it to 2-3 days format
      • Presentations from working groups during the focus months
    • 7
      7. WP5 Tech meetings Topics

      https://indico.in2p3.fr/category/907/

      22 June: Stefano A. Russo (INAF)
      6 July: Marek Szuba (GSI / FAIR)
      20 July: Zheng Meyer-Zhao (ASTRON)

      Partners still to be scheduled from September:

      CERN:

      CNRS:

      CSIC: will schedule a tech talk when prototype is ready

      CTAO:

      EGO:

      FAU:

      JIVE:

      KIS:

      Nikhef:

      OU:

      RUG:

      SKAO:

      UCM:

    • 8
      8. Round table
    • 9
      9. Next meeting - Monday 20 July 11:00 CEST

      Today at 4PM there will be the Tech Talk - Rosetta: a container-centric science platform by Stefano A. Russo (INAF)

      more info about the topics:
      https://indico.in2p3.fr/event/20642/

Fonctionne avec Indico v3.3.5