WP5 Monthly meeting 21 September

Name: WP5 Monthly meeting 21 September
Start: 2020-09-21T11:00:00+02:00
End: 2020-09-21T12:00:00+02:00
Location: No location set

lundi 21 sept. 2020, 11:00 → 12:00 Europe/Paris

Description

Meeting with all partners involved in WP5/ESAP

You are invited to attend a videocon taking place in virtual meeting room:

Join Zoom Meeting
https://astron.zoom.us/j/97308347310?pwd=Q0xCdkQ3R2lESEtQMjcybnpQZXRzZz09

Meeting ID: 973 0834 7310
Password: Will be provided via email*

One tap mobile
+31202410288,,97308347310# Netherlands
+31207940854,,97308347310# Netherlands

Contact

meyer@astron.nl

- 11:00 → 11:03
  
  1. Roll call 3m
  
  ASTRON: Zheng Meyer, Michiel van Haarlem
  
  CERN: Rizart Dona, Riccardo Di Maria
  
  CNRS: Dominique Boutigny, Marie Paturel
  
  CSIC: Susana Sanchez, Jose Ramon Rodon
  
  CTAO: Matthias Fuessling, Gareth Hughes
  
  EGO: Pierre Chanial
  
  FAIR: Raffaele Grosso
  
  FAU:
  
  INAF:
  
  IFAE: Jordi Delgado
  
  JIVE: Harro Verkouter, Mark Kettenis
  
  KIS:
  
  Nikhef: Valentin Pestel
  
  OU: Hugh Dickinson
  
  RUG:
  
  SKAO: Rosie Bolten
  
  UCM: Daniel Nieto
  
  UEDIN:
- 11:03 → 11:05
  
  2. Last meeting minutes 2m
  
  Minutes of last meeting can be found at the previous meeting.
  Overview of meetings: https://indico.in2p3.fr/category/906/
- 11:05 → 11:15
  3. Announcements, news and general updates 10m
  
  Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
  Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.
  
  If you are unable to add the information please send it to meyer@astron.nl. We will then add it for you.
  Overview Milestones
  
  31-Jul-20: MS29 Initial science platform prototype with discovery and data staging
  
  30-Sep-20: MS30 Deployment of initial set of ESFRI software on prototype platform
  
  30-Nov-20: MS31 Second WP5 workshop to analyse prototype performance
  
  Overview Deliverables
  
  31-Jan-2021: D5.3 Performance assessment of initial Science Platform prototype
  
  31-Jul-2022: D5.4 Final assessment of the performance of the Science Platform prototype and plan for deployment of production version within the EOSC.
  - ASTRON 1m
    
    * Extension request is under negotiation
    
    * Midterm report is submitted, input from partners are put into the report
    
    * Organising WP5 Focus Months
    
    * Leading the ESAP UI & VO working group and Rucio working group
    
    * Developing ESAP prototype frontend and backend
    
    * Implemented VO integration using UKIDSS use case for TAP service
    
    * Documentations on ESAP prototype
  - CERN 1m
    
    CERN WP5 contribution has resulted in the JupyterLab-Rucio integration.
  - CNRS-LAPP 1m
    
    Newcomer: Marie Paturel on a 2 year contract at CNRS-LAPP
    
    Start deploying the LSST Science Platform
  - CSIC 1m
    
    We participate in ESAP UI & IVOA. In particular, we are integrating services for accessing simulated data ( asteroseismology) and exploring how SAMP can be used to connect ESAP with the VO ecosystem.
    
    We also participate in IDA WG since we are interested in deploying a JupyterHub service on the IAA SRC prototype.
  - CTAO 1m
    
    Leading DIRAC FG for the Focus month.
    Still working on scope, design and functionality.
    
    Several meeting with meetings/tech discussions with DIRAC experts.
    
    This has lead to a connection between WP3 who are using DIRAC to run CORSIKA containers.
    They might be able to offer this as a service to WP5.
  - EGO 1m
    
    On-going work to run the ESCAPE test science case for MMA at CNAF data center with GW, then using GW data from the datalake.
  - FAIR 1m
    
    Docker stack integrating FAIR experiment software (CbmRoot) and Jupyter upgraded, using now docker compose. The Jupyterlab image contains the necessary code to download from our datalake instance some raw data, run simple analysis with visualization on them, and upload the results back to the datalake.
    
    Work ongoing to finalize the integration with the Rucio datalake and to progress with the software licence in order to integrate this activity with WP3 software repositories.
  - FAU 1m
  - IFAE 1m
    
    Ingested data on the Hadoop database (HIVE) from Gamma-rays projects like MAGIC and public data coming from HESS can be selected and explored from the GammaHub prototype. Pending to include other data coming from CTA or maybe FERMI.
    
    New progress on the interface of the Crab Spectrum notebook using Hive DB to select data, and produce quick Data Products, like skymaps, spectrums...
    
    The idea is to interface HIVE to perform massive data selection inside a Pythton notebook, in order to find the observations and the associated events to perform a quick analysis.
    
    This interface requires cone search calculations to perform the selection in terms of distance in the sky. This cone search works, observations are selected quickly and for the moment are passed to gammapy to produce the quick analysis.
    
    The same interface will be useful for the third functionality of our project, which is related to more complex analysis.
  - INAF 1m
  - JIVE 1m
    
    Since the last meeting CASA6.1 was released and JIVE is now working to update the CASA-Jupyter image to work with that release. More calibration-data-attachment scripts have been added (done in WP3). Attempting to create a Jupyterhub GUI for downloading data into the container, but that is proving difficult under the limited Jupyterhub API.
  - KIS 1m
  - Nikhef 1m
  - RUG 1m
  - SKAO 1m
    
    SKA has been looking at interfacing to the JupyterHUb API to see if available resources can be "advertised" to ESAP users. This is actually tricky - good collaboration with Stelios Voutsinas (UEdin) to progress technical work.
  - UCM 1m
    
    * Following up UI & IVOA working group.
    * Considering alternative use cases to integrate CTA higher level data access and analysis into ESAP (UCM internal discussion).
  - UEDIN 1m
  - OU 1m
- 11:15 → 11:25
  
  4. Focus Months updates 10m
  
  * 5 Working groups
  
  * weekly meeting updates: ESAP UI * IVOA working group, IDA working group
  
  * bi-weekly meeting updates: Rucio working group
  
  * DIRAC working group: in close collaboration with WP3
  
  * Planning integration on Rosetta (INAF)
  
  * Implemented query for VO and non-VO use cases within ESAP frontend and backend
  
  * Examples are VO integration, Zooniverse integration, and ASTRON data explorer integration
  
  * OU will present Zooniverse integration results this afternoon at the Tech Talk
  
  * Plan to reach Milestone 5.3 (October), 5.4 (October)
- 11:25 → 11:35
  
  5. WP5 Progress Meeting via Zoom 26-28 October 10m
  
  Call for participants and presentations
  * Presentations from each working group
  * Discussion and future work sessions
  
  * Indico event page will be available soon
  
  * Please register for the event
  
  * If you have workflows, JupyterNotebook Environment available, please send it to Rohini Joshi (SKAO) to add it into the JupyterHub instance.
  
  * Each working group will give an update during the progress meeting.
  
  * Encourage WP5 partners and ESFRIs to participate in ESAP performance evaluation after the progress meeting to prepare for M5.5 (Performance Evaluation workshop). We hope to be able to organise the workshop F2F in the beginning of next year.
- 11:35 → 11:40
  
  6. WP5 Tech meetings Topics 5m
  
  Please fill in the Doodle:
  
  https://doodle.com/poll/safnc3ep3wv7pqqw
  
  21 Sep: OU
  
  5 Oct: Looking for contribution
  
  19 Oct: KM3Net
  
  2 Nov: UEDIN
  
  16 Nov: IFAE
  
  30 Nov: CSIC
- 11:40 → 11:45
  
  7. Round table 5m
- 11:45 → 11:50
  
  8. Next meeting - Monday 19 October 11:00 CEST 5m
  
  At 4PM there will be a Tech Talk more info about the topics:
  https://indico.in2p3.fr/category/907/

Choisissez le fuseau horaire

WP5 Monthly meeting 21 September