WP4 Technology Forum 2

13 avr. 2021, 09:00 → 15 avr. 2021, 16:30 Europe/Paris

On-line

Andre Schaaff (CNRS), Dave Morris, François Bonnarel (CDS ObAS CNRS Université de Strasbourg), Hendrik Heinl, Marco Molinaro (INAF), Mark Allen (CDS/CNRS), Martino Romaniello

 

The WP4 Technology Forum 2 is organised as a major WP4 meeting of the ESCAPE project. All WP4 partners are encouraged to attend.  We plan to have cross-WP activities and a number of invited guests.

Goals

Update on the progress of all of the WP4 tasks.

• Task 4.1 - Integration of astronomy VO data and services into the EOSC
• Task 4.2 – Implementation of FAIR principles for ESFRI data through the Virtual Observatory
• Task 4.3 – Adding value to trusted content in astronomy archives

Prepare the ESCAPE input to the May 2021 IVOA Interoperability meeting.

Strengthen the cross-WP activities with WP3, WP5 and WP2.

Planning for the WP4 activities in the 2nd part of the ESCAPE project.

Work together on practicial implementations!

 

Location and Schedule

Due to the on-going covid-19 pandemic, this Technology Forum will be held as an on-line event.

The schedule is include below.  The presentation sessions are organised in the mornings and hack-a-thon interactions in the afternoons, with the final conlcuding session on Thursday afternoon.

Registration

Registration is now closed...

Contributed presentations can be proposed in the registration form, and we also encourage you to propose hack-a-thon topics. Note that you can return to your registration form to add/modify the contributions, and hack-a-thon topics can of course be decided on-the-spot in the meeting according to the needs.

Links

Top level info for WP4 is maintained on the Wiki pages: https://wiki.escape2020.de/index.php/WP4_-_CEVO

ESCAPE project: https://projectescape.eu

 

mardi 13 avril

09:00 → 10:40 Introduction

09:00 Welcome and logistics

Orateurs: Mark Allen (CDS/CNRS), Hendrik Heinl (CDS/ObAS)

09:10 Overview of ESCAPE and WP4 status

Orateur: Mark Allen (CDS/CNRS)

ALLEN_intro_v1.pdf

ALLEN_intro_v1.pptx

09:30 Task 4.1 Summary and Status

Orateur: Marco Molinaro (INAF)

Task 4.1 [pdf]

09:50 Task 4.2 Summary and Status

Orateur: François Bonnarel (CDS ObAS CNRS Université de Strasbourg)

Task4.2.pdf

10:10 Task 4.3 Summary and Status

Orateur: Martino Romaniello (ESO)

04_Romaniello_Task43.pdf

10:40 → 11:00 Virtual Coffee Break

11:00 → 12:45 Session. (Chair - Marco Molinaro)

11:00 Provenance update and intro for Provenance hack-a-thon

Follow-up of the 2020 workshop on Provenance requirements

Orateur: Mathieu Servillat (LUTH, Observatoire de Paris)

2021-04-13 Provenance update @WP4-TF.pdf

11:15 How the ESO Archive makes use of VO Technologies

ESO Web and Programmatic interfaces, using: - ADQL - Aladin Lite - DataLink - HiPS - ObsCore - SAMP - SODA - SSA - STC-S (point, circle, polygon, multi-polygon) - TAP (DALI, VOSI, UWS, UCD, UTYPE, ...) - TOPCAT - VOTable - pyvo

Orateur: Alberto Micol

06_ESO_experience_adopting_VO_2021.pdf

11:40 Using Neutrino data - a KM3NeT perspective

In this contribution the requirements and current status of the integration efforts of high-energy neutrino data in the VO, and more widely, ESCAPE environment, is introduced from the perspective of KM3NeT. A special focus will be given to the requirement of providing probability estimates alongside the data to interpret these low-statistic data samples. If fitting, we can also provide an update on the KM3NeT provenance developments.

Orateur: Jutta Schnabel (Friedrich-Alexander Universität Erlangen-Nürnberg)

WP4 Tech forum KM3NeT dataformat + provenance April2021.pdf

12:05 UCD and TAP service for solar physics

We explain what has been achieved this year at the ROB within WP4, Task 2.2 on 'implementing FAIR principles through VO'. Mapping of UCD to solar physics catalogs and FITS keywords is underway, and some extensions of UCD to solar physics are being discussed. We also investigated the interoperability between a solar image browser, JHelioviewer, and the TAP service at ESAC through the use of SAMP protocol. Finally, we began to install a TAP server using the DaCHS software. The goal is to serve FITS files as well as event catalogs.

Orateur: Veronique Delouille (STCE/Royal Observatory of Belgium)

08_WP4_TechForum_TAP_UCD_solarphysics_ROB.pdf

12:45 → 14:00 Lunch Break

14:00 → 15:00 Hack-a-thon on VO and Solar data/services

ESTintheVOHaT.pdf

15:00 → 16:00 Hack-a-thon: Provenance

Président de session: Mathieu Servillat (LUTH, Observatoire de Paris)

mercredi 14 avril

09:00 → 10:30 Session (Chair - Stefania Amodeo)

09:00 Feedback from the 1st Science with interoperable data school

The presentation will focus on the most relevant aspects of the First science with interoperable data school held on-line on 2021 Feb 8-12, 19

Orateur: Enrique Solano

08_school_techforum_14apr2021.pdf

09:20 CTA

Orateurs: Dr Matthias Fuessling (CTAO gGmbH), Catherine Boisson (LUTH, Obs. Paris-Meudon)

2021-04_CEVO_CTA.pdf

09:45 Multi Order Coverage data structure to plan multi-messenger observations

We describe the use of Multi Order Coverage (MOC) maps as a practical way to manage complex regions of the sky for the planning of multi-messenger observations. Using the example of the low-latency gravitational-wave alerts, and a simulated observational campaign with three observatories, we show that the use of MOC maps allows a high level of interoperability to support observing schedule plans.

Orateur: Giuseppe Greco (INFN-Perugia)

10_MOCvisibility.pdf

10:05 A VO service for the European VLBI Network

At JIVE we are working on making data from the European VLBI Network (EVN) archive available through VO protocols. For this purpose we have built a TAP service that serves ObsCore records. To create these records we wrote some special-purpose software in Python that extracts the necessary meta-data from FITS-IDI files. In this presentation I will discuss some of the choices made when writing this software as well as some further improvements we still intend to make before the service goes "live".

Orateur: Mark Kettenis (JIVE)

11_ESCAPE-WP4-TechForum-kettenis.pdf

10:30 → 11:00 Virtual Coffee Break

11:10 → 12:50 Session (Chair - Dave Morris)

11:10 Using semantics to give B2Find better metadata

Orateur: Markus Demleitner

12_b2finduat.pdf

11:30 VESPA-Cloud

We have developed of prototype to deploy DaCHS instances, using docker and openstack, with git version control for server configuration, as well as for services configurations. The prototype was developed with support from EOSC-Hub, and has been tested and CC-IN2P3 and CESNET cloud-compute resources. We also explored the storage of dat and metadata in EUDAT. The framework can also be used locally, e.g., for continuous integration and testing during the service development stage.

Orateur: M. Baptiste Cecconi (Observatoire de Paris)

VESPA-Cloud-ESCAPE-Apr-2021.pdf

11:50 Data Model usage in the VO

I'll present an overview on different possible usages of the data models in the VO

Orateur: Laurent Michel (Observatoire Astronomique de Strasbourg)

VODM-Escape-2021.pdf

12:10 Intro for VO Validation hack-a-thon

Improve VO service validation statistics: I'd like to get together with willing participants (especially VO service operators/owners) to understand validation failures and maybe improve service compliance or validator behaviour. TAP especially, but also SCS, SIA, SSA - see e.g. https://wiki.ivoa.net/internal/IVOA/InterOpNov2020Ops/20201118-Euro-VOResourcesValidationStatus.pdf

Orateur: Mark Taylor (University of Bristol)

validate.pdf

12:50 → 14:00 Lunch Break

14:00 → 15:00 Hack-a-thon on ESFRI requirements for VO: Hack-a-thon on ESFRIs

ESFRI-Requirements-FOR-VOstandards.pdf

ESFRIRequirementsForVOStandards.pdf

SKA-visHiPSandAladinLite.pdf

15:00 → 16:00 Hack-a-thon VO Validation

17:00 → 18:00 Hack-a-thon: pgsphere

Président de session: Hendrik Heinl (CDS/ObAS)

jeudi 15 avril

09:00 → 10:50 Session (Chair - André Schaaff)

09:00 ESAP Gateway API + GUI, current implementation status

In WP5 we have been implementing the ESAP Gateway, a REST API and a GUI on top of that. So far, it has mostly been geared towards 'data discovery', where institutes were able to configure and query their 'service providers' in a common and generic way. Ideally, this pattern of configuration and API's can be used for integration of other types of services into the ESAP framework also, by the other WP teams.

Orateur: Nico Vermaas

09:30 WP4 - WP5 topics

Orateur: Stelios Voutsinas

WP5-4_topics_voutsinas.pdf

09:50 Software metadata in the IVOA

How we can use the OSSR metadata to register and deploy IVOA software.
How we could use the OSSR metadata to plan task execution in ESCAPE and the IVOA.

Orateur: Dave Morris (University of Edinburgh)

20210414-metadata.pdf

10:10 Apertif DR1 integration into ASTRON VO services

Orateur: Yan Grange (ASTRON, the Netherlands Institute for Radio Astronomy)

Apertif DR1.pptx

screencap 1.mp4

screencap 2.mp4

10:30 Mining the EVN Archive using JupyterLab and the VO

Mining the EVN Archive using JupyterLab and the VO At JIVE we are building a JupyterHub based portal to the archive of the European VLBI Network (EVN). The portal will allow users to process any dataset from the EVN archive on hardware at JIVE. As part of this effort we have created a JupyterLab plugin which allows users to query the EVN archive through our recently created TAP service. The plugin can also import the discovered datasets into the user's JupyterLab environment. In this talk I will discuss the implementation of this plugin and the various issues encountered when interacting with the VO through a JupyterLab plugin. I will also briefly discuss our efforts to get the EVN Archive, which contains visibility data rather than images, into the VO.

Orateur: Aard Keimpema (JIVE)

WP4-Techforum-keimpema.pdf

10:50 → 11:10 Virtual Coffee Break

11:10 → 12:30 Hack-a-thon: Cross-WP activities: Including VO and Platforms

12:30 → 14:00 Lunch Break

14:00 → 15:30 Conclusions

14:00 Hack-a-thon Feedback Reports

2021-04-13 Provenance hack-a-thon @WP4-TF.pdf

ESFRIsRequirementsForStandardsHackaThon.pdf

SolarHackaThon.pdf

14:45 Discussion / Planning

15:05 Conclusions and next steps

Orateur: Mark Allen (CDS/CNRS)

ALLEN_summary.pptx