Meeting with all partners involved in WP5/ESAP
You are invited to attend a videocon taking place in virtual meeting room:
Join Zoom Meeting
https://astron.zoom.us/j/97308347310?pwd=Q0xCdkQ3R2lESEtQMjcybnpQZXRzZz09
Meeting ID: 973 0834 7310
Password: Will be provided via email*
One tap mobile
+31202410288,,97308347310# Netherlands
+31207940854,,97308347310# Netherlands
ASTRON: Zheng Meyer, Michiel van Haarlem
CERN: Rizart Dona, Riccardo Di Maria
CNRS: Dominique Boutigny, Marie Paturel
CSIC: Susana Sanchez, Jose Ramon Rodon
CTAO: Matthias Fuessling, Gareth Hughes
EGO: Pierre Chanial
FAIR: Raffaele Grosso
FAU:
INAF:
IFAE: Jordi Delgado
JIVE: Harro Verkouter, Mark Kettenis
KIS:
Nikhef: Valentin Pestel
OU: Hugh Dickinson
RUG:
SKAO: Rosie Bolten
UCM: Daniel Nieto
UEDIN:
Minutes of last meeting can be found at the previous meeting.
Overview of meetings: https://indico.in2p3.fr/category/906/
Provide your information by adding minutes to the sub-contribution. You will need to have an indico account to do this.
Note: Please also mention in your updates if you are going to or were at an event to talk about ESAP.
If you are unable to add the information please send it to meyer@astron.nl. We will then add it for you.
Overview Milestones
Overview Deliverables
* Extension request is under negotiation
* Midterm report is submitted, input from partners are put into the report
* Organising WP5 Focus Months
* Leading the ESAP UI & VO working group and Rucio working group
* Developing ESAP prototype frontend and backend
* Implemented VO integration using UKIDSS use case for TAP service
* Documentations on ESAP prototype
Docker stack integrating FAIR experiment software (CbmRoot) and Jupyter upgraded, using now docker compose. The Jupyterlab image contains the necessary code to download from our datalake instance some raw data, run simple analysis with visualization on them, and upload the results back to the datalake.
Work ongoing to finalize the integration with the Rucio datalake and to progress with the software licence in order to integrate this activity with WP3 software repositories.
Ingested data on the Hadoop database (HIVE) from Gamma-rays projects like MAGIC and public data coming from HESS can be selected and explored from the GammaHub prototype. Pending to include other data coming from CTA or maybe FERMI.
New progress on the interface of the Crab Spectrum notebook using Hive DB to select data, and produce quick Data Products, like skymaps, spectrums...
The idea is to interface HIVE to perform massive data selection inside a Pythton notebook, in order to find the observations and the associated events to perform a quick analysis.
This interface requires cone search calculations to perform the selection in terms of distance in the sky. This cone search works, observations are selected quickly and for the moment are passed to gammapy to produce the quick analysis.
The same interface will be useful for the third functionality of our project, which is related to more complex analysis.
Since the last meeting CASA6.1 was released and JIVE is now working to update the CASA-Jupyter image to work with that release. More calibration-data-attachment scripts have been added (done in WP3). Attempting to create a Jupyterhub GUI for downloading data into the container, but that is proving difficult under the limited Jupyterhub API.
* 5 Working groups
* weekly meeting updates: ESAP UI * IVOA working group, IDA working group
* bi-weekly meeting updates: Rucio working group
* DIRAC working group: in close collaboration with WP3
* Planning integration on Rosetta (INAF)
* Implemented query for VO and non-VO use cases within ESAP frontend and backend
* Examples are VO integration, Zooniverse integration, and ASTRON data explorer integration
* OU will present Zooniverse integration results this afternoon at the Tech Talk
* Plan to reach Milestone 5.3 (October), 5.4 (October)
Call for participants and presentations
* Presentations from each working group
* Discussion and future work sessions
* Indico event page will be available soon
* Please register for the event
* If you have workflows, JupyterNotebook Environment available, please send it to Rohini Joshi (SKAO) to add it into the JupyterHub instance.
* Each working group will give an update during the progress meeting.
* Encourage WP5 partners and ESFRIs to participate in ESAP performance evaluation after the progress meeting to prepare for M5.5 (Performance Evaluation workshop). We hope to be able to organise the workshop F2F in the beginning of next year.
At 4PM there will be a Tech Talk more info about the topics:
https://indico.in2p3.fr/category/907/
