WP2 fortnightly meeting
-
-
1
NewsOrateurs: Rosie Bolton (Square Kilometre Array Organisation), Xavier Espinal (CERN)
- Mid-term review confirmed by the 27th of November 2020.
- Preparations: ~30mins/WP + ~20mins discussion draft to be circulated with project management by Friday 23 October
- Task leads: high level summary slide (or couple of them) by tomorrow
- DepOps: nice data lake activity plots
- E-EB 3rd of November
- Preparations: ~30mins/WP + ~20mins discussion draft to be circulated with project management by Friday 23 October
- Technical coordination meeting kick-off (date tbc)
- To ensure good integration of the ESFRIs and RIs with the various technical work packages, and good understanding and feedback between what the scientific collaborations want to do and how ESCAPE implements the relevant infrastructure and services
- WP leads and representatives from the ESFRIs and RIs. Technical experts invited when needed.
- Milestones and deliverables:
- M2.3 (M22): Second WP2/DIOS Workshop (virtual event)
- Date: 8th and 9th of December (half day)
- M2.4 (M24): Expanded prototype. Verify experiment data access from compute platforms (including commercial clouds)
- Heads-up to review storage resources deployed. To evolve data lake infrastructure towards a meaningful size, allowing to scale-up data ingestion and throughput challenges.
- M2.3 (M22): Second WP2/DIOS Workshop (virtual event)
- FDR exercise
- 17th Nov- 1st Dress Rehearsal
- Workplan (please update) https://docs.google.com/presentation/d/1WW11aczpXGiMAULIhOEiMCUNUR48BLI94MqA74fcPss/edit?usp=sharing
- 15th Dec - 2nd Dress Rehearsal
- 17th Nov- 1st Dress Rehearsal
- Mid-term review confirmed by the 27th of November 2020.
-
2
WP2 workshop preparationOrateur: All
WP2 2nd workshop agenda discussion
- Format: we proposed 1 full day, comments?
- Pilot assessment:
- Experiments perspective?
- Sites perspective?
- Task leads perspective about the exercise? what went well, what can be improved, plans for the 2nd FDR, etc...
- Next steps:
- Preparations for the 2nd Dress Rehearsal
- Integration with compute/WP5 joint discussion?
- Next steps:
- Evolution of the pilot towards the prototype
- Action list review and highlights
NB: Need to appoint a scientific secretary. Please drop an email to myself/Rosie if you want to cover this key role.
-
3
Data injection demonstrators (discussion)Orateur: Dr Riccardo Di Maria (CERN)
All the sciences/experiments are now on board, having provided reports for at least the 1st exercise.
The reports for the 2nd exercise are attached to agenda https://indico.in2p3.fr/event/22501/ .
CMS, EGO-VIRGO, and SKA reports for 2nd tasks are still missing.
3rd Data Injection Demonstrators meeting next week, for which the 3rd task is due:
accessing the data in the lake with an application/workflow that does use the data and produce a real output.
If you are using a JupyterLab notebook, the work performed by our GSOC student (Rucio-JupyterLab Extension) could be handy. It is a simple extension to be installed.
https://github.com/didithilmy/gsoc2020
https://github.com/didithilmy/rucio-jupyterlab
Several topics were raised at today's meeting that should be discussed with a broader audience (i.e. next WP2 Fortnightly meeting):
- greedy option for RSEs;
- Rucio multi-VO functionalities;
- experiment-specific RSE.
-
4
AOB
Rob Barnsley - Rucio testing framework
-
1