Data and Analysis Challenge (DAC21) from the 22nd to the 26th November
Ambitious and challenging workflows prepared by the participating experiments (we have them all involved)
The exercise will be covering a wide variety of areas, all of them very relevant for the project: data recording from remote sources; data management policies, rules and lifecycles; long-haul data transferring and orchestration; data processing on different: notebooks, HPCs, clouds, large clusters; content delivery and caching; embargo data PoC and more [here]
This exercise will be the assessment of the ESCAPE Data Lake prototype by the participating scientific communities and the main input for the 2nd Reporting Period to the EC.
17th ESCAPE Executive Board tomorrow
ESCAPE Milestone M2.5 to be delivered by December: extension of the data lake to efficiently serve data to external compute resources providers (written document). Work done by Frederic, but potential use of cloud RSEs during DAC21 could bring more value.
FENIX project (https://fenix-ri.eu/) Reminder+recap: HPCs interested in "partnering" with the Science Clusters in Europe. Agreed to start working on the basic commonalities in the infrastructure to get use cases started.
Agreed on the first two main topics to address are 1) AAI (FENIX-IAM integration) and 2) FTS/S3/Swift transfer orchestration for ESCAPE data lake integration and file pre-placement.
We've got two accounts on CSCS's S3 storage services to start testing data delivery and common identity.
26th International Conference on Computing in High Energy and Nuclear Physics (CHEP 2022 2023):
ATLAS: October 20th, 25th DONE
CTA: November 15th, 16th
KM3Net: November 11th, 12th
LOFAR: November 15th, 17th, 18th (data and software preparation beforehand)
LSST: November 15th, 16th
MAGIC: November 15th, 16th
Fixed dates
CMS: November 15th, 16th
FAIR: November 15th, 16th
SKA: November 15th, 16th
EGO/VIRGO: November 15th, 16th
