- Data And Analysis Challenge (DAC21)
- The three preparatory activities started:
- A1: Data Injection, Data Management and Data Processing
- A2: Multi-RUCIO, Data Lake continuous testing and Monitoring/operations
- A3: AAI, token integration, ACLs and networks
- Bi-weekly meeting focused on Activity-1 but touching base in the advancement on global DAC21 related topics (https://indico.in2p3.fr/event/24398/)
- Global progress tracked at the WP2 bi-weekly meetings (https://indico.in2p3.fr/event/24459/)
- Need engagement/presence from WP3/WP4/WP5 to progress and achieve the goals at the x-task boundaries:
- WP3: Delivering of Software, calibration files, containers/VMs (jobs) to compute facilities: sites, clouds, HPCs.
- WP4: HiPS set-up and test storage endpoint)
- WP5: Different ESAPs integration with DAC21 data processing activities (data “preparation" and analysis)
- Progress towards token based authentication. Activated token daemons on FTS, running tests+debug involving RUCIO and RSEs. Several issues being addressed to have a common translation and understanding across the systems about token scopes, tokens “audiences” and trusting of the token issuer.
- ATLAS Distributed Computing Technical Board asked WP2 to present status and prospects of the ESCAPE Data Lake status. Riccardo presented. Positive feedback from ATLAS community.
- Ian and myself representing ESCAPE in early discussions with the FENIX project. They are interested in "partnering" with the Science Clusters in Europe. We had a close meeting yesterday to start working on the basic commonalities in the infrastructure to get some use cases started. Main items are 1) AAI and 2) FTS/Swift guided transfers for data pre-placement and 3) software distribution possibilities (containers).
- Possibility to get some resources in September. We need to identify an HPC use-case/workflow from one of more sciences in ESCAPE and prepare a letter of intent to formally ask for these resources (deadline 9th July). Please reflect on this and get back to Ian and myself, different possibilities can be considered for different workflow types and will be important to get the ball rolling with these HPC community that are intending to homogeneize the access and the usage for the different partners participating: JULICH, BSC, CINECA, CSCS, CSC, CEA and EBRAINS.