General TSP meeting

Europe/Paris
Ian Bird is inviting you to a scheduled Zoom meeting. Topic: TSP Coordination Time: This is a recurring meeting Meet anytime Join Zoom Meeting https://cern.zoom.us/j/61664951981?pwd=VU1kNWJuYmZpUXNydHhzd3FxN1BqQT09 Meeting ID: 616 6495 1981 Passcode: 906877 One tap mobile +33170379729,,61664951981# France +33186995831,,61664951981# France Dial by your location +33 1 7037 9729 France +33 1 8699 5831 France +33 1 7037 2246 France +41 43 210 70 42 Switzerland +41 43 210 71 08 Switzerland +41 31 528 09 88 Switzerland Meeting ID: 616 6495 1981 Find your local number: https://cern.zoom.us/u/cedwQoIwSh Join by SIP 61664951981@188.184.85.92 61664951981@188.184.87.135 Join by H.323 188.184.85.92 188.184.87.135 Meeting ID: 616 6495 1981 Passcode: 906877
Ian Bird (LAPP)
Description

Ian Bird is inviting you to a scheduled Zoom meeting.

Topic: TSP Coordination
Time: This is a recurring meeting Meet anytime

Join Zoom Meeting
https://cern.zoom.us/j/61664951981?pwd=VU1kNWJuYmZpUXNydHhzd3FxN1BqQT09

Meeting ID: 616 6495 1981
Passcode: 906877
One tap mobile
+33170379729,,61664951981# France
+33186995831,,61664951981# France

Dial by your location
        +33 1 7037 9729 France
        +33 1 8699 5831 France
        +33 1 7037 2246 France
        +41 43 210 70 42 Switzerland
        +41 43 210 71 08 Switzerland
        +41 31 528 09 88 Switzerland
Meeting ID: 616 6495 1981
Find your local number: https://cern.zoom.us/u/cedwQoIwSh

Join by SIP
61664951981@188.184.85.92
61664951981@188.184.87.135

Join by H.323
188.184.85.92
188.184.87.135
Meeting ID: 616 6495 1981
Passcode: 906877

    • 09:00 09:10
      Introduction 10m

      Goals of TSP meeting:

      • Kick off the collaborative work on the TSPs, help get the new people up to speed
      • Make a first set of draft milestones:
        • by each sub-project and project
        • by service (deployment status, functionality)
      • Start gathering real resource estimates (CPU/GPU/other, storage, & etc.) - need ground up estimates by sub-project
        • determine which project partners will be able to provide what level of resources to cross-domain TSPs
        • start to build an estimate of what we will ask for procurements (via ESCAPE & EOSC-Future), and what we will want from HPC
      • Understand first steps (e.g. in putting data sets into data lake, …)
      • Identify any missing input or show stoppers

      Some of this list can be action items/homework, but we need to get moving on this. If we can do some in the meeting, so much the better.

      On the planning/milestones: I think a few high level milestones is all we require - enough to show progress and to provide coordination points. We do not need fine grained planning (in my opinion).

      • Clarify personnel situation
        Note that we are obliged to monitor how the EOSC-Future funded effort is used, and report on it.
      Orateur: Ian Bird (LAPP)
    • 09:10 09:25
      Dark Matter - overview 15m
      Orateur: Caterina Doglioni (Lund University)
    • 09:25 09:40
      Extreme Universe - overview 15m
      Orateur: Elena Cuoco
    • 09:40 10:00
      Planning 20m
      • Milestones, etc
      • ESCAPE software & services needed (Data Lake, OSSR, ESAP, WP4, - initial VRE, ... etc.)
      Orateur: Ian Bird (LAPP)
      • Comments on Data Lake 5m
        Orateurs: Elena Gazzarrini, Xavier Espinal (CERN)
        • The current ESCAPE Data Lake infrastructure provides the required functionality to start an early implementation for the Dark Matter TSP. Functionalities are in place for Data Injection, Data Replication and Data Processing via Notebooks/DLaaS.

        • This early implementation can be coupled to the activities carried on in ESCAPE to import experiments workflows in view of the ESCAPE DAC21 to assess the pilot prototype performance. This will activate a quick onboarding process of people and the sciences, thanks to the overlap and the synergies between ESCAPE and EOSC-future projects.

        • Idea (Arturo) to establish a cross-working group with the aim to replicate and align the current work being done in ESCAPE in view to accelerate the TSP onboarding. 

        • Some of the activities we can start addressing now for the DM TSP:

          • Data injection

          • Implement policies and replication rules if needed

          • Data processing activities: 

            • Notebook, Data Lake as a Service, computing clusters

            • Explore accessing to software/libraries (OSSR)

        • Several other activities started recently which will be naturally following this early stage, some of those are:

          • HPC/FENIX: ability to port the data, software and workflows to the HPC centers. 

          • Early collaboration with CSCS to prototype a storage endpoint for data access and common AAI strategy. 

        • RECAST/REANA integration in the VRE, DLaaS or other platforms where to spawn a re-analysis.

        • Some services are bound to the ESCAPE project and its timeline. Need to understand how to properly evolve or maintain them. 

          • Storage Resources in ESCAPE come from the participating sites, and need to be understood how we frame them. Reduced number of sites might be OK, EGI-ACE resources ok too, just need to frame our expectation.

          • Data Lake services at CERN: RUCIO, FTS, CRIC, etc.

      • Comments on OSSR 5m
        Orateur: Kay Graf (ECAP - University of Erlangen)
      • Comments on VRE ideas 5m
        Orateur: Arturo Sanchez Pineda (LAPP)
    • 10:00 10:20
      Resource requirements 20m

      Initial estimates of needs and timelines

      Orateur: Ian Bird (LAPP)
    • 10:20 10:40
      Discussion/planning 20m
    • 10:50 10:55
      AOB 5m
      • Future meetings and frequency - DM/EU-specific meetings, General meeting as coordination point
      Orateur: Ian Bird (LAPP)