Bi-Weekly Datalake DepOps meeting (Rosie chairing)

mercredi 16 juin 2021, 10:00 → 11:00 Europe/Paris

Agustin Bruzzese (PIC), Andrea Ceccanti (INFN), Paul Millar (DESY), Rizart Dona (CERN), Rohini Joshi (SKA Organisation), Rosie Bolton (Square Kilometre Array Organisation), Yan Grange (ASTRON, the Netherlands Institute for Radio Astronomy), frederic gillardo

Bi-Weekly meeting to discuss progress on Rucio deployments and EDLK JIRA issues: https://jira.skatelescope.org/issues/?filter=15115

Zoom room: https://skatelescope.zoom.us/j/97713259777?pwd=Q2EwSWZ3NkRaazFRSy9YT3Y5UmdJZz09

New Rucio Instances

PIC

Discussing with CTA re. sharing instance. La Palma -> PIC transfer tests. K8s deployment, with standard daemons and Web UI. Rucio v1.23. Prometheus and ES as main monitoring tools. hermes2 used in preference to hermes1.

(Note, discussion to be had whether/how to support long haul use cases  - e.g. potential CTA use case on SKA rucio instance.)

SKAO

K8s deployment on STFC cloud. Standard daemons (plus hermes2) no web UI enabled.  Recent tests using transmogrifier daemon too. Making use of "legacy" sites used for old RAL SKA instance - IDIA (South Africa), AARNET, Manchester, Lancaster. Plus DESY, SARA - SARA  site is an old GridFTP server, better if this could be updated.

Back end Rucio database for SKA was postgres.

Deployment notes available (will be on JIRA)

Not token based - GridPP (VOMS server?) used.

Datalake health

AOB

Activity 3 - planning, use DepOps to track progress