LAPP ESCAPE regular meeting

Europe/Paris
Description

LAPP ESCAPE bi-weekly meetings

Emplacement:
https://meeting.lapp.in2p3.fr/b/jul-kon-2if-dwh

Indico:
https://indico.in2p3.fr/category/978/

Minutes:
On Indico

    • 1
      WP1
      Orateurs: Giovanni LAMANNA (LAPP - IN2P3/CNRS), Ian Bird (LAPP), Julie CHAUDAN
      • EOSC-Future had its first "technical review" on Oct 14.  The report has not been received yet (promised 2 weeks).
        • Some expectation that the project would already have delivered a lot more after only 6 months, even though the plan was mostly recruitment and planning during this time.
        • 2 of the reviewers (both HEP and HPC related) encouraged the delivery of use cases to the science projects
      • Had a general TSP meeting last week, well attended.  Several concrete issues were raised (e.g. interaction between IVOA and Data Lake,  MoU with experiments maybe needed for access to some data sets, quite a lot of discussion on what the VRE is.)
        • agreed a monthly meeting to get the projects moving, in addition to the TSP-specific meetings.
        • agreed we need a wiki (or similar) to host project-internal information, documents, etc.
        • Please join the mailing lists if you think you should be involved: eoscfuture-tspdm@projectescape.eu, and eoscfuture-tspgw@projectescape.eu)
        • Agenda, presentations and minutes are here: https://indico.in2p3.fr/event/25352/ 
      • Next ESCAPE periodic review is agreed for March 2, 2022
    • 2
      WP2
      Orateurs: Arturo Sanchez Pineda (LAPP), Berkay TURK ({CNRS}UMR5814), Nadine NEYROUD (LAPP), Stephane JEZEQUEL (LAPP), frederic gillardo

      Frederic:

      DAC 21 : 

      CTA use case 2 (reprocessing) 

      Discussion with Luisa A. Conclusion DIRAC server must have access to RUCIO server (not only worker). 

      There is a networking rule @ PIC that prevents access from outside. This rule can not be modified before DAC21 according to Agustin. Therefore we won’t be able to run this use case :(

       

      S3 : 

      I created an openstack project in CERN, with s3 storage attached 50 TB.

      The client s3cmd is installed and configure on lapp-esc03

      Next step : modify the LAPP-AWS settings in CRIC

       

      dCache : 

      Remove read only anonymous access. 

      For testing purpose, using oidc agent installed on lapp-esc03

      Working with Federica from INF to fix the OIDC support

       

      Berkay

      ESCAPE:

      • LAPP-WEBDAV RSE was open to anonymous access

        • It has been fixed with updating authentication mechanisms.

        • But FTS transfers are failing. Continue to investigate.

      • Rucio document for DAC21

      K8S:

      • Second session completed on 18th October.

       

      Arturo:

      • For DAC21

        • After Riccardo’s call to perform tests to get ready for the event, I picked the past 15/10 and 20/10

        • Unfortunately, the past 15/10 it was an issue at CERN and almost all services were down for hours

        • So last 20/10 I started the “data augmentation” in the DLaaS. 

          • Found some relevant things like I cannot have a >99.99GB ROOT file with a TTree inside

          • This is making me change some parts so to get the 10x data I plan

          • So, I will continue the tests the coming Monday 25/10

          • This include to upload ~6TB to IN2P3/LAPP and INFN/Napoli RSEs

      • At CERN

        • Sustancial conversations with Xavier regarding the integration of the new personnel

        • The past 19/10 I host an in-person meeting at CERN with Alba, Elena, Jared and Xavier to get on the same page regarding the Datalake usage, the DLaaS, the VRE prototype and other tools.

          • They agreed to have frequent meetings in person and online.

    • 3
      WP3
      Orateurs: Enrique Garcia Garcia, Dr Thomas Vuillaume (LAPP, CNRS)

      No mayor updates.

      • New release (v0.3.3) of eOSSR (library used by the ESAP to communicate with the OSSR)*.
      • v1.0 of the `mlfermilatdwarfs` package (Dark matter constraints from dwarf galaxies: a data-driven LAT analysis - Francesca Calore, Christopher Eckner et al.) was successfully uploaded to the OSSR using the new version of the library.

       

      *eOSSR v.0.3.3 release note:

      A major update of the eOSSR library.

      • simplifies upload to the OSSR with a unique script
      • Introduces eOSSR logo
      • Record representation based on record ID only, improves its print_info
      • handle lists in OSSR search kwargs
      • solve lowercase issue in OSSR search kwargs
      • introduces global HTTP errors handling
      • improve documentation (notebooks are run live, clearer docstrings)
      • include OSSR statistics in documentation
      • update README with install and cite instructions
      • Bugfix of v0.3, v0.3.1 and v0.3.2
    • 4
      WP5

      Rubin Science Platform at LAPP

      Orateurs: Dominique Boutigny (LAPP), Marie Paturel, Sabine Elles (LAPP)
    • 5
      WP6
      Orateur: Mathilde Hubert (LAPP)

      VIDEOS
      - General video: work in progress
      - Data Science school: work in progress
      - ESFRI: Only 2 video pills to be done: EST and HLC and maybe LSST

      ESCAPE WEBINARS
      - liaising with Xavier Espinal, WP2, to organise next one

      EVENTS
      - Second ESCAPE Virtual Observatory School: https://www.projectescape.eu/events/second-escape-virtual-observatory-school
      -  Astronomical Data Analysis Software and Systems (ADASS) XXXI https://www.projectescape.eu/events/astronomical-data-analysis-software-and-systems-adass-xxxi