LAPP ESCAPE regular meeting

lundi 25 oct. 2021, 14:00 → 15:30 Europe/Paris

LAPP ESCAPE bi-weekly meetings

Emplacement:
https://meeting.lapp.in2p3.fr/b/jul-kon-2if-dwh

Indico:
https://indico.in2p3.fr/category/978/

Minutes:
On Indico

14:00 → 14:10 WP1

Orateurs: Giovanni LAMANNA (LAPP - IN2P3/CNRS), Ian Bird (LAPP), Julie CHAUDAN

• EOSC-Future had its first "technical review" on Oct 14.  The report has not been received yet (promised 2 weeks).
  • Some expectation that the project would already have delivered a lot more after only 6 months, even though the plan was mostly recruitment and planning during this time.
  • 2 of the reviewers (both HEP and HPC related) encouraged the delivery of use cases to the science projects
• Had a general TSP meeting last week, well attended.  Several concrete issues were raised (e.g. interaction between IVOA and Data Lake,  MoU with experiments maybe needed for access to some data sets, quite a lot of discussion on what the VRE is.)
  • agreed a monthly meeting to get the projects moving, in addition to the TSP-specific meetings.
  • agreed we need a wiki (or similar) to host project-internal information, documents, etc.
  • Please join the mailing lists if you think you should be involved: eoscfuture-tspdm@projectescape.eu, and eoscfuture-tspgw@projectescape.eu)
  • Agenda, presentations and minutes are here: https://indico.in2p3.fr/event/25352/ 
• Next ESCAPE periodic review is agreed for March 2, 2022

14:10 → 14:30 WP2

Orateurs: Arturo Sanchez Pineda (LAPP), Berkay TURK ({CNRS}UMR5814), Nadine NEYROUD (LAPP), Stephane JEZEQUEL (LAPP), frederic gillardo

Optional presentation --> on VRE efforts (no only WP2 related)

Frederic:

DAC 21 : 

CTA use case 2 (reprocessing) 

Discussion with Luisa A. Conclusion DIRAC server must have access to RUCIO server (not only worker). 

There is a networking rule @ PIC that prevents access from outside. This rule can not be modified before DAC21 according to Agustin. Therefore we won’t be able to run this use case :(

 

S3 : 

I created an openstack project in CERN, with s3 storage attached 50 TB.

The client s3cmd is installed and configure on lapp-esc03

Next step : modify the LAPP-AWS settings in CRIC

 

dCache : 

Remove read only anonymous access. 

For testing purpose, using oidc agent installed on lapp-esc03

Working with Federica from INF to fix the OIDC support

 

Berkay

ESCAPE:

• LAPP-WEBDAV RSE was open to anonymous access

  • It has been fixed with updating authentication mechanisms.

  • But FTS transfers are failing. Continue to investigate.

• Rucio document for DAC21

K8S:

• Second session completed on 18th October.

 

Arturo:

• For DAC21

  • After Riccardo’s call to perform tests to get ready for the event, I picked the past 15/10 and 20/10

  • Unfortunately, the past 15/10 it was an issue at CERN and almost all services were down for hours

  • So last 20/10 I started the “data augmentation” in the DLaaS. 

    • Found some relevant things like I cannot have a >99.99GB ROOT file with a TTree inside

    • This is making me change some parts so to get the 10x data I plan

    • So, I will continue the tests the coming Monday 25/10

    • This include to upload ~6TB to IN2P3/LAPP and INFN/Napoli RSEs

• At CERN

  • Sustancial conversations with Xavier regarding the integration of the new personnel

  • The past 19/10 I host an in-person meeting at CERN with Alba, Elena, Jared and Xavier to get on the same page regarding the Datalake usage, the DLaaS, the VRE prototype and other tools.

    • They agreed to have frequent meetings in person and online.

14:30 → 14:50 WP3

Orateurs: Enrique Garcia Garcia, Dr Thomas Vuillaume (LAPP, CNRS)

No mayor updates.

• New release (v0.3.3) of eOSSR (library used by the ESAP to communicate with the OSSR)*.
• v1.0 of the `mlfermilatdwarfs` package (Dark matter constraints from dwarf galaxies: a data-driven LAT analysis - Francesca Calore, Christopher Eckner et al.) was successfully uploaded to the OSSR using the new version of the library.

 

*eOSSR v.0.3.3 release note:

A major update of the eOSSR library.

• simplifies upload to the OSSR with a unique script
• Introduces eOSSR logo
• Record representation based on record ID only, improves its print_info
• handle lists in OSSR search kwargs
• solve lowercase issue in OSSR search kwargs
• introduces global HTTP errors handling
• improve documentation (notebooks are run live, clearer docstrings)
• include OSSR statistics in documentation
• update README with install and cite instructions
• Bugfix of v0.3, v0.3.1 and v0.3.2

14:50 → 15:10 WP5

Rubin Science Platform at LAPP

Orateurs: Dominique Boutigny (LAPP), Marie Paturel, Sabine Elles (LAPP)

ESCAPE_RSP_25_oct_2021.pdf

15:10 → 15:30 WP6

Orateur: Mathilde Hubert (LAPP)

VIDEOS
- General video: work in progress
- Data Science school: work in progress
- ESFRI: Only 2 video pills to be done: EST and HLC and maybe LSST

ESCAPE WEBINARS
- liaising with Xavier Espinal, WP2, to organise next one

EVENTS
- Second ESCAPE Virtual Observatory School: https://www.projectescape.eu/events/second-escape-virtual-observatory-school
-  Astronomical Data Analysis Software and Systems (ADASS) XXXI https://www.projectescape.eu/events/astronomical-data-analysis-software-and-systems-adass-xxxi