DIRAC Project meeting

mardi 6 mars 2018, 10:00 → 12:05 Europe/Paris

Visio Zoom

Johan Bregeon (IN2P3 LUPM)

The DIRAC@IN2P3 Project meeting to review the progress in various activities

https://zoom.us/j/660700907

DIRAC@IN2P3 meeting
-------------------
+ budget : 6k euros arrived and is available at CPPM

-------------------
DIRAC Update

+ usual series of patches, one patch per week
+ V6r20 is in certification phase, slow because many developments at CERN and people are busy
+ CentOS7 - still no coherent middleware package, many issues, with gfal2 in particular
            Chris tries to recompile everything from source, but really not straightforward
+ DIRAC workshop very soon at CC-IN2P3
  idea of a tutorial on the TransformationSystem
    -> good idea, for users and for us to improve on documentation, standard tutorial, etc...
    -> need to work on it from now to have a real hands on session

+ DIRAC4EGI has been officially launched
  new communities come in with users to register, new apps to setup
  new engineer shall arrive soon, either April 1st or May 1st
  wanted to hire 2 people, Andrei found only one so far
  one person from Cyfronet will join the effort
 
+ Ecole au Vietnam
  LUPM director organize a school in Vietnam
  proposal to have a DIRAC course
  Andrei underlines the fact that DIRAC by itself is not really interesting for students that do not have a direct use case, it would be better to have a more general big data/parallel computing course. Hands on, tutorials are difficult to setup in Hanoi for infrastructure issues.
  Andrei had contacts with IFI

+ Missing files at CNAF
  if just one file missing, option to let the job start anyway, file remains unused
  no tool to remove files just from the catalogue
 
 
+ DIRAC acknowledgement
  Andrei to see with agent valorisation CNRS
  find a good formula to put in all papers

-------------------
OBELICS catalogue of services
  DIRAC4EGI service or DIRAC software ?
  to be prepared for EGI anyway, just
 

-------------------
MetaQuery, TransformationSystem and ProductionSystem
  New ProductionSystem integrated to the CTA Dirac setup
  in order to test it in a production context
  needed a few patches to Transformation cli and db
  Basic tests done : create, remove, list associated transformations
  Work to be done on Production monitoring
                     Meta Query matching
  Plan is to get something good enough to be presented to the community
    -> DIRAC request for comments
    -> discussion at DIRAC user workshop
  Andrei question on the web interface
    -> no real thoughts about it yet
    -> look into the Web interface of LHCb production system

-------------------
Publication
COMDIRAC
  Pierre got back on his paper
  need for new feedback
  https://plmlatex.math.cnrs.fr/project/594294e228fe7c787feec2e8

Discussion on simplifying the DIRAC client installation
  Pierre would like to reduce the externals for the client
  Andrei mentions it's already reduced w.r.t. the server
  work on-going, but no simple solution
  pip install dirac - example config file exists on github
 
Andrei goes to a conference in Taipei
  presents management of heteregenous resources
  HPT/HTC/Clouds etc...
  with proceedings !

 

1 Etat du projet

• Update Andrei
• Questions diverses
  ** Ecole d'Hanoi : contribution Dirac (Luisa)
  ** InputDataResolution : ignore missing files option, Banned sites ? (Luisa, Johan)
  ** Acknowledgement for DIRAC (Luisa, Johan)

Orateurs: Dr Andrei Tsaregorodtsev (CPPM, Marseille), Johan Bregeon (IN2P3 LUPM)

2 Contribution au catalogue de service OBELISC

Bonjour Luisa et Johan,

Under the framework of H2020-ASTERICS, we are developing a catalogue of open services for data integration.
This work is being carried out by WP3-OBELICS, it will be released as an open catalogue of services and will be reported to European Commission as a formal deliverable (D3.14).

Today I am writing to you to request a contribution from DIRAC to this open catalogue of services for data integration. More specifically we would need the following information:

A brief description of the service along with the requisite weblinks and contact details 
How this service has been used and in which projects (e.g. CTA… )
Advantages of this service compared to others. How is it adapted to a specific project? 
Feedback from end users

We will of course acknowledge DIRAC in the catalogue. Please also make sure to provide us the acknowledgement text with requisite details ( grant number etc.). Please let us know if you would be able to provide above information on open services by Tuesday 25 February 2018.

Should you have more questions please feel free to write us. Thank you for your consideration of this request and we look forward to hearing from you.

Best Regards.

Thomas

---

Dr. Thomas Vuillaume
LAPP, CNRS
Member of H.E.S.S. and CTA collaboration
Member of the ASTERICS-H2020 project
thomas.vuillaume@lapp.in2p3.fr

3 MetaQuery, Transformation and Production System

Developpement en cours :
* https://forge.in2p3.fr/projects/dirac-in2p3/wiki/Production_System#RFC-draft
* https://github.com/arrabito/DIRAC/tree/ProdSys_v6r19/ProductionSystem

Orateur: Mme Luisa Arrabito (LUPM)

4 Publications / Conférences

Publications
* COMDIRAC
* Transformation System
* Meta Query

Conferences
* CHEP 2018 Sofia

Orateurs: Dr Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Johan Bregeon (IN2P3 LUPM), Pierre Gay (Université de Bordeaux)

5 Objectifs pour 2018

• points sur les divers projets initialement lancés
• mise à jour des objectifs 2018

Orateurs: Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France), Johan Bregeon (IN2P3 LUPM)