Distributed Computing in Astrophysics

Europe/Paris
Salle de la Convivialité (Centre François Arago (FACe))

Salle de la Convivialité

Centre François Arago (FACe)

13 rue Watt 75013 Paris
Cécile Cavet (APC), Karsten Kretschmer (APC), Volodymyr Savchenko (APC)
Description

While the performance of the computing hardware is rapidly evolving the evolution is no more primarily due to development of a single processor but is rather achieved by increase of the number of coordinated processing units. Distributed hardware requires special design of the software, supporting dedicated parallel algorithms, reliable and resilient, capable of handling simultaneous access to large and diverse data. Distributed systems have different degrees of integration: cores at each CPU or GPU, nodes at a computing cluster, or world-wide heterogeneous systems like grids or clouds. Different systems set different requirements for the software.

In this 2-day workshop we will learn about the status and future plans of distributed computing in the context of astrophysical projects. In addition, we will have hands-on session to experience how distributed computing using the Hadoop system works, and how astrophysical analysis on a virtual system already today is successfully put into place in the HERA analysis service.

The workshop is organised by Volodymyr Savchenko, Karsten Kretschmer, Cécile Cavet and Volker Beckmann of the François Arago Centre at the APC laboratory.

We acknowledge the financial support of DIM-ACAV and of the LabEx UnivEarthS for this workshop.

Participants
  • Antoine Basset
  • Antoine Petiteau
  • Cécile Cavet
  • Daniel Maier
  • Eric Aubourg
  • Fan YE
  • I-Chun SHIH
  • jean-marc Colley
  • Karsten Kretschmer
  • Langshi Chen
  • Lorenzo Faccioli
  • Olivier Herent
  • Pierre-François Honoré
  • Quentin Le Boulc'h
  • Sibylle TECHENE
  • Soobash Daiboo
  • Stéphane Schanne
  • Suyan Dong
  • sylvain mottet
  • Volker Beckmann
  • Volodymyr Savchenko
    • 09:30 09:40
      Welcome 10m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Volodymyr Savchenko (APC)
    • 09:40 10:00
      Review on distributed computing 20m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Cécile Cavet (APC)
      Transparents
    • 10:00 10:55
      Data processing challenges in Gaia 55m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Pasquale Panuzzo (GEPI, Observatoire de Paris)
      Transparents
    • 10:55 11:15
      Coffee break 20m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
    • 11:15 12:00
      INTEGRAL 45m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateurs: Dr Karsten Kretschmer (APC), Dr Volodymyr Savchenko (APC)
      Slides
    • 12:00 12:45
      Euclid and LSST 45m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: M. Eric Aubourg (APC)
      Transparents
    • 12:45 13:45
      Lunch 1h Pizzeria Paris-Milan

      Pizzeria Paris-Milan

      11 Rue Elsa Morante75013 Paris

      provided by the workshop

    • 13:45 16:45
      Hadoop Hands-on 3h Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Presentation and hands-on afternoon.

      Participants need to configure laptop and create accounts on the StratusLab cloud infrastructure and on the SlipStream Web interface:
      - StratusLab cloud:
        &nbsp- register: https://cloud.lal.stratuslab.eu/register/register/
        &nbsp- create SSH key: $ ssh-keygen
      - SlipStream Web interface:
        &nbsp- register: https://slipstream.stratuslab.eu
      The SlipStream interface will be configured during the tutorial.
      Send the SlipStream username to use the Hadoop deployment.
      Orateur: Dr Cécile Cavet (APC)
      Transparents
    • 16:45 17:15
      Coffee break 30m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
    • 17:15 18:15
      HERA demonstration 1h Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Volodymyr Savchenko (APC)
      Slides
  • vendredi 11 décembre
    • 09:30 10:20
      From LOFAR to SKA, challenges in distributed computing 50m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Soobash Daiboo (Observatoire de Paris)
      Transparents
    • 10:20 10:50
      CTA 30m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Volker Beckmann (APC, Univ. Paris 7)
      Slides
    • 10:50 11:20
      Coffee break 30m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
    • 11:20 12:10
      Computing in low frequency gravitational wave astronomy: eLISA, LISA Pathfinder and the Pulsar Timing Array 50m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: M. Antoine Petiteau (APC - Université Paris-Diderot)
      Transparents
    • 12:10 12:55
      Lessons learned from Planck-HFI Data Processing Center software infrastructure 45m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris
      Orateur: Dr Jean-Marc Delouis (IAP)
      Transparents
    • 12:55 13:40
      Final Discussion and Workshop wrap-up 45m Salle de la Convivialité

      Salle de la Convivialité

      Centre François Arago (FACe)

      13 rue Watt 75013 Paris