Workshop on Open-Source Software Lifecycles

23 juil. 2020, 09:00 → 28 juil. 2020, 12:25 Europe/Paris

https://fau.zoom.us/j/92142605646 (ZOOM)

Software development is an integral part of modern science, gaining knowledge from data. All ESCAPE partners develop and maintain some software (from extensive frameworks to individual analysis scripts) for their respective experiments - along the full life cycle of software development.

The objective of this workshop is to bring together the scientists' communities of Astrophysics, Astroparticle Physics and Particle Physics who are leading the software development within their domain. Common and best practices in software development will be discussed and shared, enabling cross-fertilization across the domains. Those practices will then be taken into account in the upcoming ESCAPE school, training young scientists to build and maintain the expertise in the field

Core topics are:

• Software Development Lifecycle Strategies
• Development: coding styles, versioning, maintenance, documentation, software quality standards
• Testing: test suites and code coverage
• efficiency optimization and benchmarking: standards and ideas
• platform integration and metadata
• software licenses

Zoom Video-Conference Link

You can always enter the room at https://fau.zoom.us/j/92142605646. For further connection options see Communications.

Discussion platform

Discussions and gathering of knowledge are managed in an Gitlab project, the WOSSL discussion project. Add your knowledge to the wiki, browse through topics or engage in discussions in the projects issues!

Recordings of the sessions can be found at the FAU Video Platform.

 

ESCAPE_GDPR_Events_20190425.pdf

jeu. 23 juillet

09:00 → 09:15 Introduction

09:00 Introduction

Introduction to the ESCAPE, OSSR and WOSSL

Orateurs: Jutta Schnabel (Friedrich-Alexander Universität Erlangen-Nürnberg), Dr Kay Graf (ECAP - University of Erlangen)

ESCAPE_WOSSL_Introduction_20200723.pdf

09:15 → 09:50 Software development strategies: Software development and maintenance in the EOSC

Core questions:
- What is the role of software in a FAIR open science world?
- What concepts of a software lifecycle management are employed, which guidelines should be followed?
- How to integrate larger communities in the software development framework and workflow?

09:15 Software Source Code in Research and Open Science

VideoID: 76155

Orateur: Roberto Di Cosmo

Video at SWH

Video @FAU video portal

09:50 → 11:05 Software development strategies: Lifecycle strategies of the ESFRIs

Core questions:
- What is the role of software in a FAIR open science world?
- What concepts of a software lifecycle management are employed, which guidelines should be followed?
- How to integrate larger communities in the software development framework and workflow?

09:50 Lifecycle Strategy in CTA Array Control System

VideoID: 76187

Orateur: Igor Oya

CTA_ACADA_SDLC_WOSSL_July_2020_v1.pdf

Video @FAU video portal

10:15 SKA Software Development: Scaling agile software development processes around the world

The Square Kilometre Array Organisation (SKAO) is in the process to start construction of what will be the largest research facility in the world, with two radio interferometers generating each one petabyte of data per day, which will be distributed by a network of SKA Regional Centres (SRCs). Construction is expected to start after the establishment of the SKA Observatory Inter-Governmental Organisation by mid 2021, and last for around 6 years after that. However, we are already prototyping the software development processes that will help us align the work of around 150 full-time equivalent people around the world. In this talk we will show what are the current agile software development processes at SKAO, how we are already leveraging the Scaled Agile Framework (SAFe®) to provide alignment across the world-wide community of developers and other contributors, and how we will be managing the full software lifecycle of it during construction and beyond.

VideoID: 76184

Orateur: Juande Santander-Vela (SKA Organisation)

Software Development Practices in ESFRIS—SKA Software Development.key

Software Development Practices in ESFRIS—SKA Software Development.pdf

Video @FAU video portal

10:40 Nothing Works: Lessons Learned from Leading and Maintaining the Open Source Project Gammapy

VideoID: 76190

Orateur: Axel Donath

gammapy-wossl-2020.key

gammapy-wossl-2020.pdf

Video @FAU video portal

11:05 → 11:20 Fluid Break

11:20 → 12:15 Software development strategies: Interoperability in Workflows

Core questions:
- What is the role of software in a FAIR open science world?
- What concepts of a software lifecycle management are employed, which guidelines should be followed?
- How to integrate larger communities in the software development framework and workflow?

11:20 Stimela and CARAcal

VideoID: 76193

Orateurs: Gyula I. G. Jozsa, Sphesihle Makhathini

jozsa_wossl_caracal_2007.pdf

Stimela_Makhathini.pdf

Video @FAU video portal

11:45 Presentation of Hangar

open-source data versioning tool

VideoID: 76196

Orateur: Richard Izzo (Tensorwerk)

presentation-23JUL2020.pdf

presentation-23JUL2020.pptx

Video @FAU video portal

ven. 24 juillet

08:00 → 08:30 Software development strategies: Software Architecture

Core questions:
- What is the role of software in a FAIR open science world?
- What concepts of a software lifecycle management are employed, which guidelines should be followed?
- How to integrate larger communities in the software development framework and workflow?

08:00 Deployment automation as a key stage in the development lifecycle

At Rubin Observatory we are several years into software development of services in preparation for the Legacy Survey of Space & Time (LSST). In this talk I will describe how adopting a service deployment model has enabled us to use integration testing as a core part of our development lifecycle. Key technologies referenced will be Kubernetes, ArgoCD, Vault, and Helm.

VideoID: 76234

Orateur: Frossie Economou (Rubin Observatory)

Video @FAU video portal

08:30 → 10:45 Software development: Best practices

Core questions:
What concepts of a software lifecycle management are employed, which guidelines should be followed?
- development
- testing and deployment
- maintenance

08:30 The DLR Software Engineering Guidelines - An approach to support sustainable software development in research

VideoID: 76237

Orateur: Carina Haupt (German Aerospace Center (DLR))

20200724_SEGuidelines.pdf

20200724_SEGuidelines.pptx

Video @FAU video portal

09:00 Best Practices in Code Development

VideoID: 76240

Orateur: Tamas Gal (ECAP / FAU)

best_practices.html

best_practices.org

best_practices.pdf

Video @FAU video portal

09:25 HSF and CERN Software and Code Optimisation

VideoID: 76243

Orateur: Lukas Heinrich (CERN)

ESCAPE.pdf

Video @FAU video portal

09:50 Benchmarking CPU resources with HEPIX

VideoID: 76246

Orateur: Andrea Valassi (CERN)

20200724-WOSSL-BMK-AV.pdf

Video @FAU video portal

10:15 Software Engineering at SDE Group, GSI

VideoID: 76249

Orateur: Dr Christian Tacke (GSI)

slides.pdf

Video @FAU video portal

10:45 → 11:00 Fluid Break

11:00 → 12:25 Software in the OSSR: Linking Catalogues and Repositories

Core Questions:
What are the user and provider requirements for a FAIR software repository?
user requirements?
provider requirements?
interaction requirements?
EOSC requirements?

11:00 OpenAIRE

VideoID: 76252

Orateur: Paolo Manghi

Software's Scholarly Communication Life-cycle - The OpenAIRE's View

Video @FAU video portal

11:30 OSSR: ESCAPE Repository and Catalogue

VideoID: 76255

Orateur: Dr Thomas Vuillaume (LAPP, CNRS)

20200724_ESCAPE_repo.pdf

Video @FAU video portal

12:00 Software metadata beyond citations

VideoID: 76258

Orateur: Mark Kettenis (JIVE)

Video @FAU video portal

WOSSL-kettenis.pdf

lun. 27 juillet

09:00 → 09:50 Software in the OSSR: Status

Core Questions:
What are the user and provider requirements for a FAIR software repository?
user requirements?
provider requirements?
interaction requirements?
EOSC requirements?

09:00 OSSR Implementation Concept and Status

VideoID: 76464

Orateur: Enrique GARCIA GARCIA

20200727_WOSSL_OSSR_implementation_Garcia.pdf

Video @FAU video portal

09:25 Containerisation for scientific reproducibility

VideoID: 76467

Orateur: Stefano Alberto Russo (IANF)

Video @FAU video portal

WOSSL Workshop 2020 - Containerization for scientific reproducibility.pdf

09:50 → 11:00 Software Pitches: Pitches and Discussion

What is the role of software in a FAIR open science world?

Video @FAU video portal

09:50 Web application prototypes for CTA

Orateur: Mathieu Servillat (LUTH, Observatoire de Paris)

2020-10-21 web app CTA @WP3-WOSSL.pdf

09:55 Web-based data visualization for the Radio Neutrino Observatory in Greenland

Orateur: Christoph Welling

WOSSL_welling.pdf

10:00 OrcaNet: A training organizer for Deep Learning

A training organizer for Deep Learning

Orateur: Stefan Reck (ECAP - University of Erlangen)

orcanet.pdf

10:05 agnpy: numerical modelling of AGN spectra in python

Built on numpy and astropy, agnpy computes the spectral energy distribution (SED) produced by the synchrotron and inverse Compton radiation of relativistic electrons accelerated in the jets of Active Galactic Nuclei. The radiation field of several AGN components (e.g. Accretion Disk, Broad Line Region, Dust Torus) can be selected as target for the inverse Compton and the gamma-gamma pair-production opacity of the latter can be estimated. agnpy hopes to provide an important missing piece in the growing community of python-based astronomical software.

Orateur: Cosimo Nigro (IFAE)

wossl_agnpy_pitch.pdf

10:10 The joint-crab project: Towards open and reproducible multi-instrument analysis in gamma-ray astronomy

The joint-crab project represents the first multi-instrument, fully-reproducible analysis in gamma-ray astronomy.
A common data format proposed for high-level gamma-ray instruments data is implemented for a small set of Fermi-LAT, MAGIC, VERITAS, FACT, and H.E.S.S observations.
The data were analysed with the open-source software gammapy to produce a joint maximum likelihood fit of the Crab nebula spectrum.
All the results presented in this work are obtained using open-access on-line assets that allow for a long-term reproducibility of the results (Docker, zenodo).

Orateur: Cosimo Nigro (IFAE)

wossl_joint_crab_pitch.pdf

10:15 gLike: likelihood maximization and profiling for astrophysical (and beyond) applications

Based on ROOT, gLike is a framework for the numerical maximization of likelihood functions.
The likelihood has one free parameter (named g) and as many nuisance parameters as wanted, which will be profiled in the maximization process. Multi-instrument likelihood can be created and jointly profiled by compounding together several likelihood terms. gLike has been and is being used for Dark Matter searches in gamma-ray astronomy and will ultimately enter the ESCAPE software collection.

Orateur: Cosimo Nigro (IFAE)

wossl_glike_pitch.pdf

10:20 AstroAnt: astronomical analyses of ANTARES neutrino telecsope data in python

In astronomy it is a common task for a telescope/detector team to provide a software pipeline for

• reducing data to a certain region on the sky,
• applying the most recent calibration knowledge,
• and estimating signal probabilities and signal background.

Using this pipeline enables the astrophysicist to quickly start analyzing and interpreting the data in a scientific context. In particular she or he does not need to have an in-depth knowledge of the telescope and signal detection process.

Neutrino astroparticle physics and astronomy are new and fast emerging fields. Currently, the work around prototype and neutrino telescopes being built concentrates on understanding, improving, and developing technologies. Thus, only limited software pipelines for astrophysical purposes as described above exist.

I will present highlights of the software pipeline AstroAnt developed for the ANTARES neutrino telescope. This pipeline can serve as a prototype for the next-generation KM3NeT neutrino telescope currently being built, in order to kick off astronomical analyses in the next years.

Orateur: Matthias Bissinger (ECAP - University of Erlangen)

bissinger_astroant_wossl2020.pdf

10:25 Software from the ESCAPE Test Science Project: Dark Matter

VideoID: 76470

Orateur: Caterina Doglioni (University of Geneva)

20200727_Doglioni_ESCAPE-WOSSL-DM-TSP.pdf

Video @FAU video portal

10:30 Discussion

11:00 → 11:10 Fluid Break

11:10 → 12:05 Software development: Best Practices II

Core questions:
What concepts of a software lifecycle management are employed, which guidelines should be followed?
- development
- testing and deployment
- maintenance

11:10 Software development experiences from the CASA project

VideoID: 76479

Orateur: Mark Kettenis (JIVE)

Video @FAU video portal

WOSSL-CASA.pdf

11:35 Zenodo - Software Archiving and Metadata Handling

VideoID: 76476

Orateur: Jose Benito Gonzalez Lopez (CERN)

2020-07-WOSSL-ESCAPE-JB.pdf

Video @FAU video portal

13:15 → 14:45 Software in the OSSR: Demonstration

Core Questions:
What are the user and provider requirements for a FAIR software repository?
user requirements?
provider requirements?
interaction requirements?
EOSC requirements?

13:15 Demonstration of Building and Running a Container

VideoID: 76482

Orateur: Stefano Alberto Russo (IANF)

Video @FAU video portal

13:30 OSSR Onboarding

Orateur: Enrique GARCIA GARCIA

20200727_WOSSL_OSSR_onboarding_summary.pdf

Video @FAU video portal

14:30 Discussion

mar. 28 juillet

09:00 → 12:10 Copyright and Licensing: Approaches in large collaborations

Core questions:
How should software copyrights and licenses managed, which concepts are employed, how to pick one for the own project?
How to integrate larger communities in the software development framework and workflow?

09:00 Legal aspects of publishing and contributing to open-source projects

VideoID: 76586

Orateur: Carina Haupt (German Aerospace Center (DLR))

20200727_OS.pdf

20200727_OS.pptx

Video @FAU video portal

09:45 Licensing Question in KM3NeT

VideoID: 76580

Orateur: Jutta Schnabel (Friedrich-Alexander Universität Erlangen-Nürnberg)

Licenses_KM3NeT_WOSSL2020_short.pdf

Video @FAU video portal

WOSSL2020-software-licensing-Groep.pdf

10:10 Licensing in CTA

VideoID: 76574

Orateur: Igor Oya

SW_Licensing_WOSSL_Oya_v2.pdf

Video @FAU video portal

10:35 Fluid Break

10:50 Licensing and copyright in SKA software

In this talk I'll take a look at the software licensing and related policies adopted by the SKA project. I'll try to cover the reasons of the main choices and their consequences on the project.
I'm not a lawyer, so I'll try and give an engineering perspective on the topic.

VideoID: 76577

Orateur: Marco Bartolini (SKA Organisation)

Copyright, Licensing and Provenance_ Approaches in large collaborations—SKA Software licensing.pdf

Video @FAU video portal

11:15 Copyright and Licensing in ASTRON

Orateur: Yan Grange (ASTRON, the Netherlands Institute for Radio Astronomy)

Grange_ASTRON_OSC_final.pdf

Grange_ASTRON_OSC_final.pptx

Video @FAU video portal

11:40 Discussion

12:10 → 12:25 Introduction: Summary and End Note

12:10 Summary and End Note

VideoID: 76583

Orateurs: Jutta Schnabel (Friedrich-Alexander Universität Erlangen-Nürnberg), Dr Kay Graf (ECAP - University of Erlangen)

ESCAPE_WOSSL_Summary_20200728.pdf