As the volumes of weather and climate data expand, it is of paramount importance for scientists to exploit techniques and solutions able to efficiently extract knowledge from these data. 

This online training course aims to increase scientists’ expertise on data analysis and visualisation applied to climate and weather domains, using high-performance data analytics (HPDA) and visualisation tools available from the open source market (i.e., Ophidia and ParaView). 

The training covers topics from simple analytics tasks to workflows and applications (e.g., Python-based) and provides best practices and guidelines on dealing with massive scientific datasets on HPC architectures. 

Examples of real applications of the tools for data analytics and visualisation (i.e., Ophidia and ParaView) in the climate and weather domain will be presented. The training will include demos and hands-on sessions concerning the different tools. 

This course is organised in the context of the “Centre of Excellence in Simulation of Weather and Climate in Europe” (ESiWACE) phase 2 project.

List of Topics:

• Introduction to big data, scientific data management and analytics at scale
• Open-source High Performance Data Analytics (HPDA) tools
• Data Analytics workflows for eScience
• Introduction to data visualisation using ParaView
• Discussion of visualisation workflows, from post to in-situ

Audience: The training targets the audience in the field of weather and climate research with different backgrounds, from computer to Earth system scientists. This course is open to students, young scientists and also more experienced researchers/engineers who wish to improve their data analytics and visualisation skills. Basic knowledge of Python, Linux, NetCDF data format and general aspects concerning climate/weather data is required to fully take advantage of the training.

Schedule: The training is organised as an 8-hour online course, divided into 4 sessions, with 2 hours of work per day required for the participants. The event is scheduled for September 6-9, 2022 according to the following calendar:

• Session 1: Introduction to Ophidia, 6th September 2022, 14.30-16.30
• Session 2: Ophidia advanced concepts, 7th September 2022, 14.30-16.30
• Session 3: Introduction to ParaView, 8th September 2022, 14.30-16.30
• Session 4: Advanced ParaView use, 9th September 2022, 14.30-16.30

Each session combines presentations about the various topics and practical tutorials/hands-on.

Participation: Registration is required for attending the online live training sessions. The training materials (e.g., slides, instructions, notebooks, scripts, etc.) will be made available.  Instructions and materials for the practical sessions will be made available beforehand to registered users.

You can register to the training from this page: https://indico.dkrz.de/event/43/
Note that the registration closes on the 2nd of September AoE.

Read our news item on the successfully completed 2021 edition of this training.