SMACK 15: Programming parallel workloads with PyCOMPSs in La Palma

Authors
Dr.
Rosa Badia
Dr.
Javier Conejero
Date and time
10 May 2022 - 10:30 Europe/London
Address

Online

Talk language
English
Slides language
English
Serie number
1
Description

 PyCOMPSs is a task-based programming in Python that enables simple sequential codes to be executed in parallel in distributed computing platforms. It is based on the addition of python decorators in the functions of the code to indicate those that can be executed in parallel between them. The runtime takes care of the different parallelization and resource management actions, as well as of the ditribution of the data in the different nodes of the computing infrastructure. It is installed in multiple supercomputers of the RES, like MareNostrum 4 and now LaPalma. The talk will present an overview of PyCOMPSs, two demos with simple examples and a hands-on in LaPalma on how we can parallelize EMCEE workloads.

Slides and Examples: https://gitlab.com/makhlaghi/smack-talks-iac

Format
Series
Talk Video
https://youtu.be/G5K4LmYcWtg

It may interest you

  • SMACK 21: Introduction to Slurm@IAC
    Slurm Workload Manager (formerly known as Simple Linux Utility for Resource Management (SLURM), or simply Slurm, is a free and open-source job scheduler for Linux and Unix-like kernels, used by many of the world's supercomputers and computer clusters. While Slurm has been used at the IAC in the LaPalma supercomputer and deimos/diva for a long time
    Ángel Manuel de
    Vicente Garrido

    Aula

    19 Sep 2023 - 12:30 Europe/London
    Past
    Talk Video
    https://youtu.be/zYGXENSS1LY
  • Series
    SMACK 19: "Introducing the new 133-Mpixel visualization wall of the IAC"
    In a time when we deal with extremely large images (be it from computer simulations or from extremely powerful telescopes), visualizing them can become a challenge. If we use a regular monitor, we have two options: 1) fit the image to our monitor resolution, which involves interpolation and thus losing information and the ability to see small image
    Ángel Manuel de
    Vicente Garrido

    Online + Pleiades

    21 Mar 2023 - 09:30 Europe/London
    Past
    Talk Video
    https://youtu.be/uA6Jjbmep4w
  • Series
    SMACK 18: Modules and Python Virtual Environments
    The first part of this talk will present an overview of the tool "module" and its main commands and flags. "module" provides the dynamic modification of the user’s environment for supporting multiple versions of an application or a library without any conflict. In the second part, we’ll first explain what Python virtual environments are, and
    José Carlos
    Ruiz Luque
    Nicola
    Caon

    Online

    5 Jul 2022 - 12:30 Europe/London
    Past
    Talk Video
    https://youtu.be/WCx58zIKlbY