Skip to main navigation Skip to search Skip to main content

Efficiently simulating Lagrangian particles in large-scale ocean flows — Data structures and their impact on geophysical applications

  • Christian Kehl
  • , Peter D. Nooteboom
  • , Mikael L.A. Kaandorp
  • , Erik van Sebille*
  • *Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Studying oceanography by using Lagrangian simulations has been adopted for a range of scenarios, such as the determining the fate of microplastics in the ocean, simulating the origin locations of microplankton used for palaeoceanographic reconstructions, and for studying the impact of fish aggregation devices on the migration behaviour of tuna. These simulations are complex and represent a considerable runtime effort to obtain trajectory results, which is the prime motivation for enhancing the performance of Lagrangian particle simulators. This paper assesses established performance enhancing techniques from Eulerian simulators in light of computational conditions and demands of Lagrangian simulators. A performance enhancement strategy specifically targeting physics-based Lagrangian particle simulations is outlined to address the performance gaps, and techniques for closing the performance gap are presented and implemented. Realistic experiments are derived from three specific oceanographic application scenarios, and the suggested performance-enhancing techniques are benchmarked in detail, so to allow for a good attribution of speed-up measurements to individual techniques. The impacts and insights of the performance enhancement strategy are further discussed for Lagrangian simulations in other geoscience applications. The experiments show that I/O-enhancing techniques, such as dynamic loading and buffering, lead to considerable speed-up on-par with an idealised parallelisation of the process over 20 nodes. Conversely, while the cache-efficient structure-of-arrays collection yields a visible speed-up, other alternative data structures fail in fulfilling the theoretically-expected performance increase. This insight demonstrates the importance of good data alignment in memory and caches for Lagrangian physics simulations.

Original languageEnglish
Article number105322
Number of pages13
JournalComputers and Geosciences
Volume175
DOIs
Publication statusPublished - Jun 2023

Bibliographical note

Funding Information:
All authors thank the OceanParcels group of Utrecht University's IMAU for their valuable feedback and the provided, interesting application scenarios. The research is supported by the “Tracking Of Plastic In Our Seas” (TOPIOS) project (grant agreement no. 715386), and partly by the IMMERSE project (grant agreement no. 821926), both funded by ERC's Horizon 2020 Research and Innovation program. Furthermore, the NWO Groot-funded nanoplastics project, Netherlands (ref. no. OCENW.GROOT.2019.043) supported the outlined development. Simulations were carried out on the Dutch National e-Infrastructure with the support of SURF Cooperative (project no. 16371 and 2019.034). We thank Phillipe Delandmeter, a former group member, for his considerable early contributions to the HPC developments in parcels. We further thank Delphine M.A. Lobelle, Stefanie L. Ypma and Reint P.B. Fischer for their microbiological- and physics curation of the biofouling study and the Galapagos cleanup project. Code availability section, Package name: parcels, Contact: [email protected], Hardware requirements: laptop or workstation for small, synthetic examples; high-throughput workstation or cluster for realistic scenarios; scales to HPC facilities with MPI support via SGE, SLURM or PBS, Program language: Python, Software required: python package dependencies are lists in github's environment file; requires mpi4py for MPI distribution; requires portalocker for the hardware buffer branch. Program size: 7.7 megabytes, The source codes are available for downloading at the link: https://github.com/oceanparcels/parcels, Installation guide, tutorials, training material and literature overview available at https://oceanparcels.org. The package is available at conda-forge under https://anaconda.org/conda-forge/parcels.

Funding Information:
All authors thank the OceanParcels group of Utrecht University’s IMAU for their valuable feedback and the provided, interesting application scenarios. The research is supported by the “Tracking Of Plastic In Our Seas” (TOPIOS) project (grant agreement no. 715386 ), and partly by the IMMERSE project (grant agreement no. 821926 ), both funded by ERC’s Horizon 2020 Research and Innovation program . Furthermore, the NWO Groot-funded nanoplastics project, Netherlands (ref. no. OCENW.GROOT.2019.043 ) supported the outlined development. Simulations were carried out on the Dutch National e-Infrastructure with the support of SURF Cooperative (project no. 16371 and 2019.034 ). We thank Phillipe Delandmeter, a former group member, for his considerable early contributions to the HPC developments in parcels. We further thank Delphine M.A. Lobelle, Stefanie L. Ypma and Reint P.B. Fischer for their microbiological- and physics curation of the biofouling study and the Galapagos cleanup project.

Publisher Copyright:
© 2023

Funding

All authors thank the OceanParcels group of Utrecht University's IMAU for their valuable feedback and the provided, interesting application scenarios. The research is supported by the “Tracking Of Plastic In Our Seas” (TOPIOS) project (grant agreement no. 715386), and partly by the IMMERSE project (grant agreement no. 821926), both funded by ERC's Horizon 2020 Research and Innovation program. Furthermore, the NWO Groot-funded nanoplastics project, Netherlands (ref. no. OCENW.GROOT.2019.043) supported the outlined development. Simulations were carried out on the Dutch National e-Infrastructure with the support of SURF Cooperative (project no. 16371 and 2019.034). We thank Phillipe Delandmeter, a former group member, for his considerable early contributions to the HPC developments in parcels. We further thank Delphine M.A. Lobelle, Stefanie L. Ypma and Reint P.B. Fischer for their microbiological- and physics curation of the biofouling study and the Galapagos cleanup project. Code availability section, Package name: parcels, Contact: [email protected], Hardware requirements: laptop or workstation for small, synthetic examples; high-throughput workstation or cluster for realistic scenarios; scales to HPC facilities with MPI support via SGE, SLURM or PBS, Program language: Python, Software required: python package dependencies are lists in github's environment file; requires mpi4py for MPI distribution; requires portalocker for the hardware buffer branch. Program size: 7.7 megabytes, The source codes are available for downloading at the link: https://github.com/oceanparcels/parcels, Installation guide, tutorials, training material and literature overview available at https://oceanparcels.org. The package is available at conda-forge under https://anaconda.org/conda-forge/parcels. All authors thank the OceanParcels group of Utrecht University’s IMAU for their valuable feedback and the provided, interesting application scenarios. The research is supported by the “Tracking Of Plastic In Our Seas” (TOPIOS) project (grant agreement no. 715386 ), and partly by the IMMERSE project (grant agreement no. 821926 ), both funded by ERC’s Horizon 2020 Research and Innovation program . Furthermore, the NWO Groot-funded nanoplastics project, Netherlands (ref. no. OCENW.GROOT.2019.043 ) supported the outlined development. Simulations were carried out on the Dutch National e-Infrastructure with the support of SURF Cooperative (project no. 16371 and 2019.034 ). We thank Phillipe Delandmeter, a former group member, for his considerable early contributions to the HPC developments in parcels. We further thank Delphine M.A. Lobelle, Stefanie L. Ypma and Reint P.B. Fischer for their microbiological- and physics curation of the biofouling study and the Galapagos cleanup project.

FundersFunder number
"Tracking Of Plastic In Our Seas" (TOPIOS) project - ERC's Horizon 2020 Research and Innovation program715386
IMMERSE project - ERC's Horizon 2020 Research and Innovation program821926
NWO Groot-funded nanoplastics project, NetherlandsOCENW.GROOT.2019.043
SURF Cooperative16371, 2019.034

    Keywords

    • Lagrangian simulations
    • Particle systems
    • Performance enhancement
    • Physical oceanography

    Fingerprint

    Dive into the research topics of 'Efficiently simulating Lagrangian particles in large-scale ocean flows — Data structures and their impact on geophysical applications'. Together they form a unique fingerprint.

    Cite this