SearcharxivSearch

arXiv · 2411.09364

CaLES: A GPU-accelerated solver for large-eddy simulation of wall-bounded flows

Abstract

We introduce CaLES, a GPU-accelerated finite-difference solver designed for large-eddy simulations (LES) of incompressible wall-bounded flows in massively parallel environments. Built upon the existing direct numerical simulation (DNS) solver CaNS, CaLES relies on low-storage, third-order Runge-Kutta schemes for temporal discretization, with the option to treat viscous terms via an implicit Crank-Nicolson scheme in one or three directions. A fast direct solver, based on eigenfunction expansions, is used to solve the discretized Poisson/Helmholtz equations. For turbulence modeling, the classical Smagorinsky model with van Driest near-wall damping and the dynamic Smagorinsky model are implemented, along with a logarithmic law wall model. GPU acceleration is achieved through OpenACC directives, following CaNS-2.3.0. Performance assessments were conducted on the Leonardo cluster at CINECA, Italy. Each node is equipped with one Intel Xeon Platinum 8358 CPU (2.60 GHz, 32 cores) and four NVIDIA A100 GPUs (64 GB HBM2e), interconnected via NVLink 3.0 (200 GB/s). The inter-node communication bandwidth is 25 GB/s, supported by a DragonFly+ network architecture with NVIDIA Mellanox InfiniBand HDR. Results indicate that the computational speed on a single GPU is equivalent to approximately 15 CPU nodes, depending on the treatment of viscous terms and the subgrid-scale model, and that the solver efficiently scales across multiple GPUs. The predictive capability of CaLES has been tested using multiple flow cases, including decaying isotropic turbulence, turbulent channel flow, and turbulent duct flow. The high computational efficiency of the solver enables grid convergence studies on extremely fine grids, pinpointing non-monotonic grid convergence for wall-modeled LES.

Explore related subjects

Keep this discovery

BibTeXRIS

Maochao Xiao, Alessandro Ceci, Pedro Costa, Johan Larsson, Sergio Pirozzoli. 2024-11-14. CaLES: A GPU-accelerated solver for large-eddy simulation of wall-bounded flows. https://arxiv.org/abs/2411.09364

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Correlative effects of induced magnetic field-buoyancy on reactive solute dispersion dynamics in couple-stress fluids

We investigate the dispersion of a reactive solute in a couple-stress fluid flowing between two parallel plates under the combined effects of pressure-driven flow, buoyancy, and an induced magnetic field. The model incorporates first-order heterogeneous reactions at both channel walls alongside a bulk reaction. Using Mei's multiscale homogenization technique accurate to third order, we develop a higher-order asymptotic formulation to determine the effective longitudinal dispersion coefficient and concentration field. Analytical predictions are complemented by Brownian dynamics simulations and finite-difference solutions, while the Aris method of moments quantifies transient mean displacement, spatial variance, and effective dispersivity. The hydrodynamic analysis reveals a singular branch in the velocity solution when the Hartmann number equals half the couple-stress parameter and identifies a characteristic quarter-power scaling between the Hartmann number and couple-stress parameter, separating couple-stress- and magnetically dominated regimes. The model recovers classical Taylor-dispersion behavior in the non-reactive Newtonian limit and agrees well with experimental measurements. Couple-stress rheology and magnetic damping suppress shear-induced dispersion, whereas buoyancy enhances dispersion through additional transverse velocity gradients. A distinct saturation regime of the dispersion coefficient emerges with an increasing couple-stress parameter, while unequal wall absorption induces persistent transverse asymmetry, and stronger absorption enhances solute removal near the source. Numerical and stochastic results validate the analytical framework while resolving higher-order concentration structures and particle-scale wall adsorption.

physics.flu-dyn

DiffSWE2d: a differentiable Shallow Water Equations solver for end-to-end flood and tsunami modelling

Solving inverse and optimisation problems with traditional shallow water equations (SWE) solvers can be computationally expensive, particularly when gradients with respect to model inputs or parameters must be estimated through repeated forward simulations. In this paper, we introduce DiffSWE2d, an open-source differentiable shallow water equations solver for end-to-end flood and tsunami modelling implemented in PyTorch. By leveraging automatic differentiation, DiffSWE2d represents the time-marching physics as a differentiable computational graph, enabling gradients to be propagated directly through the numerical solver. We validate the solver against two established benchmark cases and demonstrate its application to tsunami waveform inversion, showing its ability to infer model inputs through gradient-based optimisation. DiffSWE2d provides a flexible framework for integrating physics-based hydrodynamic modelling with modern optimisation and machine learning methods. The source code and reproducible examples are publicly available at: https://github.com/ZhonghouXu/DiffSWE2d

physics.flu-dyn

Low inertia limit of elasto-inertial turbulence

Pipe and channel flows of viscoelastic fluids display chaotic dynamics at unusually low speeds, a phenomenon referred to as elasto-inertial turbulence, EIT. First reported in experiments a century ago, recent theoretical studies and model computations predict a variety of scenarios for the phenomenon's origin, ranging from hoop stress modes to center modes and to Tollmien-Schlichting waves. Lacking experimental confirmation, the relevant scenario in actual flows of polymer solutions remains unknown. We here determine the transition threshold of EIT in pipe experiments, covering three decades in elasticity number. Across this entire parameter range, the transition features center mode structures at onset. Eventually the instability diverges at a lower inertia (upper elasticity) limit, which is a robust signature of this center mode scenario. Finally, we report the first experimental observation of a traveling wave in viscoelastic pipe flow, and the sequences of localized structures found, are in excellent agreement with a center mode traveling wave, the "arrowhead" solution, discovered in model simulations.

physics.flu-dyn