RELEASED: HPE Cray Programming Environment 24.11 General Availability Release for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.1 SLES15 SP6 – January 2025

PRODUCT DESCRIPTION

The HPE Cray Programming Environment 24.11 release for HPE Cray Supercomputing EX and HPE Cray Supercomputing systems is now available for CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.1 SLES15 SP6 systems.

HPE Cray Operating System COS 24.7 (Base 3.1.0/USS 1.1.0) based on SLES15 SP5
HPE Cray Operating System COS 25.1 (Base 3.2.0/USS 1.2.0) based on SLES15 SP6

The following software is supported with this release:

Cluster System Manager (CSM) 1.6.1 - managed systems running SLES15 SP5 or SLES15 SP6 on the compute/login nodes.
COS components comprise:
- COS Base
- HPE Cray Supercomputing User Services Software (USS)
- HPE SUSE Linux Enterprise Server

SOFTWARE OVERVIEW

This software announcement applies to HPE Cray Supercomputing EX and/or HPE Cray Supercomputing CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.1 SLES15 SP6 systems.

HPE Cray Programming Environment licensed customers may download the release materials by submitting a request to HPE PointNext for the package below (depending on entitlement):

HPE Cray Programming Environment 24.11 for CSM

CPE support for specific HPE Cray Supercomputing EX recipes may be found in the following documents which are maintained for each recipe on the HPE Support Center:

HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM
HPE Cray Software Compatibility Matrixes Reference Guide

See “module help <product>” for the corresponding PE product release notes.

Content for CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.1 SLES15 SP6 Systems:

cpe-24.11-sles15-sp5-csm-24.11.2.tar.gz
cpe-24.11-sles15-sp6-csm-24.11.4.tar.gz

NOTE: The single tarfile(s) above contain base PE as well as optional installation of other third-party compiler support.

REQUIRED: Base PE
OPTIONAL:

AMD AOCC 4.2.0

AMD ROCm 6.2.1

Intel OneAPI 2024.2.0

NVIDIA HPC SDK Unsupported

CUDA Unsupported

GCC 13

Documentation

NOTE: As of CPE 24.11 and later, HPE discontinued providing CPE release announcement and user guide documentation on the HPE Support Center web page. CPE 24.11 (and later) release announcement and user guides, along with installation guides, are now available on the CPE Documentation site. CPE installation guides for all CPE versions can still be accessed from the HPE Support Center web page. CPE 24.07 and earlier documentation, including user guides, installation guides, release announcements, and related revision documentation, can also be found on the HPE Support Center web page.

Installation Guide

HPE Cray Programming Environment Installation Guide: CSM on HPE Cray Supercomputing EX Systems (24.11)

HPE_CPE_Installation_Guide_CSM_on_HPE_Cray_Supercomputing_EX_Systems_24.11.pdf

User Guide

HPE Cray Programming Environment User Guide: CSM on HPE Cray Supercomputing EX Systems (24.11)

HPE_CPE_User_Guide_CSM_on_HPE_Cray_Supercomputing_EX_Systems_24.11.pdf

IMPORTANT NOTES

NOTE: NVIDIA HPC SDK releases include three versions of CUDA. For each new SDK version supported by HPE, Cray PE supports only the latest CUDA version included in the respective NVIDIA HPC SDK release (i.e., the older two CUDA versions are not supported by CPE when a new SDK is supported).

NOTE: Perftools 24.11.0 and PAPI 7.1.0.4 included with CPE 24.11 are not compatible with ROCm earlier than 6.0.0, they require the use of ROCm 6.0.0 or later.

NOTE: Starting with CPE 24.03, on systems with aarch64 CPUs and NVIDIA GPUs, if MPICH_GPU_SUPPORT_ENABLED=1 is set, HPE Cray MPI automatically chooses to disable the use of XPMEM for intra-node, inter-process MPI data movement operations that involve memory regions that are managed by system allocators (e.g., mmap, malloc, and new). This is done to guard against potential interactions between XPMEM and the GPU runtime layer that may cause node failures to occur. Instead of using XPMEM, HPE Cray MPI uses Linux Cross Memory Attach (CMA) to optimize these MPI operations. It is important to note that GPU Peer2Peer IPC will continue to be used for intra-node, inter-process data movement operations involving memory regions managed via GPU memory allocators (e.g., cudaMalloc, cudaFree).

NOTE: Beginning in CPE 24.11, the NVHPC modules (PrgEnv-nvhpc, nvhpc, nvhpc-mixed) are no longer offered. The NVIDIA modules (PrgEnv-nvidia, nvidia, nvidia-mixed) are now the sole option for modules regarding the NVIDIA programing environment. The move to the NVIDIA modules is to complete the alignment of CPE module flows. The module flow for all environments is as follows:

Load an environment meta module (ie. PrgEnv-nvidia)

Environment meta module loads a compiler (ie. nvidia)

User can choose to load a toolkit (cuda, cudatoolkit)

NOTE: 24.11/ 25.03 HPE HPC Software 2025 roadmap update for HPE Cray systems with NVIDIA CPUs and GPUs. The NVIDIA driver support for SLES15 SP6 was not available before code completion dates, as a result, the January 2025 HPE HPC continuous software stack releases are for HPE Cray EX systems without NVIDIA CPUs and GPUs. For HPE Cray EX Systems with NVIDIA CPUs and GPUs, please use the August 2024 (CPE 24.07) HPE HPC continuous software stack. These software stacks were validated with NVIDIA HPC SDK 24.3. The March 2025 HPE HPC continuous and extended software stack releases will be validated with NVIDIA HPC SDK 24.11 and will support all HPE CRAY EX systems.

CPE 24.11 Product Versions:

NOTE: Use of **** indicates a new or updated component version compared to CPE 24.07.

HPE Cray Programming Environment for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with CSM


Cray Compiling Environment – CCE
cce 18.0.1 ****

Cray Message Passing Toolkit - CMPT
cray-mpich 8.1.31 ****
cray-mpixlate 1.0.6 ****
cray-dsmml 0.3.0
cray-pmi 6.1.15
cray-openshmemx 11.7.3 ****

Application Launch Tools - ALT

Cray Debugging Support Tools – CDST
cray-cti 2.19.0 ****
gdb4hpc 4.16.3 ****
cray-ccdb 5.0.5 ****
cray-stat 4.12.4 ****
atp 3.15.5 ****
valgrind4hpc 2.13.4 ****
sanitizers4hpc 1.1.4 ****
cray-dyninst 12.3.4 ****
cray-mrnet 5.1.4 ****
cray-zmqnet 1.0.0 ****

Cray Performance Measurement & Analysis Tools – CPMAT
perftools 24.11.0 ****
cray-papi 7.1.0.4 ****

Cray Scientific and Math Libraries - CSML
cray-libsci 24.11.0 ****
cray-libsci-acc 24.11.0 ****
cray-fftw 3.3.10.9 ****

Cray Deep Learning Tools
craype-dl-plugin-ftr 22.06.1.2
craype-dl-plugin-py3 24.03.1

Cray Environment Setup and Compiling support – CENV
craypkg-gen 1.3.34 ****
craype 2.7.33 ****
cpe-prgenv 8.6.0 ****
cray-lmod 8.7.37
cray-modules 3.2.11.7

Third party products
cray-hdf5 1.14.3.3 ****
cray-netcdf 4.9.0.15 ****
cray-parallel-netcdf 1.12.3.15 ****
cray-python 3.11.7
cray-R 4.4.0

Third-party products supported
Totalview 2024.1.21
Forge 23.1.2

*******************************************************************************************