RELEASED: HPE Cray Programming Environment 25.03 General Availability Release for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.3 SLES15 SP6 – March 2025

PRODUCT DESCRIPTION

The HPE Cray Programming Environment 25.03 release for HPE Cray Supercomputing EX and HPE Cray Supercomputing systems is now available for CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.3 SLES15 SP6 systems.

  • HPE Cray Operating System COS 24.7 (Base 3.1.0/USS 1.1.0) based on SLES15 SP5

  • HPE Cray Operating System COS 25.3 (Base 3.3.0/USS 1.3.0) based on SLES15 SP6

The following software is supported with this release:

  • Cluster System Manager (CSM) 1.6.1 - managed systems running SLES15 SP5 or SLES15 SP6 on the compute/login nodes.

  • COS components comprise:

    • COS Base

    • HPE Cray Supercomputing User Services Software (USS)

    • HPE SUSE Linux Enterprise Server

SOFTWARE OVERVIEW

This software announcement applies to HPE Cray Supercomputing EX and/or HPE Cray Supercomputing CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.3 SLES15 SP6 systems.

HPE Cray Programming Environment licensed customers may download the release materials by submitting a request to HPE PointNext for the package below (depending on entitlement):

  • HPE Cray Programming Environment 25.03 for CSM

CPE support for specific HPE Cray Supercomputing EX recipes may be found in the following documents which are maintained for each recipe on the HPE Support Center:

  • HPE Cray EX System Software Stack Installation and Upgrade Guide for CSM

  • HPE Cray Software Compatibility Matrixes Reference Guide

See “module help <product>” for the corresponding PE product release notes.

Content for CSM 1.6.1 COS 24.7 SLES15 SP5 and CSM 1.6.1 COS 25.3 SLES15 SP6 Systems:

  • cpe-25.03-sles15-sp5-csm-25.3.3.tar.gz

  • cpe-25.03-sles15-sp5-aarch64-csm-25.3.3.tar.gz

  • cpe-25.03-sles15-sp6-csm-25.3.3.tar.gz

  • cpe-25.03-sles15-sp6-aarch64-csm-25.3.3.tar.gz

NOTE: The single tarfile(s) above contain base PE as well as optional installation of other third-party compiler support.

  • REQUIRED: Base PE

  • OPTIONAL:

  • AMD AOCC 5.0

  • AMD ROCm 6.3

  • Intel OneAPI 2025.0.0

  • NVIDIA HPC SDK 24.11

  • GCC 13

Documentation

NOTE: As of CPE 24.11 and later, HPE discontinued providing CPE release announcement and user guide documentation on the HPE Support Center web page. CPE 24.11 (and later) release announcement and user guides, along with installation guides, are now available on the CPE Documentation site. CPE installation guides for all CPE versions can still be accessed from the HPE Support Center web page. CPE 24.07 and earlier documentation, including user guides, installation guides, release announcements, and related revision documentation, can also be found on the HPE Support Center web page.

CPE 25.03 Installation and User Guides

Document Title/Filename

Document Part Number

Included in .tar File?

CPE Documentation Site

HPE Support Center

HPE Cray Programming Environment Installation Guide: CSM on HPE Cray Supercomputing EX Systems (25.03)

S-8033

Y

Y

Y

HPE_CPE_Installation_Guide_CSM_on_HPE_Cray_Supercomputing_EX _Systems_25.03.pdf

HPE Supercomputing Cray Programming Environment Getting Started User Guide: HPE Cray Supercomputing EX Systems (25.03)

S-9934

N

Y

Y

HPE_CPE_Getting_Started_User_Guide_HPE_Cray_Supercomputing_EX_Systems_25.03_S-9934.pdf

HPE Cray Programming Environment User Guide: CSM (25.03)

N/A

N

Y

N

HPE Performance Analysis Tools User Guide (25.03)

N/A

N

Y

N

HPE Cray Cassini Performance Counters User Guide (25.03)

N/A

N

Y

N

HPE Cray Fortran Reference Manual (19.0.0)

N/A

N

Y

N

HPE Cray Clang C and C++ Quick Reference (19.0.0)

N/A

N

Y

N

HPE Cray Compiling Environment Overview (19.0.0)

N/A

N

Y

N

Other Documentation

  • CPE-25.03-CSM-Release-Announcement.md

\ HPE CPE Release Information Available on the CPE Documentation site for HPE Cray Supercomputing EX Systems

The information posted includes the release notes for each HPE CPE release starting with 24.03 along with other CPE related information. The release notes files will also continue to be posted as part of the release packages.

IMPORTANT NOTES

  • NOTE: NVIDIA HPC SDK releases include three versions of CUDA. For each new SDK version supported by HPE, Cray PE supports only the latest CUDA version included in the respective NVIDIA HPC SDK release (i.e., the older two CUDA versions are not supported by CPE when a new SDK is supported).

  • NOTE: Perftools 25.03.0 and PAPI 7.1.0.4 included with CPE 25.03 are not compatible with ROCm earlier than 6.0.0, they require the use of ROCm 6.0.0 or later.

  • NOTE: Starting with CPE 24.03, on systems with aarch64 CPUs and NVIDIA GPUs, if MPICH_GPU_SUPPORT_ENABLED=1 is set, HPE Cray MPI automatically chooses to disable the use of XPMEM for intra-node, inter-process MPI data movement operations that involve memory regions that are managed by system allocators (e.g., mmap, malloc, and new). This is done to guard against potential interactions between XPMEM and the GPU runtime layer that may cause node failures to occur. Instead of using XPMEM, HPE Cray MPI uses Linux Cross Memory Attach (CMA) to optimize these MPI operations. It is important to note that GPU Peer2Peer IPC will continue to be used for intra-node, inter-process data movement operations involving memory regions managed via GPU memory allocators (e.g., cudaMalloc, cudaFree).

  • NOTE: Beginning in CPE 24.11, the NVHPC modules (PrgEnv-nvhpc, nvhpc, nvhpc-mixed) are no longer offered. The NVIDIA modules (PrgEnv-nvidia, nvidia, nvidia-mixed) are now the sole option for modules regarding the NVIDIA programing environment. The move to the NVIDIA modules is to complete the alignment of CPE module flows. The module flow for all environments is as follows:

  • Load an environment meta module (ie. PrgEnv-nvidia)

  • Environment meta module loads a compiler (ie. nvidia)

  • User can choose to load a toolkit (cuda, cudatoolkit)

  • NOTE: 24.11/ 25.03 HPE HPC Software 2025 roadmap update for HPE Cray systems with NVIDIA CPUs and GPUs. The NVIDIA driver support for SLES15 SP6 was not available before code completion dates, as a result, the January 2025 HPE HPC continuous software stack releases are for HPE Cray EX systems without NVIDIA CPUs and GPUs. For HPE Cray EX Systems with NVIDIA CPUs and GPUs, please use the August 2024 (CPE 24.07) HPE HPC continuous software stack. These software stacks were validated with NVIDIA HPC SDK 24.3. The March 2025 HPE HPC continuous and extended software stack releases will be validated with NVIDIA HPC SDK 24.11 and will support all HPE CRAY EX systems.

  • NOTE: 512M hugepages are not supported on ARM64 nodes running cos-base-3.3. If a user runs ‘module load craype-hugepages512M’ on ARM64 nodes, any subsequent command will hang. The hung command can be killed. This does not occur on x86_64 nodes and it does not affect transparent huge pages.

  • NOTE: The GUI application Apprentice will be made available as an open source build in future releases and the binaries will be removed from the perftools rpms.

CPE 25.03 Product Versions:

NOTE: Use of **** indicates a new or updated component version compared to CPE 24.11.

HPE Cray Programming Environment for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with CSM

Cray Compiling Environment – CCE

    cce 19.0.0 ****

Cray Message Passing Toolkit - CMPT

    cray-mpich 8.1.32 ****

    cray-mpixlate 1.0.7 ****

    cray-dsmml 0.3.1 ****

    cray-pmi 6.1.15

    cray-openshmemx 11.7.4 ****

Cray Debugging Support Tools – CDST

    cray-cti 2.19.1 ****

    gdb4hpc 4.16.4 ****

    cray-ccdb 5.0.6 ****

    cray-stat 4.12.5 ****

    atp 3.15.6 ****

    valgrind4hpc 2.13.5 ****

    sanitizers4hpc 1.1.5 ****

    cray-dyninst 12.3.5 ****

    cray-mrnet 5.1.5 ****

    cray-zmqnet 1.3.1 ****

Cray Performance Measurement & Analysis Tools – CPMAT

    perftools 25.03.0 ****

    cray-papi 7.2.0.1 ****

Cray Scientific and Math Libraries - CSML

    cray-libsci 25.03.0 ****

    cray-libsci-acc 25.03.0 ****

    cray-fftw 3.3.10.10 ****

Cray Deep Learning Tools

    craype-dl-plugin-ftr 22.06.1.2

    craype-dl-plugin-py3 24.03.1

Cray Environment Setup and Compiling support – CENV

    craypkg-gen 1.3.35 ****

    craype 2.7.34 ****

    cpe-prgenv 8.6.0

    cray-lmod 8.7.55 ****

    cray-modules 3.2.11.7

Third party products

    cray-hdf5 1.14.3.5 ****

    cray-netcdf 4.9.0.17 ****

    cray-parallel-netcdf 1.12.3.17 ****

    cray-python 3.11.7

    cray-R 4.4.0

Third-party products supported

    Totalview 2024.4.0

    Forge 24.1.1

*******************************************************************************************