RELEASED: HPE Cray Programming Environment 25.03 General Availability Release for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with HPCM 1.13 COS 24.7 SLES15 SP5 and HPCM 1.13 COS 25.3 SLES15 SP6 – March 2025

PRODUCT DESCRIPTION

The HPE Cray Programming Environment 25.03 release for HPE Cray Supercomputing EX and HPE Cray Supercomputing systems is now available for HPCM 1.13 COS 24.7 SLES15 SP5 and HPCM 1.13 COS 25.3 SLES15 SP6 systems.

  • HPE Cray Operating System COS 24.7 (Base 3.1.0/USS 1.1.0) based on SLES15 SP5

  • HPE Cray Operating System COS 25.3 (Base 3.3.0/USS 1.3.0) based on SLES15 SP6

The following software is supported with this release:

  • HPE Performance Cluster Manager (HPCM) 1.13 - managed systems running SLES15 SP5 or SLES15 SP6 on the compute/login nodes.

  • COS components comprise:

    • COS Base

    • HPE Cray Supercomputing User Services Software (USS)

    • HPE SUSE Linux Enterprise Server

SOFTWARE OVERVIEW

This software announcement applies to HPE Cray Supercomputing EX and/or HPE Cray Supercomputing HPCM 1.13 COS 24.7 SLES15 SP5 and HPCM 1.13 COS 25.3 SLES15 SP6 systems.

HPE Cray Programming Environment licensed customers may download the release materials by submitting a request to HPE PointNext for the respective package below (depending on entitlement):

  • HPE Cray Programming Environment DOCS for HPCM 25.03-DOCS

  • HPE Cray Programming Environment (CPE) 25.03 Software for HPCM

\ See “module help <product>” for the corresponding PE product release notes.

\ Content for HPCM 1.13 COS 24.7 SLES15 SP5 and HPCM 1.13 COS 25.3 SLES15 SP6 Systems:

  • cpe-25.3.3-sles15-sp5-x86_64.iso

  • cpe-25.3.3-sles15-sp5-aarch64.iso

  • cpe-25.3.3-sles15-sp6-x86_64.iso

  • cpe-25.3.3-sles15-sp6-aarch64.iso

NOTE: The single tarfile(s) above contain base PE as well as optional installation of other third-party compiler support.

  • REQUIRED: Base PE

  • OPTIONAL:

  • AMD AOCC 5.0

  • AMD ROCm 6.3

  • Intel OneAPI 2025.0.0

  • NVIDIA HPC SDK 24.11

  • GCC 14 & 13

Documentation

NOTE: As of CPE 24.11 and later, HPE discontinued providing CPE release announcement and user guide documentation on the HPE Support Center web page. CPE 24.11 (and later) release announcement and user guides, along with installation guides, are now available on the CPE Documentation site. CPE installation guides for all CPE versions can still be accessed from the HPE Support Center web page. CPE 24.07 and earlier documentation, including user guides, installation guides, release announcements, and related revision documentation, can also be found on the HPE Support Center web page.

CPE 25.03 Installation and User Guides

Document Title/Filename

Document Part Number

Included in .tar File?

CPE Documentation Site

HPE Support Center

HPE Cray Programming Environment Installation Guide: HPCM on HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems (25.03)

S-8003

Y

Y

Y

HPE_CPE_Installation_Guide_HPCM_on_HPE_Cray_Supercomputing_EX _Systems_25.03.pdf

HPE Supercomputing Cray Programming Environment Getting Started User Guide: HPE Cray Supercomputing EX Systems (25.03)

S-9934

N

Y

Y

HPE_CPE_Getting_Started_User_Guide_HPE_Cray_Supercomputing_EX_Systems_25.03_S-9934.pdf

HPE Cray Programming Environment User Guide: HPCM (25.03)

N/A

N

Y

N

HPE Performance Analysis Tools User Guide (25.03)

N/A

N

Y

N

HPE Cray Cassini Performance Counters User Guide (25.03)

N/A

N

Y

N

HPE Cray Fortran Reference Manual (19.0.0)

N/A

N

Y

N

HPE Cray Clang C and C++ Quick Reference (19.0.0)

N/A

N

Y

N

HPE Cray Compiling Environment Overview (19.0.0)

N/A

N

Y

N

Other Documentation

  • CPE-25.03-HPCM-Release-Announcement.md

\ HPE CPE Release Information Available on the CPE Documentation site for HPE Cray Supercomputing EX Systems

The information posted includes the release notes for each HPE CPE release starting with 24.03 along with other CPE related information. The release notes files will also continue to be posted as part of the release packages.

IMPORTANT NOTES

  • NOTE: NVIDIA HPC SDK releases include three versions of CUDA. For each new SDK version supported by HPE, Cray PE supports only the latest CUDA version included in the respective NVIDIA HPC SDK release (i.e., the older two CUDA versions are not supported by CPE when a new SDK is supported).

  • NOTE: Perftools 25.03.0 and PAPI 7.1.0.4 included with CPE 25.03 are not compatible with ROCm earlier than 6.0.0, they require the use of ROCm 6.0.0 or later.

  • NOTE: Starting with CPE 24.03, on systems with aarch64 CPUs and NVIDIA GPUs, if MPICH_GPU_SUPPORT_ENABLED=1 is set, HPE Cray MPI automatically chooses to disable the use of XPMEM for intra-node, inter-process MPI data movement operations that involve memory regions that are managed by system allocators (e.g., mmap, malloc, and new). This is done to guard against potential interactions between XPMEM and the GPU runtime layer that may cause node failures to occur. Instead of using XPMEM, HPE Cray MPI uses Linux Cross Memory Attach (CMA) to optimize these MPI operations. It is important to note that GPU Peer2Peer IPC will continue to be used for intra-node, inter-process data movement operations involving memory regions managed via GPU memory allocators (e.g., cudaMalloc, cudaFree).

  • NOTE: Beginning in CPE 24.11, the NVHPC modules (PrgEnv-nvhpc, nvhpc, nvhpc-mixed) are no longer offered. The NVIDIA modules (PrgEnv-nvidia, nvidia, nvidia-mixed) are now the sole option for modules regarding the NVIDIA programing environment. The move to the NVIDIA modules is to complete the alignment of CPE module flows. The module flow for all environments is as follows:

  • Load an environment meta module (ie. PrgEnv-nvidia)

  • Environment meta module loads a compiler (ie. nvidia)

  • User can choose to load a toolkit (cuda, cudatoolkit)

  • NOTE: 24.11/ 25.03 HPE HPC Software 2025 roadmap update for HPE Cray systems with NVIDIA CPUs and GPUs. The NVIDIA driver support for SLES15 SP6 was not available before code completion dates, as a result, the January 2025 HPE HPC continuous software stack releases are for HPE Cray EX systems without NVIDIA CPUs and GPUs. For HPE Cray EX Systems with NVIDIA CPUs and GPUs, please use the August 2024 (CPE 24.07) HPE HPC continuous software stack. These software stacks were validated with NVIDIA HPC SDK 24.3. The March 2025 HPE HPC continuous and extended software stack releases will be validated with NVIDIA HPC SDK 24.11 and will support all HPE CRAY EX systems.

  • NOTE: Starting in CPE 25.03, we are now releasing .ISO packages for HPCM.

  • NOTE: 512M hugepages are not supported on ARM64 nodes running cos-base-3.3. If a user runs ‘module load craype-hugepages512M’ on ARM64 nodes, any subsequent command will hang. The hung command can be killed. This does not occur on x86_64 nodes and it does not affect transparent huge pages.

  • NOTE: The GUI application Apprentice will be made available as an open source build in future releases and the binaries will be removed from the perftools rpms.

CPE 25.03 Product Versions:

NOTE: Use of **** indicates a new or updated component version compared to CPE 24.11.

HPE Cray Programming Environment for HPE Cray Supercomputing EX and HPE Cray Supercomputing Systems with HPCM

Cray Compiling Environment – CCE

    cce 19.0.0 ****

Cray Message Passing Toolkit - CMPT

    cray-mpich 8.1.32 ****

    cray-mpixlate 1.0.7 ****

    cray-dsmml 0.3.1 ****

    cray-pmi 6.1.15

    cray-openshmemx 11.7.4 ****

Cray Debugging Support Tools – CDST

    cray-cti 2.19.1 ****

    gdb4hpc 4.16.4 ****

    cray-ccdb 5.0.6 ****

    cray-stat 4.12.5 ****

    atp 3.15.6 ****

    valgrind4hpc 2.13.5 ****

    sanitizers4hpc 1.1.5 ****

    cray-dyninst 12.3.5 ****

    cray-mrnet 5.1.5 ****

    cray-zmqnet 1.3.1 ****

Cray Performance Measurement & Analysis Tools – CPMAT

    perftools 25.03.0 ****

    cray-papi 7.2.0.1 ****

Cray Scientific and Math Libraries - CSML

    cray-libsci 25.03.0 ****

    cray-libsci-acc 25.03.0 ****

    cray-fftw 3.3.10.10 ****

Cray Deep Learning Tools

    craype-dl-plugin-ftr 22.06.1.2

    craype-dl-plugin-py3 24.03.1

Cray Environment Setup and Compiling support – CENV

    craypkg-gen 1.3.35 ****

    craype 2.7.34 ****

    cpe-prgenv 8.6.0

    cray-lmod 8.7.55 ****

    cray-modules 3.2.11.7

Third party products

    cray-hdf5 1.14.3.5 ****

    cray-netcdf 4.9.0.17 ****

    cray-parallel-netcdf 1.12.3.17 ****

    cray-python 3.11.7

    cray-R 4.4.0

Third-party products supported

    Totalview 2024.4.0

    Forge 24.1.1

*******************************************************************************************