Release Notes for CPE 26.03 on SLES 15 sp7
Abnormal Termination Processing (ATP) 3.15.7
atp 3.15.7
================================================================================
Product Description
---------------------------
- Abnormal Termination Processing (ATP) is a system that
monitors user applications, and should an application
take a system trap, ATP preforms analysis on the dying
application. All of the stack backtraces of the
application processes are gathered into a merged
stack backtrace tree and written to disk as the file
"atpMergedBT.dot". The stack backtrace for the first process
to die is sent to stderr as is the number of the signal that
caused the death. If the core file size limit (RLIMIT_CORE)
is non-zero, a heuristically selected set of processes dump
their core.
atpMergedBT.dot can be viewed with 'statview', a component
of the STAT package (module load cray-stat). The merged stack
backtrace tree provides a concise, yet comprehensive, view
of what the application was doing at the time of its death.
Changelog
---------------------------
=======================================================================
## [unreleased]
=======================================================================
### Features
* Remove dependence on cdst-support package
=======================================================================
## [3.15.5]
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
### Features
* CPE-7888: Use roccoremerge to merge CPU and GPU corefiles
=======================================================================
## [3.15.6]
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
* PE-54139: Fix Fortran user API with AOCC Fortran compiler
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-4541: Allow coredump using ROCgdb
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.20, < 3 installed
Documentation
---------------------------
- Type `man atp` with the atp module loaded to read the atp(1) man page.
Installation Instructions
---------------------------
- rpm -ivh atp-3.15.7-20250827190612_2a9e01f471f3-190.sles15sp7.x86_64.rpm
To make atp 3.15.7 the default version of atp, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_atp_3.15.7
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/atp/3.15.7/ATTRIBUTIONS_atp.txt
CDEUX driver (craype) 2.7.36
CDEUX driver (craype) 2.7.36 - 3
==============
Purpose:
--------
The Cray Development Environment User eXperience driver (CDEUX) (craype)
provides a common set of drivers for all CPE programming environments,
notably the C/C++ (cc/CC) and Fortran (ftn) languages.
Key Changes and Bugs Closed:
----------------------------
- Updated ROCm support for 7.0
- Added support for ROCm flang (llvm) compiler alongside (PGI/classic)
- Updated CCE support
Product and OS Dependencies:
----------------------------
The CDEUX driver (craype) 2.7.36 release is supported on the following
HPE systems:
* HPE Cray EX systems
* HPE Apollo XD systems as part of the Cray Programming Environment
Documentation:
---------------
See manpages for cc, CC, ftn, and intro_craype-api.
See the pkg-config manpage or
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Product description:
--------------------
CrayPE contains drivers, cc, CC, and ftn to compile for all CPE
Programming Environments.
Certain components, files or programs contained within this package or product
are Copyright 2013-2025 Hewlett Packard Enterprise Development LP.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2025 Hewlett Packard
Enterprise Development LP.
CM PE Integration
CM-PE-INTEGRATION CHANGELOG
===========================
26.03 (2026-03-06)
* Address security risk related to /cm_cpe mount exposing secrets
* Remove shell profile scripts that initialize the module environment
* Add dependency on the cpe-profile package
25.09 (2025-06-30)
* Add /etc/cray-pe.d/pe_overlay.conf for configuring CPE image overlay
* Allow setting the default CPE image using /etc/cray-pe.d/pe_overlay.conf
* Allow disabling CPE image mounts from overwriting existing images using
/etc/cray-pe.d/pe_overlay.conf
* Allow setting additional overlay paths using /etc/cray-pe.d/pe_overlay.conf
* Allow /etc/cray-pe.d/cpe_images to override the expected CPE image name
* Allow the OS version in the CPE image to use . - or sp to separate
the major and minor version numbers
* Fix issue where legacy images were mounted in the wrong order
* Fix PELOCAL_PRGENV for zsh
* Fix LMOD_SYSTEM_DEFAULT_MODULES trailing whitespace in zsh
25.03 (2025-02-05)
* Update deploy script to support locally built HPCM images
* numactl will detect and filter out nodes that have memory_failures
24.07 (2023-06-05)
* Remove rpm queries from 77-deploy-pe.sh for improved performance
* Remove find commands from 77-deploy-pe.sh for improved performance
* Replace the systemd file with a new pe.service that depends on pe.mount
* CAST-35461 fix setting MODULEPATH in csh.cshrc.local
* Replace find commands with for loops to allow using symlink paths in gen_modulefiles.sh
24.03 (2023-02-16)
* Fix regex in gen_modulefiles for Intel OneAPI
* Add a umask 022 to ensure CPE access is not limited
* Add nfs-utils as an rpm dependencies
23.12 (2023-11-27)
* Determine the craype-target architecture during shell initialization
* Add support for compute nodes running on aarch64 hardware
* Update gen_modulefiles.sh to better support new compiler versions
* Add better logging information to `77-deploy-pe`
23.05 (2023-05-10)
* Allow sites to override the lmod install path by setting `lmod_prefix_path`
in `cray-pe-configuration.sh` and `cray-pe-configuration.csh`. Sites can
now use newer versions of lmod provided by the OS distribution.
* Update `76-add-pe-to-fstab` so that `/pe` is not added to `/etc/fstab` more
then once.
23.03 (2023-03-03)
* Spread the squashfs image mounts across NUMA domains to balance memory
usage across NUMA nodes.
* Add RPM dependency on `numactl`
23.02 (2023-01-30)
* Update shell profile scripts to initialize lmod using HPE provided package.
* Remove leading and trailing `:` in `LMOD_SYSTEM_DEFAULT_MODULES` that is no
longer an acceptable format in new versions of lmod.
22.12 (2022-12-12)
* Add a `site_module_list` to `cray-pe-configuration.sh` and
`cray-pe-configuration.csh` to allow sites to add modules loaded at login
without the need to modify HPE defaults `init_module_list`.
22.11 (2022-11-10)
* Update `gen_modulefiles.sh` to recreating symlinks to ensure idempotence.
22.10 (2022-10-03)
* Changes for HPCM 1.8 to ensure that `/pe` is mounted in `76-add-pe-to-fstab`
before running `77-deploy-pe`
22.09 (2022-08-23)
* Update `pe_overlay.sh` to only remove workdirs when unmounts are successful.
* Update `gen_modulefiles.sh` to run `one_off_set_defaults` after generating
all modulefiles.
22.08 (2022-07-22)
* Enable older PE images to deploy on system with newer minor base OS version.
* Update `gen_modulefiles.sh` to use the latest available version of
`craypkg-gen`.
22.05 (2022-04-26)
* Remove `/opt/modulefiles` from `MODULEPATH`.
22.04 (2022-03-28)
* Add a temporary workaround in `pe_overlay.sh` that copies lmod GPU
modulefiles into the PE overlay's upper layer so they are visible after
`/opt/cray/pe` is mounted.
Cray Common Tool Interface (CTI) 2.21.0
cray-cti 2.21.0
================================================================================
Product Description
---------------------------
- Cray Common Tools Interface (CTI) is a library that abstracts debugger tool support
to a common interface regardless of the underlying work load manager. It facilitates
the staging of files and the launch of tool daemons on the compute nodes associated
with a parallel job. Options and interfaces can be found in the cti(1) and cti(3)
manpages.
Notes
---------------------------
- CPE-13288: Contains a workaround for an issue where PALS tool daemon launches will fail if
/tmp is mounted noexec. In this case, set CTI_BACKEND_TMPDIR to a backend directory on
an executable filesystem.
Changelog
---------------------------
=======================================================================
## [unreleased]
=======================================================================
### Bug Fixes
* CPE-13691: Work around PMIx hostname bug
* CPE-14234: Don't exit on task prolog failure
=======================================================================
## [2.21.0-rc2]
=======================================================================
### Bug Fixes
* CPE-14013: Add fallback for missing PMIx hostname operation
* CPE-12977: Terminate `flux job attach` with SIGKILL
=======================================================================
## [2.21.0]
=======================================================================
### Bug Fixes
* CPE-13288: Add CTI_BACKEND_TMPDIR for backend directory setting
* CPE-11579: Fix pals_fini dlsym
* CPE-9580: Update libflux API for 0.75
### Features
* CPE-8701: Add waiting attach functions for Slurm, PALS, Flux
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP6 - SP7
- HPE HPCM systems with SLES 15 SP6 - SP7 or RHEL 8.10, RHEL 9.5 - 9.6
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-dyninst 12.3.6 or later installed
Documentation
---------------------------
- See manpages cti.1 and cti.3 for user and developer documentation respectively
Installation Instructions
---------------------------
- rpm -ivh cray-cti-2.21.0-20260115210236_218ffbbc9d22-281.sles15sp7.x86_64.rpm
To make cray-cti 2.21.0 the default version of cray-cti, execute:
/opt/cray/admin-pe/set_default_files/set_default_cray-cti-2.21.0
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2026 Hewlett Packard Enterprise Development LP. SPDX-License-Identifier: Linux-OpenIB
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/cti/2.21.0/ATTRIBUTIONS_cti.txt
Cray Dyninst 12.3.6
cray-dyninst 12.3.6
================================================================================
Product Description
---------------------------
- cray-dyninst provides tools for binary instrumentation, analysis, and modification.
Changelog
---------------------------
=======================================================================
## [12.3.6]
=======================================================================
### Features
* Remove dependence on cray-cdst-support package
=======================================================================
## [12.3.5]
=======================================================================
### Features
* Add build for rhel 9.5; remove build for rhel 8.9 and sles15sp4
=======================================================================
## [12.3.4]
=======================================================================
### Features
* Support rhel 8.10
* Build on sles15sp6 and rhel9.4
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Documentation
---------------------------
- https://github.com/dyninst/dyninst
Installation Instructions
---------------------------
- rpm -ivh cray-dyninst-12.3.6-20251125190106_2e98b0e19aff-103.sles15sp7.x86_64.rpm
To make this the default version of cray-dyninst, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-dyninst_12.3.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/dyninst/12.3.6/ATTRIBUTIONS_dyninst.txt
Cray LibSci 26.03.0
Cray LibSci 26.03.0
=====================
Purpose:
--------
Cray LibSci 26.03.0 provides scientific libraries for Cray
HPC systems. Cray LibSci is supported on the host CPU but
not on the accelerator of these systems.
The Cray LibSci 26.03.0 release provides updated support for
the following:
* SLES 15 SP7 (x86_64 and aarch64)
* RHEL 8.10 (x86_64)
* RHEL 9.6 (x86_64 and aarch64)
* AMD ROCm 7.0
* Intel oneAPI 2025.2.1
* AMD AOCC 5.0
* Nvidia HPC SDK 25.9
* GCC 14
Cray LibSci 26.03.0 includes the following versions of publicly
available libraries:
* LAPACK 3.12.1 - For further information, see
http://www.netlib.org/lapack
* ScaLAPACK 2.2.0 - (Scalable LAPACK) For further information, see
http://www.netlib.org/scalapack.
* QDWH 2.0.0 KSVD 1.0.0 - Polar decomposition and SVD packages, see
https://github.com/ecrc/qdwh
https://github.com/ecrc/ksvd
Key Changes and Bugs Closed:
----------------------------
Changes in Cray LibSci 25.09.0
* Update to LAPACK 3.12.1
Changes in Cray LibSci 25.03.0
* Support for Intel Emerald Rapids
* CAST-36293 - Issue calling CGEMM with multiple threads
Changes in Cray LibSci 24.11.0
* Support for AMD MI300A and Turin
* Miscellaneous bug fixes
Changes in Cray LibSci 24.07.0
* Miscellaneous bug fixes
* Enabled module to set LD_LIBRARY_PATH when PE_LD_LIBRARY_PATH=system
* Removed Iterative Refinement Toolkit (IRT) support
Changes in Cray LibSci 24.03.0
* CAST-34956 - Lua module environment variable issue
Changed in Cray LibSci 23.12.5
* CAST-33777 - LibSci mutex contention issue
* Removed support for Intel KNL
Product and OS Dependencies:
----------------------------
The Cray LibSci 26.03.0 release requires the following:
* SLES 15 SP6/SP7 or RHEL 8.10/9.5/9.6
* SLES 15 SP6 (x86_64 or aarch64)
* SLES 15 SP7 (x86_64 or aarch64)
* RHEL 8.10 (x86_64)
* RHEL 9.5 (x86_64 or aarch64)
* RHEL 9.6 (x86_64 or aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 20.x or later
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3 to 14.2 (RHEL 8.10)
* gcc-toolset-12.2 to 14.2 (RHEL 9.5)
* gcc-toolset-12.2 to 14.2 (RHEL 9.6)
* AOCC 4.1.0 or later
* AMD ROCm 6.0.0 or later
* Intel 2025.0.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
Notes and Limitations:
----------------------
OMP threaded versions:
The CrayPE 2.1.2 and later releases add support for link line generation
for the multi-threaded versions of the libsci library based on the OpenMP
flags the user specifies for each compiler:
* CCE by default links to the OpenMP LibSci library. CrayPE will link in
the serial version of LibSci when the CCE flag -hnoomp is used.
* GNU by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the GNU flag -fopenmp is used.
* INTEL by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the INTEL flag -qopenmp is used.
Stack size limit:
The 'ulimit -s unlimited' system stack size setting is required for
cray-libsci on all supported Cray platforms. This is typically set as a
system default by admin but may otherwise need to be set at runtime.
Non-default dynamic linking:
When using a non-default version of cray-libsci with dynamic linking
users should set at runtime and at linktime after loading the desired
cray-libsci module--or set the equivalent for their linux shell:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci man page for additional information.
Modulefile:
-----------
module load cray-libsci
Installation instructions:
--------------------------
LibSci is now packaged into separate compiler specific RPMs to allow
rpmbuild to correctly include compiler dependencies.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2025
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
/opt/cray/libsci/26.03.0/ATTRIBUTIONS
Cray LibSci for Accelerators 26.03.0
Cray LibSci_ACC 26.03.0
=======================
Purpose:
--------
The Cray LibSci_ACC 26.03.0 release provides accelerated versions of
scientific libraries for HPE Cray systems with accelerators.
Product and OS Dependencies:
----------------------------
Cray LibSci_ACC 26.03.0 requires the following platform:
HPE Cray EX system with AMD MI250X & MI300A
HPE Cray EX system with Nvidia A100 & H100
Cray LibSci_ACC 26.03.0 supports the following OS:
RHEL 8.10 x86_64
RHEL 9.5 x86_64 & aarch64
RHEL 9.6 x86_64 & aarch64
SLES 15SP6 x86_64 & aarch64
SLES 15SP7 x86_64 & aarch64
Notes and Limitations:
----------------------
LAPACK workspace calculations from other implementations or hard-coded
values may not be compatible with cray-libsci_acc. Workspaces reported from
a query to the corresponding cray-libsci_acc function should be used.
The current supported usecase is a one-rank to one-gpu mapping for apps.
Performance improvements can be achieved in programs calling cray-libsci_acc
subroutines by using pinned memory. See the intro_libsci_acc man page for
details.
Use of the aprun option "-cc none" or the srun option "--cpu_bind=none"
to disable core affinity is strongly suggested to maintain performance.
When using non-default cray-libsci_acc versions users should set equivalent
at runtime and linktime after loading the desired cray-libsci_acc module:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci_acc man page for additional information.
Modulefile:
-----------
module load cray-libsci_acc
Sample Installation instructions:
---------------------------------
RPM install command:
rpm -ivh cray-libsci-acc-26.03.0-*.##ARCH##.rpm
The "*" in the install command represents compiler version combinations.
To make this the default version:
##PREFIX##/admin-pe/set_default_files/set_default_libsci_acc_26.03.0
License:
--------
Except for the third party modules and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright -2025 Hewlett
Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in
this package are detailed in the file:
##PREFIX##/libsci_acc/26.03.0/ATTRIBUTIONS_libsci_acc_26.03.0.txt
Cray Lmod 8.7.60
Cray Lmod 8.7.60
================================================================================
Documentation:
--------------------------------------------------------------------------------
See CPE's Installation and User Guides for documentation.
Also see Lmod's official website: https://lmod.readthedocs.io
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 8.7.60 release is dependent on the following
software:
bc
sed
lua >= 5.3
lua-luaposix
lua-luafilesystem
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh cray-lmod-8.7.60-1.sles15sp7.x86_64.rpm
To make this the default version, update the symbolic "lmod" link
to the desired Lmod version directory.
Cray Lmod Scripts 3.2.1.0
Lmod Scripts 3.2.1.0
================================================================================
Release Date:
--------------------------------------------------------------------------------
December, 2023
Purpose:
--------------------------------------------------------------------------------
Updates package license.
Bugs fixed in this release:
--------------------------------------------------------------------------------
Documentation:
--------------------------------------------------------------------------------
See system Installation and User Guides for documentation
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 3.2.1.0 release is dependent on the following
software:
set_default_3
Lua
Lmod
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh lmod_scripts-3.2.1.0-202506282057.5db31ff7c9241-0.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_lmod_scripts_3.2.1.0
Product description:
--------------------------------------------------------------------------------
Contains Lua scripts which support the Cray implementation of Lmod
Copyright 2020-2023 Hewlett Packard Enterprise Development LP
Cray MRNet 5.1.6
cray-mrnet 5.1.6
================================================================================
Product Description
---------------------------
- MRNet is a customizable, high-performance software infrastructure for
building scalable tools and applications. It supports efficient
multicast and data aggregation functionality using a tree of processes
between the tool's front-end and back-ends. MRNet-based tools may use
these internal processes to distribute many important tool activities,
for example to reduce data analysis time and keep tool front-end loads
manageable.
MRNet-based tool components communicate across logical channels called
streams. At MRNet internal processes, filters are bound to these streams to
synchronize and aggregate dataflows. Using filters, MRNet can efficiently
compute averages, sums, and other more complex aggregations and analyses
on tool data. MRNet also supports facilities that allow tool developers
dynamically load new tool-specific filters into the system.
Changelog
---------------------------
=======================================================================
## [unreleased]
=======================================================================
### Features
* Remove dependence on cdst-support
=======================================================================
## [5.1.6]
=======================================================================
### Features
* Remove dependence on cdst-support package
=======================================================================
## [5.1.5]
=======================================================================
### Features
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti >= 2.20, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-mrnet-5.1.6-20250605181848_b81ea2c8d0f9-75.sles15sp7.x86_64.rpm
To make cray-mrnet 5.1.6 the default version of cray-mrnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-mrnet_5.1.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/mrnet/5.1.6/ATTRIBUTIONS_mrnet.txt
Cray PAPI 7.3.0.1
cray-papi
=================
Release date:
-------------
March 2026
Package:
--------
cray-papi-7.3.0.1-202512031557.62b01740648e3-1 x86_64
Purpose:
--------
New version of papi 7.3.0.1 release 1
Documentation:
--------------
Overview: https://github.com/icl-utk-edu/papi
Web Site: https://icl.utk.edu/papi
Product description:
--------------------
PAPI aims to provide the tool designer and application engineer with a
consistent interface and methodology for use of the performance counter
hardware found in most major microprocessors. PAPI enables software
engineers to see, in near real time, the relation between software
performance and processor events.
Dependencies:
-------------
For a list of software used when validating this version of
PAPI on Cray and HPE systems, see the HPE Cray Programming
Environment release announcements.
Copyright 2015-2017,2019-2025 Hewlett Packard Enterprise Development LP
Cray PE Targets 1.18.0
CrayPE Targets 1.18.0
================================================================================
Dependencies:
--------------------------------------------------------------------------------
The CrayPE Targets 1.18.0 release is dependent on the following
software products:
CrayPE
set_default_3
lmod_scripts
Documentation:
--------------------------------------------------------------------------------
See manpages for cc, CC, ftn, intro_craype-api, intro_hugepages and pkg-config
See section 2.6 Using Targeting Modules of the Cray Programming Environment
User's Guide (S-2529-116)
See http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh craype-targets-1.18.0-202512031838.7f55829d2c040-1.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.18.0-tcl
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.18.0-lua
Product description:
--------------------------------------------------------------------------------
CrayPE Targets contains the modules for CrayPE targets.
TCL Modules - craype-accel-host craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-accel-nvidia-b100 craype-accel-nvidia-b200 craype-accel-amd-gfx908 craype-accel-amd-gfx90a craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-intel-max craype-arm-grace craype-hugepages1G craype-hugepages2M craype-hugepages32M craype-hugepages512M craype-network-none craype-network-ofi craype-network-ucx craype-x86-emr craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-skylake craype-x86-cascadelake craype-x86-genoa craype-x86-icelake craype-x86-trento craype-x86-spr craype-x86-spr-hbm craype-x86-turin
Lmod Modules - craype-accel-host craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-accel-nvidia-b100 craype-accel-nvidia-b200 craype-accel-amd-gfx908 craype-accel-amd-gfx90a craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-intel-max craype-arm-grace craype-hugepages1G craype-hugepages2M craype-hugepages32M craype-hugepages512M craype-network-none craype-network-ofi craype-network-ucx craype-x86-emr craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-skylake craype-x86-cascadelake craype-x86-genoa craype-x86-icelake craype-x86-trento craype-x86-spr craype-x86-spr-hbm craype-x86-turin
Copyright 2013-2023 Hewlett Packard Enterprise Development LP
Cray PMI 6.1.17
Cray PMI 6.1.17
==============================================================================
Release Date:
--------------
January 15, 2026
Purpose:
--------
The HPE Cray Process Manager Interface library provides the interface
between the application launcher and other communication libraries
such as MPI and OpenSHMEM.
HPE Cray PMI 6.1.17 is optimized for the HPE EX product line.
Key Changes and Bugs Closed:
----------------------------
Bug fixes new to Cray PMI 6.1.17 include:
- CPE-12068 - Add support for pals_get_nodelist()
- CPE-12127 - Remove rankpool code from PMI
- CPE-12572 - Update Munge to using post-quantum algorithms
- CPE-13207 - Enable choosing Munge algorithms
Product and OS Dependencies:
----------------------------
The Cray PMI 6.1.17 release is supported on the following systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product Dependencies:
----------------------------------------+
cray-pals | >= 1.0.6 |
-----------------------+----------------+
slurm | >= 20.02 |
-----------------------+----------------+
Notes and Limitations:
----------------------
Spawning MPMD applications when using the Flux application launcher
is not officially supported. The Flux maintainers have developed a
mprun.py script that may make it work in some situations. Sites are
expected to install the script themselves and ensure its location is
in PATH. It can be retrieved from Flux GitHub issue 2414 at
https://github.com/flux-framework/flux-core/issues/2414 .
Documentation:
--------------
For more information see the intro_pmi man page.
Modulefile:
-----------
module load cray-pmi/6.1.17
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2020-2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/pmi/6.1.17/ATTRIBUTIONS
Cray Python 3.12.12
cray-python 3.12.12
====================
Purpose
-------
Cray Python is an implementation of the Python programming language for the Cray
Programming Environment. The numpy and scipy modules are configured to call Cray
Libsci routines. The mpi4py module is configured to call Cray MPICH routines.
Cray Python is designed to run Python codes on the compute nodes of an HPE
supercomputer. HPE does not make changes to the Python source or any of its
libraries nor does it plan to make changes in future releases.
The cray-python 3.12.12 release contains
- python-3.12.12
- numpy-2.3.5
- scipy-1.16.3
- mpi4py-4.1.1
- dask-2025.11.0
Product and OS Dependencies
---------------------------
The cray-python 3.12.12 release is supported on
- Cray EX systems running SLES 15, RHEL 8, or RHEL 9
Documentation
-------------
https://www.python.org/doc
Changelog
---------
https://docs.python.org/release/3.12.12/whatsnew/changelog.html
Modulefile
----------
module load cray-python/3.12.12
Installation
------------
rpm -ihv cray-python-3.12.12-20251212014649.8b04a48-1.sles15sp7.x86_64.rpm
To make this the default version, execute
[PREFIX]/admin-pe/set_default_files/set_default_python_3.12.12
Certain components, files, or programs contained within this package are
© Copyright 2021-2025 Hewlett Packard Enterprise Development LP
Cray R 4.4.0
cray-R 4.4.0
============
Release Date
------------
March 2024
Purpose
-------
The cray-R 4.4.0 release.
cray-R is configured to call cray-libsci routines.
Product and OS Dependencies
---------------------------
The cray-R 4.4.0 release is supported on
- Cray EX systems running SLES 15 or RHEL 8
Documentation
-------------
https://cran.r-project.org/manuals.html
Modulefile
----------
module load cray-R/4.4.0
Installation
------------
rpm -ihv cray-R-4.4.0-20251211201210.d168890-1.sles15sp7.x86_64.rpm
To make this the default version, execute:
[PREFIX]/admin-pe/set_default_files/set_default_R_4.4.0
Certain components, files or programs contained within this package or product are
Copyright 2018-2024 Hewlett Packard Enterprise Development LP
Cray Stat 4.12.8
cray-stat 4.12.8
================================================================================
Product Description
---------------------------
- The Stack Trace Analysis Tool (STAT) is a highly scalable, lightweight
tool that gathers and merges stack traces from all of the processes of
a parallel application to form call graph prefix trees.
- SUSTAINING RELEASE NOTICE: Following the CPE 25.09 release, Cray STAT
will no longer be receiving feature updates. Cray STAT will still be
released as part of CPE, but may be removed in a future release.
Notes
---------------------------
- To enable gathering stack traces on an Nvidia GPU, the environment variable
STAT_GDB must be set to either cuda-gdb, which will require cuda-gdb to be
available in PATH. Or it can be set a specific debugger. We suggest the
version of cuda-gdb packaged with gdb4hpc, as in:
export STAT_GDB=/opt/cray/pe/gdb4hpc/$GDB4HPC_VERSION/libexec/cuda110-gdb-guard
After which stat-cl would be called using the options: -w -G -i
Changelog
---------------------------
=======================================================================
## [unreleased]
=======================================================================
### Bug Fixes
* CPE-13691: Merge to release branch
* Gdb-oneapi pause/resume fixes from Abdul Ijez
=======================================================================
## [4.12.8]
=======================================================================
### Features
* Cherry-pick upstream change from Fri Oct 10 by Abdul Ijaz
=======================================================================
## [4.12.6]
=======================================================================
### Features
* Remove dependence on cdst-support
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti 2.21, < 3 installed
Documentation
---------------------------
- https://computing.llnl.gov/code/STAT/
Installation Instructions
---------------------------
- rpm -ivh --oldpackage cray-stat-4.12.8-20260115183830_7d8c32f83d08-121.sles15sp7.x86_64.rpm
To make cray-stat 4.12.8 the default version of cray-stat, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-stat_4.12.8
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2026 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/stat/4.12.8/ATTRIBUTIONS_stat.txt
Cray zmqnet 1.3.2
cray-zmqnet 1.3.2
================================================================================
Product Description
---------------------------
- zmqnet is a library for creating a network tree between applications
and HPC jobs using zmq.
Changelog
---------------------------
=======================================================================
## [1.3.2]
=======================================================================
### Bug Fixes
* CPE-8343: Zero-initialize state struct before passing to `initstate_r`
### Features
* Remove dependence on cdst-support package
=======================================================================
## [1.3.1]
=======================================================================
### Bug Fixes
* CPE-8040: Use random_r instead of crashing rand in ZMQ
=======================================================================
## [1.0.0]
=======================================================================
### Bug Fixes
* CPE-7182: Remove TimeoutAfterLast from variant, create non-variant interface
* Missing apollo install yamls PE-55041
* PE-54822: Throw exception when fail to detect hostname
* PE-53720: Include capnp tools in support directory
* PE-53603: Show diagnostic when libsodium cannot be loaded
* PE-51694: Make pings thread safe
* PE-51165: Assign rank and PID in packed mode
* PE-49776: Check TMPDIR before using it
* PE-49611: Detect spurious timeouts and fix backend timeout setting
* PE-48636: Remove message traversal limit
* Fix install path exported by lmod modulefile on relocated install
* PE-45208: Don't remove auth keyfile until setup completed
* Fix rarely dropped messages during startup
* Ensure nodes in newly created communicators are fully connected before returning new communicator to user
### Features
* Build with g++ 14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6082: Configurable backend timeout for flushing messages before exit
* PE-5880: Add Timeout After Last synchronization option
* Build rpms for rhel 8.10
* Build on sles sp6 and rhel 9.4
* PE-53605: Build and package libsodium dependency
* PE-51960: Added support for rhel89/93 & gcc13
* PE-44112: Add optional heartbeat monitor thread to AsyncFrontend
* PE-50464: Implement configurable port base
* Move to gcc-toolset-12 on redhat
* PE-48567: ZMQNet documentation
* Introduce forceDisconnect function to AsyncFrontend
* PE-41205: Add option to disable encryption at build and run time
=======================================================================
## [1.0.0] - 2022-9-26 (22.10)
=======================================================================
* Initial release
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti 2.20, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-zmqnet-1.3.2-20250605043925_9fca93f25f27-120.sles15sp7.x86_64.rpm
To make cray-zmqnet 1.3.2 the default version of cray-zmqnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-zmqnet_1.3.2
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2020-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/zmqnet/1.3.2/PLACEHOLDER_ATTRIBUTIONS_zmqnet.txt
Craypkg-gen 1.3.37
Craypkg-gen 1.3.37
==============
Release date
------------
December 2025
Purpose
-------
New compiler support
Bugs fixed in this release
--------------------------
- Fix Intel vars.sh behavior
- Intel module generation cleanup
- AMD ROCm 7 support
Dependencies
------------
The craypkg-gen 1.3.37 release is supported on the following HPE
Cray systems:
- Cray EX systems SLE 15.0 or later and RHEL 8.0 or later.
Driver support for integrating Third Party C, C++, and Fortran libraries
through .pc files using pkg-config is used in CrayPE 2.x and later.
Limitation
----------
- Library dependencies for static libraries are not added to the .pc files
for keywords Requires.private and Libs.private. A warning is issued by
the craypkg-gen tool to advise users to add this information to the
libraries .pc files.
Documentation
-------------
Man pages for craypkg-gen are found by executing `module load craypkg-gen`
and then `man craypkg-gen`. See
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Example:
- The following is an example, using the Intel OneAPI 2025.2 compiler.
After installing the compiler the administrator creates a modulefile for
this release by executing the following commands:
# module load craypkg-gen
# craypkg-gen -m /opt/intel/oneapi/compiler/2025.2
This version of the Intel compiler is made default by executing the
command:
# /opt/admin-pe/set_default_craypkg/set_default_intel_2025.2
Installation instructions
-------------------------
rpm -ivh craypkg-gen-1.3.37-37.0.g1ff506f-0.sles15sp7.noarch.rpm
To change the product version to default after installation:
/opt/cray/pe/admin-pe/set_default_files/set_default_craypkg-gen_1.3.37
Product description
-------------------
The craypkg-gen 1.3.37 utility provides the system administrator
a tool to integrate third party software with the Cray software stack.
Craypkg-gen assists with integration by creating .pc files for C, C++, and
Fortran libraries, pkg-config enabled modulefiles and RPMs.
The workflow for using craypkg-gen is
1) Build the open source software
2) Create .pc files for libraries
3) Create pkg-config enabled modulefiles
4) Customize pkg-config and modulefiles if needed
Certain components, files or programs contained within this package or product
are Copyright 2013-2025 Hewlett Packard Enterprise Development LP.
FFTW 3.3.10.11
FFTW 3.3.10.11
============
Purpose:
--------
This Cray FFTW 3.3.10.11 release is supported on HPE/Cray EX and
HPE/Cray XD/Apollo systems with x86-64 CPUs. Cray FFTW is supported
on the host CPU but not on the accelerator of HPE/Cray systems.
The Cray FFTW 3.3.10.11 release provides the following:
- Compiler and dependency updates
See the Product and OS Dependencies section for details.
Product and OS Dependencies:
----------------------------
This Cray FFTW 3.3.10.11 release is supported on these HPE/Cray systems:
- HPE/Cray EX Systems with SLES 15 SP6 or later, RHEL 8.10, or RHEL 9.5 or later based OS
- HPE/Cray XD/Apollo Systems with RHEL 8.10 or RHEL 9.5 or later based OS
This Cray FFTW 3.3.10.11 release requires the following software products:
craype 2.7.35 or later
cray-mpich 9.0 or later
One or more of the following major compiler versions:
CCE 20
GCC 14
AOCC 5.0
AMD (ROCm) 6.4
Nvidia 25.5 (except SLES 15.7)
Intel 2025
Notes and Limitations:
----------------------
Starting with cray-fftw/3.3.6.1 the fftw module has been renamed from fftw
to cray-fftw.
Documentation:
--------------
http://www.fftw.org/index.html#documentation
See the intro_fftw3 manual page for additional information.
Modulefile:
-----------
module load cray-fftw
Installation
------------
To install the rpm, execute:
rpm -ivh cray-fftw-3.3.10.11-202601211539.83b6378feb766-1.sles15sp7.x86_64.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_fftw_3.3.10.11
Certain components, files or programs contained within this package or
product are Copyright 2011-2025 Hewlett Packard Enterprise Development LP
gdb4hpc 4.16.6
gdb4hpc 4.16.6
================================================================================
Product Description
---------------------------
- gdb4hpc is a GDB-based parallel debugger used to debug applications compiled with
CCE, AOCC, GNU, and Intel Fortran, C and C++ compilers. It allows programmers to
either launch an application or attach to an already running application that
was launched on the system. Additionally, it provides comparative debugging
technology that enables programmers to compare data structures between two
executing applications. Comparative debugging should be used in conjunction
with the CCDB GUI tool accessed by loading the cray-ccdb module.
- Some features of gdb include:
* Command line parallel debugger allows for launching/attaching applications.
* Utilizes process sets to operate on a subset of application ranks.
* GDB-like feel, also implements a gdbmode to enable a true parallel gdb.
* GPU debugging is supported for OpenMP 4.0+ GPU directives; OpenMP 5.0 on AMD
and Nvidia GPU's.
* Workload manager support via Common Tools Interface (cray-cti).
Changelog
---------------------------
=======================================================================
## [4.16.6]
=======================================================================
### Bug Fixes
* Printing of large std::arrays and help for apropos
* Subscripting for std::vector and std::tuple
* --gpu option for launch and attach was broken
* CPE-11530: add rust functional tests and fix bug with rust-gdb spawning
* CPE-10692: Parse quoted arguments following equals in longopt
* Ignore quotes around the --env argument in launch
* CPE-9018: Survive segv in message queue debugging shared libraries
* CPE-9350: Fix incorrect pending breakpoint response in mi mode
### Features
* CPE-11464: Add Rust Strings
* CPE-11215: add Utf32Char type, Rust vector and array improvements.
* Remove dependence on cdst-support package
* CPE-9081: Add info mpi pending command
* Add support for float16 and bfloat
* CPE-8683: Add --gdbinit launch option to enable reading .gdbinit files in backend
=======================================================================
## [4.16.3]
=======================================================================
### Bug Fixes
* CPE-5960: Fix failure to launch application when using certain acceleration runtimes
* CPE-7944: Work around gdb bug when finishing during startup sequence on aarch/python
* CPE-8161: print an error message when trying to print a dereferenced null pointer
* CPE-7930: Don't print parse error to stderr
### Features
* CPE-8868: Remove MRNet network protocol
* CPE-8194: Better node management when using the run command to relaunch jobs
=======================================================================
## [4.16.4]
=======================================================================
### Bug Fixes
* CPE-6196: Allow CUDA breakpoints on kernel launch
* Print NaN and infinity values
* Add RUNPATH for unit tests to libexec/dbgsrv
* CPE-5982: Fix cuda command failures in some cases
* CPE-5960: Fix failure to launch application when using certain acceleration runtimes
* No not generate missing MPI breakpoint if a program use mpi_init_thread
* PE-52432: Load MRNet filter library from complete path
* PE-54147: Use main function from debug information
* Fix printing std::unique_ptr with newer stdc++
* Fix print of character arrays shorted by set print elements
* Fix backend gdb crash on vector<vector<string>>
### Features
* CPE-7286: Support basic list command in python mode
* CPE-7395: Support 'catch throw' and 'catch raise' commands in python mode
* CPE-6731: Apply pager setting to results of `info threads` command
* CPE-5688: In python mode, stop the application on uncaught exceptions
* CPE-635: Verify python breakpoint locations
* CPE-6345: Add --pending option to break
* CPE-5686: Add frame and up/down commands to python mode
* CPE-6994: Handle unregistered breakpoints and watchpoints
* CPE-6094: Support setting breakpoints in multithreaded python apps
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6664: Support debugging python 3.5, python 3.7, python 3.13
* CPE-6561: Improve CUDA API error reporting
* CPE-6513: Show cuda-gdb cuda API warnings
* CPE-5690: Change command prompt when in python mode
* CPE-6037: Add GPU debugging tutorial
* CPE-615: Add python mode documentation
* CPE-2316: Add "what's new in 4.16.3" document
* CPE-633: support finish command in python mode
* CPE-2350: Autocomplete struct members for `print`
* PE-53102: Set python breakpoints and step/next in python
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-53101: Evaluate python statements with the print command
* PE-55035: Python mode and python backtraces
* PE-53105: Launch applications with the same syntax as an srun command
* PE-54824: Support non-MPI PALS launches
* PE-54073: Print job output on failed launch
* PE-53771: Pass arguments to launched app on the end of the launch command
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti 2.21, < 3 installed
Documentation
---------------------------
- Type `man gdb4hpc` with the gdb4hpc module loaded to read the gdb4hpc(1) man page.
Simple usage examples are provided at the end.
Also, type `help` at the gdb4hpc command line for more information on commands.
Installation Instructions
---------------------------
- rpm -ivh gdb4hpc-4.16.6-20260115174248_94f3fb8d1fed-599.sles15sp7.x86_64.rpm
To make gdb4hpc 4.16.6 the default version of gdb4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_gdb4hpc_4.16.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2026 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/gdb4hpc/4.16.6/ATTRIBUTIONS_gdb4hpc.txt
HDF5 1.14.3.9
# HDF5 1.14.3.9
## Purpose:
This HDF5 release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* SLES 15 SP7 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* CCE 20.0.0
* AMD ROCm 7.0
* AOCC 5.0
* Intel OneAPI 2025.2
* Nvidia HPC SDK 25.9
* GCC 14
## Product and OS Dependencies:
The HDF5 1.14.3.9 release is supported on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* SLES 15 SP6/SP7 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 20.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3 to 14.2 (RHEL 8.10)
* gcc-toolset-12.2 to 14.2 (RHEL 9.5)
* gcc-toolset-12.2 to 14.2 (RHEL 9.6)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
Users are encouraged to use the Cray compiler scripts (cc, ftn, CC) to include the HDF5 header files and link in the HDF5 libraries, rather than the HDF5 compiler scripts (h5cc, h5fc, h5c++) included in the release.
## Documentation:
http://www.hdfgroup.org/HDF5/doc/index.html
## Modulefile:
`module load cray-hdf5`
OR
`module load cray-hdf5-parallel`
## Product description:
HDF5 is a data model, library, and file format for storing and managing data. It supports an unlimited variety of datatypes, and is designed for flexible and efficient I/O and for high volume and complex data. HDF5 is portable and is extensible, allowing applications to evolve in their use of HDF5. The HDF5 Technology suite includes tools and applications for managing, manipulating, viewing, and analyzing data in the HDF5 format.
## Installation:
`rpm -ivh cray-hdf5-1.14.3.9-*-202512121730.28b737dabae98.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_hdf5_1.14.3.9`
Certain components, files or programs contained within this package or product are Copyright 2019-2025 Hewlett Packard Enterprise Development LP.
HPE Cray Compiling Environment (CCE) 21.0.0
HPE Cray Compiling Environment (CCE) 21.0.0
===========================================
Purpose:
--------
CCE 21.0.0 provides Fortran, C, and C++ compilers for
HPE Cray supercomputer and HPE Apollo 2000 Gen10Plus systems.
Key Changes and Support with CCE 21.0.0:
----------------------------------------
CCE 21.0.0:
-----------
- LLVM 21 base (merges up to Dec 12, 2025 - LLVM version 21.1.8)
- Support for Clang extensions for AMD GPU floating-point atomics:
https://clang.llvm.org/docs/LanguageExtensions.html#extensions-for-controlling-atomic-code-generation
- Added or extended support for the following OpenMP features:
[6.0]
- groupprivate directive
- Fortran: workdistribute construct
- Fortran: automap modifier for declare target
- local clause for declare target
- variable-category modifier for default clause
[5.2]
- extended declare mapper to support iterators and present modifier
- support omp_initial_device and omp_invalid_device identifiers
- Fortran: doacross clause for stand-alone ordered directive
- Fortran: new linear clause syntax
- ROCm 7.0
- NVIDIA SDK 25.09
- Enhanced DWARF Support
- Functional support for low-precision floating point (FP16 and BFloat16) for C, C++, and Fortran.
User and Application Impact:
----------------------------
CCE 21.0.0:
-----------
- The "fast address" GPU optimization has been disabled at default
(equivalent to "-hacc_model=no_fast_addr"). This optimization
attempts to use 32-bit integers for GPU array index calculations
to improve performance, but it can result in incorrect behavior
if 32-bit precision is insufficient for large arrays. The
optimization can be explicitly re-enabled with "-hacc_model=fast_addr".
- The "craycc" and "crayCC" compiler drivers now bypass the Cray PE
driver and invoke CCE's "clang" driver directly. As a result, Cray
PE driver flags are no longer accepted by "craycc" and "crayCC".
This behavior now matches the "crayftn" driver, which was changed
to bypass the Cray PE driver in CCE 20.
- LLVM backends for unsupported targets have been removed. CCE now
only provides LLVM backends for supported CPU and GPU targets (X86,
AArch64, NVPTX, and AMDGPU).
- Support for the AMD GPU gfx940 target has been removed.
Issues or Bugs Resolved:
------------------------
CCE 21.0.0:
-----------
CAST-39292 CCE/20.0.x compiler bug on GSL (GNU Scientific Library)
CAST-39199 Error with a combined SAVE + a DO loop + a BLOCK construct containing an ALLOCATABLE declaration-construct
CAST-39134 integer(8) displaying 32-bit overflow related error with CCE compiler in rush_larsen_gpu_omp_fort benchmark
CAST-39116 CPE/25.09 mpif90/f77/fort and crayftn mis-handling `-shared` flag
CAST-38893 AFW ESMF segfault when compiling with CCE/20.0.0
CAST-38866 CCE 20 fortran link time increase compared to CCE 19
CAST-38817 Thornado linking error with CCE/20.0.0
CAST-38802 Cray Fortran compiler in cce/19.0.0 and cce/18.x is failing to compile a code that is correct and was compilable with cce/16.x and cce/17.x
CAST-38782 CCE 20 Incorrect Error ftn-1195 with a Particular ENUM Value and ISO_C_BINDING
CAST-38775 crayftn error on unlimited polymorphic assumed rank argument
CAST-38750 User reports issues with CCE fortran "do concurrent"
CAST-38682 Thornado linking error with CCE/20.0.0
CAST-38461 OpenMP collapse leads to out of bound access
CAST-38329 CCE 19 Ftn gives incorrect results with O2 or O3
CAST-38228 CCE 19 ftn gives extraneous warning with -h omp
CAST-38206 Cray Fortran - OpenMP private variable is being shared
CAST-38117 ftn -h sanitize=thread has false positives
CAST-38097 Woosley Heger problem cannot compile/run with cce later than 16.0.1
CAST-38089 CCE19: OpenMP producing wrong answer in ComputeRadialMomentsKernel in GenASiS
CAST-37847 The ftn sanitize option has problems and false positives
CAST-37719 Cray Fortran compiler mishandling use of intrinsic within specification expressions
CAST-37200 Arrays of abstract data types (DV SM==0)
CAST-37071 CCE Fortran Internal error in THATMPI PIC codes
CAST-36536 llc error linking dyna3d target openmp with cce 18 ftn on rzadams
CAST-36339 Issue with the OpenACC kernels construct
CAST-36177 HPE Cray EX Supercomputer - Base System CodeOpenACC compile time error "Invalid accelerator routine parallelism"
CAST-35380 CCE 17.0.0 Fortran compiler fails four Smart-Pointers tests
CAST-35015 Global PARAMETER arrays not working with OpenACC
CAST-34641 Issue with ftn/OpenACC
CAST-33343 Crayftn Unlimited Polymorphic Assumed Rank Argument
CAST-33162 ftn compiler internal error on openmp target loop setting pointer to null
CAST-32041 OpenACC + OpenMP kernel optimization/serialization issue
CAST-31462 OpenACC exit data delete failure
CAST-31407 OpenMP offloading: poor performance of reduction for array elements
CAST-30651 Unable to use runtime variable in openmp thread_limit(var) clause
CAST-30331 Weak alias fails with CCE 13/14 C + OpenMP
CAST-30276 OpenMP atomic directive inside loop region
Product and OS Dependencies:
----------------------------
This CCE release is supported on
- HPE Cray supercomputer systems running CSM with COS 2.5.X (SLES15 SP4) or COS 23.11 (SLES15 SP5)
- HPE Cray supercomputer systems running HPCM with COS 2.5.X (SLES15 SP4) or COS 23.11 (SLES15 SP5)
- HPE Cray supercomputer systems running HPCM with RHEL 8.10
- HPE Apollo 2000 Gen10Plus systems running RHEL 8.9
- AMD GPU offloading support requires at least ROCm 7.0 (ROCm 6.x is no longer supported)
Notes and Limitations:
----------------------
Documentation:
--------------
- S-5212 Cray Compiling Environment Release Overview (21.0)
- S-3901 Cray Fortran Reference Manual
- S-2179 Cray C and C++ Quick Reference
- Basic man pages: crayftn(1), craycc(1), crayCC(1), intro_openmp(7), intro_openacc(7)
- Please see https://clang.llvm.org/docs/UsersManual.html or use the -help command line option for
more information on using Clang
Modulefile:
-----------
The following will load the modules necessary to use CCE:
module load PrgEnv-cray
The following will switch to x.y.z version of CCE:
module swap cce cce/x.y.z
Installation instructions:
--------------------------
rpm -ivh cce-21.0.0-202601201720.99bfd3022cb16-0.sles15sp4.x86_64.rpm
The following script will set CCE version 21.0.0 default:
/opt/cray/pe/admin-pe/set_default_files/set_default_cce_21.0.0
License:
--------
Except for the third party components and software licensed by HPE through
proprietary agreements, components, files or programs contained within this
package or product are Copyright -2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/cce/21.0.0/ATTRIBUTIONS_21.0.txt
HPE Cray MPI 9.1.0
HPE Cray MPI 9.1.0:
=======================================
Release Date:
-------------
January 16, 2026
Purpose:
--------
HPE Cray MPI 9.x is now the recommended production version of HPE Cray
MPI beginning with CPE 25.09 and this release of HPE Cray MPI(9.1.0).
One final HPE Cray MPI 8.x release has been released with CPE 25.09 as
a fallback MPI version in case of problems with HPE Cray MPI 9.1.0.
This 8.x fallback version in CPE 25.09 will be the last release of
Cray MPI 8.x
HPE Cray MPI 9.1.0 is a version of HPE Cray MPI that supports the
MPI 4.1 standard. Cray MPICH 9.1.0 is based upon ANL MPICH 4.2.2
with support for libfabric and is optimized for the Cray Programming
Environment. Cray MPICH 9.1.0 is built to work with libfabric
ABI version 1.6 or later (libfabric API version 1.14 or later).
Major Differences HPE Cray MPI 8.x and HPE Cray MPI 9.x:
- HPE Cray MPI 9.x supports the MPI 4.1 standard. The 8.x series
supports the MPI 3.1 standard.
- HPE Cray MPI 9.x is based on ANL MPICH 4.2.2. The 8.x series is
based on ANL MPICH 3.4a2.
New HPE CRAY MPI features for HPE Cray EX systems:
The 9.x series is based on the 8.x series and thus inherits all
of 8.x's features, improvements, etc.
- Starting from the 8.1.26 release, HPE Cray MPI supports the Intel
Sapphire Rapids CPU HBM processor architecture.
- On systems with AMD GPUs, HPE Cray MPI 9.1.0 supports ROCm 7.0.
- On systems with Nvidia GPUs, HPE Cray MPI 9.1.0 supports Cuda 13.
- On Slinghot-11 systems, HPE Cray MPI uses the libfabric "cxi" provider
by default.
- HPE Cray MPI offers support for multiple NICs per node. Starting with
version 8.0.8, by default HPE Cray MPI will use all available NICs on
a node. Several rank-to-NIC assignment policies are supported. For
details on choosing a policy for assigning ranks to NICS, or for
selecting a subset of available NICs, please see the following
environment variables documented in the mpi man page.
MPICH_OFI_NIC_VERBOSE
MPICH_OFI_NIC_POLICY
MPICH_OFI_NIC_MAPPING
MPICH_OFI_NUM_NICS
- Enhancements to the MPICH_OFI_NIC_POLICY NUMA mode have been added.
Starting with version 8.0.14, if the user selects the NUMA policy,
the NIC closest to the rank is selected. A NIC no longer needs to
reside in the same numa node as the rank. If multiple NICs are
assigned to the same numa node, the local ranks will round-robin
between them. Numa distances are analyzed to select the closest NIC.
- Lmod support for HPE Cray EX starting with HPE Cray MPI 8.0.16.
- Starting with the 9.1.0 release, details of collective algorithm selection
have been documented in /opt/cray/pe/mpich/<version>/share/
- README.coll.alg_sel explains the procedure and provides an example.
- README.coll.envvar documents environment varaibles for collective
algorithm selection.
Key Changes and Bugs Closed:
----------------------------
Changes in HPE Cray MPI 9.1.0
Features and Bug Fixes:
MPICH:
- Support for MPI 4.1 standard
- CAST-36355 - Document GTL_HSA_VSMSG_CUTOFF_SIZE
- CAST-38711 - Bug fix for mpifort wrapper
- CPE-10190 - Add Allgather vlarge optimizations in CPE 26.03
- CPE-10191 - Add GPU kernel reduction support for MPI_Reduce_scatter
- CPE-10193 - Documentation for collective algorithm selection
- CPE-10466 - Alltoallv tuning for GPU buffers
- CPE-10582 - Add batch optimization feature for small message MPI_Alltoallv
- CPE-11467 - Document more GTL environment variables
- CPE-12245 - Improve MPIR_CVAR_CSEL_VERBOSE to allow selecting a set of collectives
- CPE-12300 - Adjust memcpy size cutoffs with MPICH_OPTIMIZED_MEMCPY_MAX
- CPE-12317 - Fix assert in the HW collective code
- CPE-12336 - Add batch optimization feature for small message MPI_Alltoall
- CPE-12439 - Fix return for MPIR_ERR_COLL_CHECKANDCONT
- CPE-12569 - Add PCIe blocked cycles/pkt ratios to MPICH CXI counter report
- CPE-12733 - Bug fix for stream triggered code and multi-host
- CPE-12768 - Remove unused MPIR_CVAR_MAX_SMP_ALLREDUCE_MSG_SIZE
- CPE-12802 - CVAR cleanup related to XPMEM
- CPE-12803 - Add collective algorithm selection json and readme files
- CPE-12917 - Update config file documentation
- CPE-12935 - Add MPIR_CVAR_DEBUG_CVARS for cray vars
- CPE-13072 - Change the default for the fi_getinfo PID selection
- CPE-13103 - Documentation update for MPICH_ALLGATHERV_VSHORT_MSG
- CPE-13104 - Tune JSON defaults for MPI_Reduce_scatter and MPI_Reduce_scatter_block
- CPE-13120 - Document FI_MR_CACHE_MONITOR recommendation for GTL_ENABLE_HSA_IPC_SIGNAL_CACHE
- CPE-13125 - Add kernel reduction for recursive_halving Reduce_scatter
- CPE-13126 - Add kernel reduction to recursive_halving reduce_scatter_block
- CPE-13204 - Remove blocks on big count GPU reductions
- CPE-13208 - Cleanup of Active RMA code
- CPE-13281 - Fix RMA GPU failure in win_allgather
- CPE-13290 - Add info about CSEL documentation to man-pages and release notes
- CPE-13350 - Tune MPI_Alltoall algorithm cutoffs for Rosetta2
- CPE-13398 - Bugfix for allreduce test case
- CPE-13400 - Enable ROCM 7 support
- CPE-13431 - Tune performance kernel reduce_scatters
- CPE-13528 - Increase default setting of FI_MR_CACHE_MAX_COUNT env variable
- CPE-13548 - Revert to buffered GPU transfers if a CUDA fabric buffer
- CPE-13777 - Bug fix for Fortran programs with user defined functions for MPI_Allreduce
- CPE-13829 - Update for MPIR_ERR_CHKANDJUMP()
- CPE-13830 - Update flag use in win_shm_alloc_impl()
- CPE-13834 - Bug fix for mpicc wrapper
- CPE-13955 - Enable debug builds for intel and nvidia compilers
- CPE-14082 - Document use of MPI lib-debug libraries in man page
GTL:
- CAST-39188 - Fix the version maintenance in udreg
- CPE-7173 - Change integer datatypes used in reductions from 32-bit to 64-bit
- CPE-11987 - Reduce confusion about disabling the HSA cache
- CPE-12247 - Fix invalid memory access with kernel reducion involving non-multiple of 512 elements
- CPE-12944 - Disarm IPC signal handler instance after each callback
- CPE-13039 - Additional signal states to avoid spin-wait when no memory attach is done
- CPE-13102 - Change the _memcpy_blk() functions to use ssize_t instead of integers
- CPE-13184 - Fix the spin-wait condition in HSA IPC signal cleanup
- CPE-13399 - Enable ROCM 7 support
- CPE-13351 - Enable Cuda 13 support
- CPE-13548 - Recognize CUDA stream memory allocations
Product and OS Dependencies:
----------------------------
The HPE Cray MPI 9.1.0 release is supported on the following HPE systems:
* HPE Cray EX systems with CLE
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.6 |
----------------------------+---------------------+
cray-pals | >= 1.0.6 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.9.0 |
----------------------------+---------------------+
One or more compilers:
* AMD ROCM 7.0 or later
* AOCC 4.1 or later
* CCE 20.0 or later
* GNU 12.3 or later
* Intel 2022.1 or later
* Nvidia 23.3 or later
Notes and Limitations:
----------------------
Limitations in HPE Cray MPI 9.1.0:
- HPE Cray MPI 9.1.0 does not support C++ language bindings. Note
that HPE Cray MPI 8.x releases also does not support C++ language
bindings. There is no plan to add C++ language bindings at this time.
- GPU Async Communication - Stream Triggered and Kernel Triggered
communication - is currently unsupported. Both features are planned
to be added in a future release.
- Support of SS-10 and InfiniBand has been dropped.
- On systems with Slingshot-11 hardware, some MPI programs using
MPI_PROBE (or it's variants) experience an application failure,
from libfabric, with the error message
libfabric:766248:1740758749::cxi:core:cxip_claim_onload_cb():2581<warn>
RXC (0x173:0) PtlTE 16:[Fatal] Unexpected event SEARCH, rc = NO_MATCH
This problem is being tracked by NETCASSINI-7129 and a solution is
expected in a future release of Slingshot Host Software (SHS).
In the interim, this problem may be avoided by setting
FI_CXI_RX_MATCH_MODE=software
in the software environment where the application is run. intro_mpi(1)
has information about FI_CXI_RX_MATCH_MODE.
Other Notes
- This version of HPE Cray MPI (9.1.0) supports CCE 21. For x86_64,
CCE 21 support of ROCm 7.0 has resulted in a bump of the lmod
compatbility version to 21. The lmod compatibility version on aarch64
remains at 20.
Please see the CCE release notes for further information.
- Some versions of NVIDIA compilers, in particular NVIDIA 25.3 and 25.5
compilers, add "/usr/lib64" to the rpath of any program linked with
the NVIDIA compiler drivers. This rpath blocks the use of other
parts of Cray PE. In particular it prevents Cray PMI from being used.
The most common run-time error one sees if using Slurm PMI with HPE
Cray MPI when Cray PMI is expected is:
xxxx: ../src/mpid/common/cray/cray_pmi_utils.c:108: _mpidi_cray_pmi_send: Assertion `rc == PMI2_SUCCESS' failed
One way to avoid this behavior is to add the NVIDA compiler option
"-Mnorpath" when linking programs with NVIDIA compilers.
Documentation:
--------------
For more information see the intro_mpi man page.
Modulefile:
-----------
module load cray-mpich/9.1.0
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright -2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/mpich/9.1.0/ATTRIBUTIONS
Copyright -2026 Hewlett Packard Enterprise Development LP
modules 3.2.11.8
modules 3.2.11.8
==================
Documentation:
---------------
See man-pages for module and modulefile.
NetCDF 4.9.2.3
# NetCDF 4.9.2.3
## Purpose:
This NetCDF release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* SLES 15 SP7 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* CCE 20.0.0
* AMD ROCm 7.0
* AOCC 5.0
* Intel OneAPI 2025.2
* Nvidia HPC SDK 25.9
* GCC 14
## Product and OS Dependencies:
The NetCDF 4.9.2.3 release is supported on the following systems, requiring the following software products:
* Cray HDF5 1.14.3.9
* CrayPE 2.1.2 or later
* SLES 15 SP6 (x86_64, aarch64)
* SLES 15 SP7 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 20.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3 to 14.2 (RHEL 8.10)
* gcc-toolset-12.2 to 14.2 (RHEL 9.5)
* gcc-toolset-12.2 to 14.2 (RHEL 9.6)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
Unidata now packages Netcdf-4 and legacy Netcdf-3 separately. HPE has decided not to continue supplying the legacy Netcdf-3 package. Due to CCE changes a version of netcdf built with "-sreal64" is neither needed nor provided.
NetCDF is supported on the host CPU but not on the accelerator.
## Documentation:
http://www.unidata.ucar.edu/software/netcdf/docs
## Modulefile:
`module load cray-netcdf`
OR
`module load cray-netcdf-hdf5parallel`
## Product Description:
NetCDF (network Common Data Form) is a set of interfaces for array-oriented data access and a freely-distributed collection of data access libraries for C, Fortran, C++, Java, and other languages. The netCDF libraries support a machine-independent format for representing scientific data. Together, the interfaces, libraries, and format support the creation, access, and sharing of scientific data.
## Installation:
`rpm -ivh cray-netcdf-4.9.2.3-*4.9.2.3.@ARCH@.rpm`
The "*" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_netcdf_4.9.2.3`
Certain components, files or programs contained within this package or product are Copyright 2019-2025 Hewlett Packard Enterprise Development LP.
Parallel NetCDF 1.12.3.21
# Parallel NetCDF 1.12.3.21
## Purpose:
This Parallel NetCDF release contains the following:
* SLES 15 SP6 (x86_64, aarch64)
* SLES 15 SP7 (x86_64, aarch64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* CCE 20.0.0
* AMD ROCm 7.0
* AOCC 5.0
* Intel OneAPI 2025.2
* Nvidia HPC SDK 25.9
* GCC 14
See the Parallel NetCDF documentation for details and usage information.
## Product and OS Dependencies:
This Parallel NetCDF 1.12.3.21 release is supported on on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* SLES 15 SP6 (x86_64, aarch64)
* SLES 15 SP7 (x86_64, aarch64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.5 (x86_64, aarch64)
* RHEL 9.6 (x86_64, aarch64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 20.x or later (SLES, RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3 to 14.2 (RHEL 8.10)
* gcc-toolset-12.2 to 14.2 (RHEL 9.5)
* gcc-toolset-12.2 to 14.2 (RHEL 9.6)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
## Documentation:
https://parallel-netcdf.github.io/wiki/Documentation.html
## Modulefile:
`module load cray-parallel-netcdf`
## Product Description:
Parallel NetCDF is a library providing high-performance I/O while maintaining file-format compatibility with Unidata's NetCDF.
## Installation:
`rpm -ivh cray-parallel-netcdf-1.12.3.21-*202512121735.2b38c3fc4f247.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_parallel-netcdf_1.12.3.21`
Certain components, files or programs contained within this package or product are Copyright 2019-2025 Hewlett Packard Enterprise Development LP.
Perftools 26.03.0
perftools %{pkgversion}
================================================================================
Product Description
---------------------------
- perftools is a suite of tools for sampling and tracing HPC program to identify
areas of poor performance.
Known Issues
---------------------------
- In a profile or other report table, if some function or kernel names are empty
or are difficult to interpret, try using either or both of these
pat_report options: -P and -s prune_name=''
both with the original table and with the option: -O callers
- We have observed some application crashes when running with perftools-lite-gpu,
running with pat_run -m lite-gpu can be used as a work around.
Notes
---------------------------
- This is a feature and bugfix release for the following systems
- HPE Cray EX and HPE Cray Supercomputer Systems with HPCM
- HPE Cray EX and HPE Cray Supercomputer Systems with CSM
- Supported components
- ROCm 7.0
- CUDA 13.0
- PAPI 7.3.0.1
- DWARF 2.2.0
- Supported OS
- HPE CSM systems with SLES 15 SP6 - SP7
- PE HPCM systems with SLES 15 SP6 - SP7 or RHEL 8.10, 9.5, 9.6
- Deprecations and removals
- Apprentice3 has been moved to a separate rpm, it installs under "apprentice" and
now requires "module load apprentice3".
- The counter prefix "rocm" is removed in papi 7.3.0.1. The replacement is "rocp_sdk".
- Additional dependencies
- For a list of software used when validating this version of
Perftools on Cray and HPE systems, see the HPE Cray Programming Environment
release announcements.
Changelog
---------------------------
=======================================================================
## [26.03.0]
=======================================================================
### Bug Fixes
* Rpm builds with dashes in the branch name
* Do not start jman connection while loading bard library
* Disable debug build ids in rpm install
### Features
* Move apprentice3 to a separate rpm and module file
* Add plots to python API
* Remove Apprentice 3 from perftools package
=======================================================================
## [25.09.0]
=======================================================================
### Bug Fixes
* Fix crash from memory overwrite
* Unintalling perftools leaves left over image files
* CPE-8326: __libc_start_call_main shows in calltree before main
* Recognize ignoring counter group files correctly
### Features
* Add configuration dialog to enable openssh based connection in Apprentice 3
* Cpe-9148: support collecting of Cassini retry handler counters
* Cpe-2086: produce supporting files for cassini sensor counters
* CPE-5645: Add ability to connect to data on a remote host via OpenSSH
* Update the Cassini counter groups and native avail files
* Automate creation of the changelog
* CPE-7993: Support MPI RMA in mosaic view
* Add apprentice 3 documentation for Profile and Counter panels
* Add getting started guide
=======================================================================
## [25.03.0]
=======================================================================
### Bug Fixes
* Fix crash in otf2 export CPE-7830
* Update default python pruning for 3.12
* Ensure install dir exists and error out if unwritable
* Fix multiple Mac installers in develop branch rpms.
* Fix crash initializing the call graph
* Missing character when a program has operator%
* Remove OmpTool group warning
* Update CUDA PM
* Get cortland builds going
* Fix mac buildbot builds
* Apprentice2: Two-Pie Panel Help is Wrong.
### Features
* Add getting started guide
* Build with gcc-14 on rhel 9.5 and sles15sp6
* Add Apprentice 3 documentation to web site
* Expand HIP PMs
* Shift buildbot build command to repo
Documentation
---------------------------
- See `https':'//cpe.ext.hpe.com/docs/latest/performance-tools/index.html`
- Start with `man intro_craypat`
- See these man pages':'
- app3, grid_order, intro_craypat, pat_build, pat_help, pat_info, pat_opts,
pat_report, pat_run, pat_view
- intro_papi
- perftools-base, perftools-lite, perftools-preload
- accpc, cray_cassini, cray_pm, hwpc, nwpc, papi_counters, uncore
- PAPIlicnotices
Installation Instructions
---------------------------
- rpm -ivh %{cray_name}-%{pkgversion}-202601132055.47ebd93719ccf-2.sles15sp7.x86_64.rpm
- To make %{cray_name} %{pkgversion} the default version of %{cray_name}, execute':'
%{cray_prefix}/admin-pe/set_default_files/set_default_%{cray_name}_%{pkgversion}
Legal Notices
---------------------------
%{copyright}
Attribution notices for open source licensed software for this package are detailed in the file:
$CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt
- Except for the third party modules discussed below and software licensed
by HPE through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2023
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
$CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt
sanitizers4hpc 1.1.6
sanitizers4hpc 1.1.6
================================================================================
Product Description
---------------------------
- Sanitizers4hpc is a debugging tool to aid in the detection of memory leaks
and errors in parallel applications. Using LLVM's AddressSanitizer or
LeakSanitizer as a data source, Sanitizers4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior.
Notes
---------------------------
- Shared library exposure in previous versions of sanitizers4hpc.
Previous versions of sanitizers4hpc incorrectly exported internal sanitizers4hpc
libraries into /opt/cray/pe/lib64, causing other programs that had that path in
their runpath or LD_LIBRARY_PATH to load libraries they didn't expect.
This has been fixed in the 22.08 release of sanitizers4hpc. However, links will
be present in /opt/cray/pe/lib64 pointing to older versions of sanitizers4hpc,
if an older version is installed because old installations will still modify
/opt/cray/pe/lib64 when ldconfig is run.
To clean up libraries left by previous versions of sanitizers4hpc:
Option 1:
1. Uninstall all previously installed versions of sanitizers4hpc, or remove
the .cray_dynamic_file_list file from all previously installed versions
of sanitizers4hpc, typically installed in /opt/cray/pe/sanitizers4hpc.
2. Remove any links in /opt/cray/pe/lib64 pointing into a sanitizers4hpc installation.
3. run ldconfig
Option 2:
1. Uninstall all previous versions of santizers4hpc.
Changelog
---------------------------
=======================================================================
## [1.1.4]
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
=======================================================================
## [1.1.3]
=======================================================================
### Bug Fixes
* PE-54265: Automatically preload libfabric if linked
### Features
* CPE-8108: Improve diagnostic when debug info stripped
* CPE-7776: Add check for HIP ASan instrumentation
=======================================================================
## [1.1.5]
=======================================================================
### Bug Fixes
* CPE-6849: Suppress AMD libhsa-runtime false positives #99
* CPE-6064: Don't reset ZMQNet install directory
* PE-54417: Strip trailing BuildId if present
* PE-54265: Automatically preload libfabric if linked
* PE-53866: Improve ThreadSanitizers and Nvidia Compute Sanitizers aggregation
* PE-53603: Update ZMQNet submodule for libsodium support
* PE-51193: Activate PALS startup barrier manually through libpals
* PE-49611: Update ZMQNet
### Features
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6125: Support Clang MemorySanitizers
* CPE-6249: Aggregate GPU workgroup IDs
* CPE-1039: Automatically detect and add instrumented HIP runtime to LD_LIBRARY_PATH
* CPE-5880: Automatically build ASan MPI wrappers
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* Add builds for rhel 9.4 and sles15sp6
* PE-51960: Added support for rhel89/93 & gcc13
* Use gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-cti >= 2.20, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh sanitizers4hpc-1.1.6-20250827184436_695ef5c0eb4c-122.sles15sp7.x86_64.rpm
To make sanitizers4hpc 1.1.6 the default version of sanitizers4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_sanitizers4hpc_1.1.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/sanitizers4hpc/1.1.6/ATTRIBUTIONS_sanitizers4hpc.txt
valgrind4hpc 2.13.6
valgrind4hpc 2.13.6
================================================================================
Product Description
---------------------------
- Valgrind4hpc is a Valgrind-based debugging tool to aid in the detection of memory
leaks and errors in parallel applications. Valgrind4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior. Valgrind4hpc manages starting and redirecting output from many
copies of Valgrind, as well as deduplicating and filtering Valgrind messages.
If your program can be debugged with Valgrind, it can be debugged with Valgrind4hpc.
Changelog
---------------------------
=======================================================================
## [2.13.6]
=======================================================================
### Bug Fixes
* CPE-9080: Fix output file path
### Features
* Remove dependence on cdst-support
=======================================================================
## [2.13.5]
=======================================================================
### Features
* CPE-7743: Update Valgrind to 3.24
* Build with g++14 on rhel 9.5 and sles15sp6
* Add rhel 9.5, remove rhel 8.9 and sles15sp4
* CPE-6037: Add source code to user guide
=======================================================================
## [2.13.4]
=======================================================================
### Bug Fixes
* PE-54291: Finish analysis early if job exited unexpectedly
### Features
* Support rhel 8.10
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-54471: Add suppressions for aarch64 libcxi
* PE-55037: Remove deprecated exp-sgcheck tool support
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP5 - SP6
- HPE HPCM systems with SLES 15 SP5 - SP6 or RHEL 8.10 - 9.4
- HPE Apollo systems with RHEL 8.10
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.20, < 3 installed
Documentation
---------------------------
- See man valgrind4hpc.
Installation Instructions
---------------------------
- rpm -ivh valgrind4hpc-2.13.6-20250827185037_cd609cb5c0f2-444.sles15sp7.x86_64.rpm
To make valgrind4hpc 2.13.6 the default version of valgrind4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_valgrind4hpc_2.13.6
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2025 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/valgrind4hpc/2.13.6/ATTRIBUTIONS_valgrind4hpc.txt