HPE Cray Programming Environment 24.11 Full Release Notes for SLES15 SP6
=========================================================
atp 3.15.5
================================================================================
*Released: November 2024*
Product Description
---------------------------
- Abnormal Termination Processing (ATP) is a system that
monitors user applications, and should an application
take a system trap, ATP preforms analysis on the dying
application. All of the stack backtraces of the
application processes are gathered into a merged
stack backtrace tree and written to disk as the file
"atpMergedBT.dot". The stack backtrace for the first process
to die is sent to stderr as is the number of the signal that
caused the death. If the core file size limit (RLIMIT_CORE)
is non-zero, a heuristically selected set of processes dump
their core.
atpMergedBT.dot can be viewed with 'statview', a component
of the STAT package (module load cray-stat). The merged stack
backtrace tree provides a concise, yet comprehensive, view
of what the application was doing at the time of its death.
Changelog
---------------------------
=======================================================================
## [3.15.5] - 2024-10-1 (24.11)
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
* PE-54139: Fix Fortran user API with AOCC Fortran compiler
### Features
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
=======================================================================
## [3.15.4] - 2024-05-2 (24.06)
=======================================================================
### Bug Fixes
* PE-53603: ZMQNet libsodium support
* PE-52560: Pass all ATP environment variables to Flux plugin
* PE-51520: Remove disable message from Flux plugin
### Features
* PE-53605: Build and package libsodium
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [3.15.3] - 2024-02-9 (24.03)
=======================================================================
### Bug Fixes
* PE-52423: Disable PALS local launch in modulefile
### Features
* PE-51520: Automatic plugin loading for Flux
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- Type `man atp` with the atp module loaded to read the atp(1) man page.
Installation Instructions
---------------------------
- rpm -ivh atp-3.15.5-20241007204244_cb3a010cbbd6-140.sles15sp6.x86_64.rpm
To make atp 3.15.5 the default version of atp, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_atp_3.15.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/atp/3.15.5/ATTRIBUTIONS_atp.txt
cray-ccdb 5.0.5
================================================================================
*Released: September 2024*
Product Description
---------------------------
- CCDB, Cray's next generation debugging tool extends the comparative
debugging capabilities of gdb4hpc with a Graphical User Interface (GUI)
enabling programmers to compare corresponding data structures
between two executing applications. Comparative debugging assists users with
locating sections of code containing data deviations introduced by algorithm
changes, compiler differences, and porting to new architectures/libraries.
Changelog
---------------------------
=======================================================================
## [5.0.5] - 2024-08-20 (24.09)
=======================================================================
### Bug Fixes
* PE-54348: Fix manpage path
### Features
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* Remove old gtk based ccdb-x
=======================================================================
## [5.0.4] - 2024-04-22 (24.05)
=======================================================================
### Bug Fixes
* PE-50334: Fix missing console messages
### Features
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [5.0.3] - 2024-02-7 (24.03)
=======================================================================
### Bug Fixes
* PE-51115: Make socket directory, add PBS allocation instructions
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- gdb4hpc/4.14.x or later installed
Documentation
---------------------------
- Type `man ccdb` with the cray-ccdb module loaded to read the ccdb(1) man page.
- Documentation is available through CCDB from the 'Help' menu.
Installation Instructions
---------------------------
- rpm -ivh --oldpackage cray-ccdb-5.0.5-20240919180831_ad6ddeb697cc-46.sles15sp6.x86_64.rpm
To make cray-ccdb 5.0.5 the default version of cray-ccdb, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-ccdb_5.0.5
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/ccdb/5.0.5/ATTRIBUTIONS_ccdb.txt
HPE Cray Compiling Environment (CCE) 18.0.1
===========================================
Release Date:
-------------
January 2025
Purpose:
--------
CCE 18.0.1 provides Fortran, C, and C++ compilers for
HPE Cray supercomputer and HPE Apollo 2000 Gen10Plus systems.
Key Changes and Support with CCE 18.0.1:
----------------------------------------
CCE 18.0.1:
-----------
CCE-18.0.1
- LLVM 18 base (Merges up to Jun 15th 2024. LLVM version 18.1.8)
- Initial AMD Turin Support
- ROCm 6.2.1 Support
- SLES 15 SP6 Support
-----------
CCE-18.0.0
- LLVM 18 base (Merges up to May 18th 2024. LLVM version 18.1.6)
- Split CCE into subpackages
- Updated OMP_PLACE CPU affinity mapping policy to use absolute indices instead of relative
- New "-fopenmp-force-usm" compiler flag (C/C++/Fortran) enables OpenMP unified shared memory (USM) by treating each source file
as though it contains an explicit "omp requires unified_shared_memory" directive
- Added new "compiler_interop" man page documenting CCE compiler interoperability
- Added the following OpenMP 5.1/5.2 Features:
- interop construct and API routines
- compare and fail clause for atomic construct
- present modifier and defaultmap(present)
- nowait clause for taskwait directive
- default(private) and default(firstprivate) (C/C++)
- omp_target_memcpy_async and omp_target_memcpy_rect_async
- nothing directive (C/C++)
- Added the following OpenACC features:
- OpenACC 2.5
- Automatic allocate/deallocate for device_resident/create allocatables/pointers
- Support acc_memcpy_device routine
- Support num_gangs, num_workers and vector_length on kernels directive
- Support async copy routines
- Handle scoping for lexically visible data regions
- OpenACC 2.7
- Snap subarray/subscript expressions for use at the end of data regions
- Reduction on a compute construct implies a copy clause
- OpenACC 3.1
- Implement OpenACC serial
- Added the following Fortran 2023 features
- Control over leading zeros in output of real values: LEADING_ZERO= specifier
- Auto-allocation of character variables in more places - statements
- TYPEOF and CLASSOF declarations
- More use of BOZ constants
- Partial implementation of conditional expressions and arguments
- ENUMERATION TYPE
- SIMPLE attribute for procedures
- RHEL 8.10 x86_64 support
- RHEL 9.4 x86_64 support
- RHEL 9.4 aarch64 support
- OpenMP floating-point atomic optimization hints for AMD MI250X GPUs (Fortran)
- Advanced AMD GPU DWARF support
- Fortran scalar variables and fixed-size arrays in offload regions
- Fortran common blocks
- Optimized NVIDIA Grace CPU Superchip support
User and Application Impact:
----------------------------
CCE 18.0.1:
-----------
CCE-18.0.1
Issues or Bugs Resolved:
------------------------
CCE 18.0.1:
-----------
CCE-18.0.1
CAST-36652 (ELCAP-660) Fortran submodule compiles successfully but is given an incorrect name
CAST-36543 (HPECOE-68) min and max not supported in do concurrent reduce clause in crayftn
CAST-36533 Bug in Cray Fortran version 16 modulo function
CAST-36532 (ELCAP-654) ftn compiler error with cce 18 - interface to c routine
CAST-36505 olcfhelp-19179 Cray Fortran compiler bug: intrinsic NULL() function
CAST-36497 (ELCAP-651) CCE18 Fortran does not support c_funptr
CAST-36431 Cray Fortran 17.0.0 dummy argument type not recognized for module procedure in same module
CAST-36346 (ELCAP-645) Fortran compiler not generating code unless the suppress directive is active
CAST-36326 [LUMI] CCE - OpenACC generated code performance issue (NEMO, znorthloc region)
CAST-36245 Cray fortran optimization issue
CAST-36098 5UF229JK0D - Issues with Cray Compiler on CCE 23.05 TRANSFER intrinsic
CAST-35980 (ELCAP-611) Fortran module calling a bound member function fails to compile
CAST-35954 (HPECOE-56) CCE 17.0.1 Wrong Results with Pointer Remapped Array Bound in Submodule
CAST-35927 cce17 compilation issue with -g - still exists in 18.0
CAST-35876 RFE: Cray PrgEnv related to building PIE executables
CAST-35868 (ELCAP-600) Fortran ASAN functionality triggers False Positives
CAST-35864 (ELCAP-601) Fortran invalid dope vector after omp directive with if clause
CAST-35680 crayftn merge Function Call ICE When the mask Argument Is a Derived Type Component
CAST-35467 lld: error: duplicate symbol: feenableexcept
CAST-35252 (HPECOE-44) OpenMP bug with multiple reduction clauses
-----------
CCE-18.0.0
CAST-24911 Incorrect result form ASSOCIATED
CAST-26951 RFE: Need CCE OpenMP OMP_PLACES affinity to be able to map to taskset -c
CAST-30200 ftn compiler error module pointer omp target teams distribute parallel do
CAST-30667 [ELCAP-121] ftn compiler error module pointer omp target teams distribute parallel do
CAST-32453 Cray Fortran compiler is generating wrong assembly with OpenACC
CAST-32454 CCE runtime issue related to explicit type conversion of pointer variables with OpenACC.
CAST-32456 (ELCAP-318) Fortran compiler error in omp declare target subroutine - Elevation of case 5372036627
CAST-32588 Cray Compiler Bug : Issue with polymorphic and character type.
CAST-33337 XC50-CLE-Cray Fortran Compiler- Assignment (=) is not overridden
CAST-34158 crayftn Overloaded Constructor With Polymorphic Argument in Array Constructor
CAST-34265 (ELCAP-466) paradyn target offload built with -O0 gets runtime ACC error
CAST-34571 Internal compiler error with OpenACC declare
CAST-34664 (ELCAP-493) Fortran compiler hangs/crashes on !$omp continuation statements.
CAST-34817 (ELCAP-506) ftn omp target offload runtime error with -O0
CAST-34819 HPECOE-34 CCE Fortran OpenMP offload Bug with Procedure as Argument in Declare Target is unsupported
CAST-34871 (ELCAP-510) CCE17 Fortran crashes
CAST-34910 Incorrect code with floating point optimizations in Cray Fortran
CAST-35003 (ELCAP-522) Minikin - ftn unified memory wrong result for module save variable and declare target
CAST-35004 (ELCAP-527) Minikin runtime error with CCE 17 ftn
CAST-35054 (ELCAP-513) Fortran OMP declare target in module causes runtime error with ROCm-5.7.0+
CAST-35193 Cray Compiler error 'ftn-7060' with debug build of OpenACC code
CAST-35240 Cray EX - several compilation errors compiling vasp with cce17.0.0 [5379756819 Elevation]
CAST-35257 (ELCAP-533) Fortran seg fault with nested module subroutines
CAST-35401 Cray Openmp implementation and buggy thread affinity
CAST-35512 [LUMI] ftn -hfunc_trace crashes the compiler when END statement is not named for modules
CAST-35571 Bug with compiler cce/17.0.0
CAST-35625 No source line number displayed when run with MemorySanitizer in PrgEnv-cray
CAST-35726 ftn-7206 warning in cce/17.0
CAST-35776 crayftn ICE when trying to build dftd4
CAST-35903 (ELCAP-596) Fortran compiler segfault with OpenMP and requires statement
CAST-35946 (ELCAP-610) unified memory runtime error using ftn allocatable array from:module
CAST-35963 (ELCAP-615) Paradyn ftn openmp problem: bad size of allocated pointer with omp requires unified_shared_memory
Product and OS Dependencies:
----------------------------
This CCE release is supported on
- HPE Cray supercomputer systems running CSM with COS 2.5.X (SLES 15 SP4) or COS 23.11 (SLES 15 SP5)
- HPE Cray supercomputer systems running HPCM with COS 2.5.X (SLES 15 SP4) or COS 23.11 (SLES 15 SP5)
- HPE Cray supercomputer systems running HPCM with RHEL 8.10
- HPE Apollo 2000 Gen10Plus systems running RHEL 8.9
- AMD GPU offloading support requires at least ROCm 6.0 and is tested up to ROCm 6.2.1
Notes and Limitations:
----------------------
Documentation:
--------------
- S-5212 Cray Compiling Environment Release Overview (18.0)
- S-3901 Cray Fortran Reference Manual
- S-2179 Cray C and C++ Quick Reference
- Basic man pages: crayftn(1), craycc(1), crayCC(1), intro_openmp(7), intro_openacc(7)
- Please see https://clang.llvm.org/docs/UsersManual.html or use the -help command line option for
more information on using Clang
Modulefile:
-----------
The following will load the modules necessary to use CCE:
module load PrgEnv-cray
The following will switch to x.y.z version of CCE:
module swap cce cce/x.y.z
Installation instructions:
--------------------------
rpm -ivh cce-18.0.1-202410021623.ac9591613de6f-0.sles15sp4.x86_64.rpm.x86_64.rpm
The following script will set CCE version 18.0.1 default:
/opt/cray/pe/admin-pe/set_default_files/set_default_cce_18.0.1
License:
--------
Except for the third party components and software licensed by HPE through
proprietary agreements, components, files or programs contained within this
package or product are Copyright -2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/cce/18.0.1/ATTRIBUTIONS_18.0.txt
cpe-descriptive-manifest 24.11
=================================
Release Date: Nov 2024
Product description:
--------------------
The cpe-descriptive-manifest packages contain the JSON manifest files that
are to map CPE to a format that Spack can consume.
Schema Changelog:
-----------------
v1.4
----
* Add 'wrappers' as a boolean parameter
v1.3
----
* Change '_meta' opject's 'version' property to 'schema-version'.
* Add 'cpe-version' property '_meta' object.
v1.2
----
* Add 'system-type' property to the '_meta' object.
v1.1
----
* Add '_meta' object to define file type and schema version.
v1.0
----
* Initial schema.
Cray PE DL Plugin with Resiliency Support 22.06.1.2:
Release Date:
-------------
June 2022
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 21.04.1:
o Updated DL framework support
o Introduction of resiliency support
o BFloat16 data type support
Supported Configurations:
-------------------------
Shasta/EX: CPU and AMD GPU support with PrgEnv-gnu
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.6
* PyTorch v1.10.2
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
For info regarding use of the new resiliency feature, see the examples
and README.md in ${CRAYPE_ML_PLUGIN_BASEDIR}/examples/resiliency
Sample Installation instructions:
---------------------------------
Note: Package must be installed or sym linked in the default /opt/cray/pe path.,
ie: use of the --prefix flag for rpm is not supported.
rpm -ivh craype-dl-plugin-ftr-22.06.1.2*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
Shasta/EX:
module load craype-dl-plugin-ftr/22.06.1.2
Certain components, files or programs contained within this package or
product are Copyright 2017-2022 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 21.02.1.3:
Release Date:
-------------
February 2021
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 20.10.1:
o Bug fixes for CUDA 11 support and pip install of include source dist
o Initial CUDA 11.1 support
o Updated DL framework support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC CLE 7: CPU and GPU support
Shasta: CPU-only support
Apollo: CPU-only support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.4
* PyTorch v1.7.1
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using Tensorflow 1.14 binaries distributed by Google and Intel require portions of the DL
Plugin to be compiled with gcc 4.8. If using the included source distribution of the
DL Plugin to install the Python packagesinto a given Python installation, gcc 4.8
will need to be used to install said packages, assuming Google and Intel distributed
Tensorflow 1.14 binaries are used. For TensorFlow 1.15 and greater, use of gcc 7.x
is required instead.
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-21.02.1.3*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/Shasta:
module load craype-dl-plugin-py3/21.02.1.3
CS:
module load craype-dl-plugin-py3/openmpi/21.02.1.3
module load craype-dl-plugin-py3/mvapich/21.02.1.3
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 22.06.1.2:
Release Date:
-------------
June 2022
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 22.04.1.1:
o Updated DL framework support
o BFloat16 data type support
o ROCm 5.x support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC CLE 7: CPU and GPU support
Shasta: CPU-only support
Apollo: CPU-only support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.6
* PyTorch v1.10
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using Tensorflow 1.14 binaries distributed by Google and Intel require portions of the DL
Plugin to be compiled with gcc 4.8. If using the included source distribution of the
DL Plugin to install the Python packagesinto a given Python installation, gcc 4.8
will need to be used to install said packages, assuming Google and Intel distributed
Tensorflow 1.14 binaries are used. For TensorFlow 1.15 and greater, use of gcc 7.x
is required instead.
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-22.06.1.2*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/Shasta:
module load craype-dl-plugin-py3/22.06.1.2
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 22.08.1:
Release Date:
-------------
August 2022
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 22.06.1.2:
o PyTorch Apex Amp Optimization Support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC: CLE 7 CPU and GPU support
EX: CPU and GPU support
Apollo: CPU-only support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.6
* PyTorch v1.10
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using Tensorflow 1.14 binaries distributed by Google and Intel require portions of the DL
Plugin to be compiled with gcc 4.8. If using the included source distribution of the
DL Plugin to install the Python packagesinto a given Python installation, gcc 4.8
will need to be used to install said packages, assuming Google and Intel distributed
Tensorflow 1.14 binaries are used. For TensorFlow 1.15 and greater, use of gcc 7.x
is required instead.
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-22.08.1*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/EX:
module load craype-dl-plugin-py3/22.08.1
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 22.09.1:
Release Date:
-------------
September 2022
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 22.08.1:
o Keras callbacks bug fixes
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC: CLE 7 CPU and GPU support
EX: CPU and GPU support
Apollo: CPU-only support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.6
* PyTorch v1.10
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using Tensorflow 1.14 binaries distributed by Google and Intel require portions of the DL
Plugin to be compiled with gcc 4.8. If using the included source distribution of the
DL Plugin to install the Python packagesinto a given Python installation, gcc 4.8
will need to be used to install said packages, assuming Google and Intel distributed
Tensorflow 1.14 binaries are used. For TensorFlow 1.15 and greater, use of gcc 7.x
is required instead.
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-22.09.1*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/EX:
module load craype-dl-plugin-py3/22.09.1
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 22.12.1:
Release Date:
-------------
December 2022
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 22.09.1:
o TF v2.9 Support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC: CLE 7 CPU and GPU support
EX: CPU and GPU support
Apollo: RHEL8.6 CPU and GPU support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.9
* PyTorch v1.10
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using Tensorflow 1.14 binaries distributed by Google and Intel require portions of the DL
Plugin to be compiled with gcc 4.8. If using the included source distribution of the
DL Plugin to install the Python packagesinto a given Python installation, gcc 4.8
will need to be used to install said packages, assuming Google and Intel distributed
Tensorflow 1.14 binaries are used. For TensorFlow 1.15 and greater, use of gcc 7.x
is required instead.
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-22.12.1*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/EX:
module load craype-dl-plugin-py3/22.12.1
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
Cray PE DL Plugin 23.09.1:
Release Date:
-------------
September 2023
Purpose:
--------
The following changes have been made since Cray PE DL Plugin 22.12.1:
o ROCm 5.3.x support
o TF v2.11 Support
o PT v1.12 Support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC: CLE 7 CPU and GPU support
EX: CPU and GPU support for both AMD and NVIDIA
Apollo: RHEL8.6 CPU and GPU support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.11
* PyTorch v1.12
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using TensorFlow, if you see an exception error related to apply_gradients() then
downgrade your keras installation version in your python environment.
pip install keras==2.10.0
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-23.09.1*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/EX:
module load craype-dl-plugin-py3/23.09.1
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
HPE Cray DL Plugin 24.03.1:
Release Date:
-------------
March 2024
Purpose:
--------
The following changes have been made since HPE Cray DL Plugin 23.09.1:
o AMD MI300A APU support
o TensorFlow v2.15 support
o PyTorch v2.0.1 support
o ROCm 6.0.x support
o Cray-mpich 8.1.27 support
o GCC 12.2.0 support
Supported Configurations:
-------------------------
CS: OpenMPI 4.0.2 and cray-mvapich 2.3.2 or newer with CPU and GPU support
XC: CLE 7 CPU and GPU support
EX: CPU and GPU support for both AMD and NVIDIA
Apollo: RHEL8.6 CPU and GPU support
The following Deep Learning frameworks and versions are supported:
* TensorFlow v2.15
* PyTorch v2.0.1
Documentation:
--------------
For more information see the intro_dl_plugin man pages.
Known Issues:
-------------
* Using TensorFlow, if you see an exception error related to apply_gradients() then
downgrade your keras installation version in your python environment.
pip install keras==2.10.0
Sample Installation instructions:
rpm -ivh craype-dl-plugin-py3-24.03.1*.x86_64.rpm
The "*" in the install command represents date and hash specific information.
Modulefile:
-----------
XC/EX:
module load craype-dl-plugin-py3/24.03.1
CS:
module load craype-dl-plugin-py3/openmpi/21.04.1
module load craype-dl-plugin-py3/mvapich/21.04.1
Certain components, files or programs contained within this package or
product are Copyright 2017-2021 Hewlett Packard Enterprise Development LP.
CrayPE Targets 1.15.0
================================================================================
Release Date:
--------------------------------------------------------------------------------
Nov, 2024
Purpose:
--------------------------------------------------------------------------------
Adds Intel Emerald Rapids processor support and updates NVIDIA accelerators
Bugs fixed in this release:
--------------------------------------------------------------------------------
None
Dependencies:
--------------------------------------------------------------------------------
The CrayPE Targets 1.15.0 release is dependent on the following
software products:
CrayPE
set_default_3
lmod_scripts
Documentation:
--------------------------------------------------------------------------------
See manpages for cc, CC, ftn, intro_craype-api, intro_hugepages and pkg-config
See section 2.6 Using Targeting Modules of the Cray Programming Environment
User's Guide (S-2529-116)
See http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh craype-targets-ex-1.15.0-202409191657.20a5fa1f4e679-0.ex.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.15.0-tcl
/opt/cray/pe/admin-pe/set_default_files/set_default_craype-targets_1.15.0-lua
Product description:
--------------------------------------------------------------------------------
CrayPE Targets contains the modules for CrayPE targets.
TCL Modules - craype-accel-host craype-accel-amd-gfx90a craype-accel-amd-gfx908 craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-hugepages2M craype-hugepages4M craype-hugepages8M craype-hugepages16M craype-hugepages32M craype-hugepages64M craype-hugepages128M craype-hugepages256M craype-hugepages512M craype-hugepages1G craype-hugepages2G craype-arm-grace craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-spr craype-x86-spr-hbm craype-x86-trento craype-x86-turin craype-x86-genoa craype-network-none craype-network-ofi craype-network-ucx
Lmod Modules - craype-accel-host craype-accel-amd-gfx90a craype-accel-amd-gfx908 craype-accel-amd-gfx940 craype-accel-amd-gfx942 craype-accel-nvidia70 craype-accel-nvidia80 craype-accel-nvidia90 craype-hugepages2M craype-hugepages4M craype-hugepages8M craype-hugepages16M craype-hugepages32M craype-hugepages64M craype-hugepages128M craype-hugepages256M craype-hugepages512M craype-hugepages1G craype-hugepages2G craype-arm-grace craype-x86-milan craype-x86-milan-x craype-x86-rome craype-x86-spr craype-x86-spr-hbm craype-x86-trento craype-x86-turin craype-x86-genoa craype-network-none craype-network-ofi craype-network-ucx
Copyright 2013-2023 Hewlett Packard Enterprise Development LP
CDEUX driver (craype) 2.7.33 - 4
==============
Release Date:
--------------
Nov 2024
Purpose:
--------
The Cray Development Environment User eXperience driver (CDEUX) (craype)
provides a common set of drivers for all CPE programming environments,
notably the C/C++ (cc/CC) and Fortran (ftn) languages.
New CDEUX driver (craype) features for HPE Cray EX and Apollo systems:
- Support for newer Red Hat Enterprise Linux versions
Product and OS Dependencies:
----------------------------
The CDEUX driver (craype) 2.7.33 release is supported on the following
HPE systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Documentation:
---------------
See manpages for cc, CC, ftn, and intro_craype-api.
See the pkg-config manpage or
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Product description:
--------------------
CrayPE contains drivers, cc, CC, and ftn to compile for all CPE
Programming Environments.
Certain components, files or programs contained within this package or product
are Copyright 2013-2024 Hewlett Packard Enterprise Development LP.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2023 Hewlett Packard
Enterprise Development LP.
Craypkg-gen 1.3.34
==============
Release date
------------
September 2024
Purpose
-------
Bug fix release.
Bugs fixed in this release
--------------------------
- Remove nvhpc modulefile
Dependencies
------------
The craypkg-gen 1.3.34 release is supported on the following HPE
Cray systems:
- Cray EX systems SLE 15.0 or later and RHEL 8.0 or later.
Driver support for integrating Third Party C, C++, and Fortran libraries
through .pc files using pkg-config is used in CrayPE 2.x and later.
Limitation
----------
- Library dependencies for static libraries are not added to the .pc files
for keywords Requires.private and Libs.private. A warning is issued by
the craypkg-gen tool to advise users to add this information to the
libraries .pc files.
- RPM limits packages to 4GB
Documentation
-------------
Man pages for craypkg-gen are found by executing `module load craypkg-gen`
and then `man craypkg-gen`. See
http://www.freedesktop.org/wiki/Software/pkg-config for a pkg-config
introduction.
Examples for creating modulefiles for Intel, PGI and Python are included in
the craypkg-gen ‘doc’ directory:
/opt/cray/craypkg-gen/1.3.34/doc/intel_example.txt
/opt/cray/craypkg-gen/1.3.34/doc/pgi_example.txt
/opt/cray/craypkg-gen/1.3.34/doc/python_example.txt
Example:
- As an example, the Intel 16.0.3.210 compiler was recently released.
After installing the compiler the administrator creates a modulefile for
this release by executing the following commands:
# module load craypkg-gen
# craypkg-gen -m /opt/intel/compilers_and_libraries_2016.3.210
This version of the Intel compiler is made default by executing the
command:
# /opt/admin-pe/set_default_craypkg/set_default_intel_16.0.3.210
Installation instructions
-------------------------
rpm -ivh craypkg-gen-1.3.34-1.3.34.21.g61dc039-1.sles15sp6.noarch.rpm
To change the product version to default after installation:
/opt/cray/pe/admin-pe/set_default_files/set_default_craypkg-gen_1.3.34
Product description
-------------------
The craypkg-gen 1.3.34 utility provides the system administrator
a tool to integrate third party software with the Cray software stack.
Craypkg-gen assists with integration by creating .pc files for C, C++, and
Fortran libraries, pkg-config enabled modulefiles and RPMs.
The workflow for using craypkg-gen is
1) Build the open source software
2) Create .pc files for libraries
3) Create pkg-config enabled modulefiles
4) Customize pkg-config and modulefiles if needed
Certain components, files or programs contained within this package or product
are Copyright 2013-2024 Hewlett Packard Enterprise Development LP.
cray-cti 2.19.0
================================================================================
*Released: October 2024*
Product Description
---------------------------
- Cray Common Tools Interface (CTI) is a library that abstracts debugger tool support
to a common interface regardless of the underlying work load manager. It facilitates
the staging of files and the launch of tool daemons on the compute nodes associated
with a parallel job. Options and interfaces can be found in the cti(1) and cti(3)
manpages.
Known Issues
---------------------------
- Race condition workaround for PALS 1.2.3 in CTI 2.17.0 (22.11). In PALS 1.2.3, there
is a race condition between the tool launcher releasing a job from the startup barrier
and the job actually getting to the startup barrier. This can result in the job receiving
the startup barrier release signal before it actually arrives there, resulting in the job
getting stuck in the barrier. As a workaround, the environment variable
CTI_PALS_BARRIER_RELEASE_DELAY can be set to add a delay between job startup and barrier
release. If set to a positve integer n, CTI will wait n seconds between starting a
job and releasing it from the barrier on PALS. A delay as small as one second works in
most cases.
Notes
---------------------------
- CTI 2.17.1 (PE 22.12) contains a new feature, file deduplication, for Slurm and PALS
workload managers. If enabled, CTI will run a check on compute nodes to determine if files
can be excluded from the shipped package. This can significantly improve application startup
time. To enable, set the environment variable CTI_DEDUPLICATE_FILES=1.
Changelog
---------------------------
=======================================================================
## [2.19.0] - 2024-09-10 (24.10)
=======================================================================
### Bug Fixes
* CPE-5658: Fix dropping output with `flux attach`
* PE-54406: Close stdin on Flux output redirect if unused
* PE-55244: Get PBS job comment for failed job
* PE-54822: Disable Slurm sending libraries for backend daemon
* PE-54872: Switch from squeue to sacct to get all hetjob IDs
* PE-52465: Don't add quotes to LD_PRELOAD
* PE-54079: Fix unreliable Flux application output
* PE-53554: Allow launch if debug log directory doesn't exist
### Features
* Support rhel 8.10
* Build on sles15sp6 and rhel 9.4
* PE-49731: Implement PALS non-MPI barrier launch function
* Add lock to C interface, basic multithread test
* PE-53555: Parse multiple Flux job ID formats
* PE-52995: Support Flux 0.60.0
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [2.18.3] - 2024-02-15 (24.03)
=======================================================================
### Bug Fixes
* PE-52423: Fix deduplication check for PALS
* PE-52423: Disable local launch for PALS
* PE-52540: Always include rank 0 in Flux launch
* PE-51694: Flux: fix job layout case and file deduplication
* PE-51955: Only rebuild checksum if input files changed
* PE-51495: Fix Slurm isRunning for stopped srun and backgrounded sattach
* PE-51694: Fix Flux implementation for 0.57.0
* PE-51193: Support rank remapping in PALS backend
### Features
* PE-48498: Accept PALS attach in form pbs_job_id:pals_apid
=======================================================================
## [2.18.2] - 2023-11-3 (23.12)
=======================================================================
### Bug Fixes
* Copy rank list in cti_getAppBinaryList
* PE-49914: Verify cminfo address on HPCM systems
* PE-49857: Narrow Slurm multi-cluster check
* PE-49079: Support attach for non-MPI PALS applications
* PE-49585: Detect HSN address on HPCM Slurm and use node name provided by Slurmd
### Features
* PE-50581: Support Eproxy/Slurm systems
* PE-50356: Automatically set Slurm daemon GPU GRES
* PE-50201: Add CTI_SSH_PORT option for SSH implementation
* PE-49299: Slurm MPMD launch and attach support
* Move to gcc toolset 12
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-cdst-support >= 2.14, < 3 installed
- cray-dyninst 12.3.0 or later installed
Documentation
---------------------------
- Currently the only documentation available is found in common_tools_fe.h, common_tools_be.h,
and the tests in the 'tests' directory.
Installation Instructions
---------------------------
- rpm -ivh cray-cti-2.19.0-20240918201207_f49a93122848-123.sles15sp6.x86_64.rpm
To make cray-cti 2.19.0 the default version of cray-cti, execute:
/opt/cray/admin-pe/set_default_files/set_default_cray-cti-2.19.0
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2024 Hewlett Packard Enterprise Development LP. SPDX-License-Identifier: Linux-OpenIB
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/cti/2.19.0/ATTRIBUTIONS_cti.txt
Cray DSMML 0.3.0:
==========================
Release Date:
-------------
March, 2024
Product Information:
--------------------
DSMML is a stand-alone memory management library for maintaining distributed
shared symmetric memory heaps for top level PGAS languages and libraries like
Coarray Fortran, UPC, and OpenSHMEM. DSMML allows user libraries to create
multiple symmetric heaps and share information with other libraries. Through
DSMML, we could extract interoperability between PGAS programming models.
Announcements, release informations, supported environments, and backward
compatibility informations about this product can be viewed in the following
location: https://pe-cray.github.io/cray-dsmml/
Purpose:
--------
Cray DSMML 0.3.0 supports the following features:
- Create symmetric heap segments for being used by PGAS languages and
libraries
- Allows options to allocate, deallocate memory buffers from previously
created symmetric heap segments
- Enables sharing information about the symmetric heap segments between
different programming models
- Added support for shared symmetric heap (SSHEAP) that can be used to
provide enhanced SMP data transport in user-libraries like SHMEM, CAF, UPC
The following features are fixed in Cray DSMML 0.3.0 when compared
to Cray DSMML 0.2.2:
- Add support for the library for AARCH64 processor based platforms
- Internal bug fixes involving hugepage cleanups
Refer intro_dsmml(3) manpage for more information on the supported features
and syntax for different routines
Product and OS Dependencies:
----------------------------
The Cray DSMML 0.3.0 release is supported on the following
Cray systems:
* HPE Cray EX systems with CLE
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.3 |
----------------------------+---------------------+
One or more compilers:
* AOCC 2.2 or later
* CCE 9.1 or later
* GNU 9.1 or later
* Intel 19.0 or later
* Nvidia 20.7 or later
Documentation:
--------------
Use the Cray DSMML man pages for more information on the library
functions and use intro_dsmml(3) man page for general information.
Use https://pe-cray.github.io/whitepapers/ for access to different
Cray DSMML specific whitepapers
Announcements, release informations, supported environments, and backward
compatibility informations about this product can be viewed in the following
location: https://pe-cray.github.io/cray-dsmml/
Modulefile:
-----------
module load cray-dsmml/0.3.0
Certain components, files or programs contained within this package or
product have the following Copyright:
Copyright 2018-2021 Hewlett Packard Enterprise Development LP.
cray-dyninst 12.3.4
================================================================================
*Released: September 2024*
Product Description
---------------------------
- cray-dyninst provides tools for binary instrumentation, analysis, and modification.
Changelog
---------------------------
=======================================================================
## [12.3.4] - 2024-08-30 (24.09)
=======================================================================
### Features
* Support rhel 8.10
* Build on sles15sp6 and rhel9.4
=======================================================================
## [12.3.2] - 2024-04-22 (24.05)
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [12.3.1] - 2023-09-25 (23.10)
=======================================================================
### Features
* Use gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- https://github.com/dyninst/dyninst
Installation Instructions
---------------------------
- rpm -ivh cray-dyninst-12.3.4-20240918205943_0aea99d36573-57.sles15sp6.x86_64.rpm
To make this the default version of cray-dyninst, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-dyninst_12.3.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/dyninst/12.3.4/ATTRIBUTIONS_dyninst.txt
FFTW 3.3.10.9
============
Purpose:
--------
This Cray FFTW 3.3.10.9 release is supported on HPE/Cray EX and
HPE/Cray XD/Apollo systems with x86-64 CPUs. Cray FFTW is supported
on the host CPU but not on the accelerator of HPE/Cray systems.
The Cray FFTW 3.3.10.9 release provides the following:
- Compiler and dependency updates
See the Product and OS Dependencies section for details.
Product and OS Dependencies:
----------------------------
This Cray FFTW 3.3.10.9 release is supported on these HPE/Cray systems:
- HPE/Cray EX Systems with SLES 15 SP5 or later, RHEL 8.10, or RHEL 9.4 based OS
- HPE/Cray XD/Apollo Systems with RHEL 8.10 or RHEL 9.4 based OS
This Cray FFTW 3.3.10.9 release requires the following software products:
craype 2.7.32 or later
cray-mpich 8.1.30 or later
One or more of the following major compiler versions:
CCE 18
GCC 13
AOCC 4
AMD (ROCm) 6
Intel 2024
Notes and Limitations:
----------------------
Starting with cray-fftw/3.3.6.1 the fftw module has been renamed from fftw
to cray-fftw.
Documentation:
--------------
http://www.fftw.org/index.html#documentation
See the intro_fftw3 manual page for additional information.
Modulefile:
-----------
module load cray-fftw
Installation
------------
To install the rpm, execute:
rpm -ivh cray-fftw-3.3.10.9-202409181931.fdd21c9755807-1.sles15sp5.x86_64.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_fftw_3.3.10.9
Certain components, files or programs contained within this package or
product are Copyright 2011-2024 Hewlett Packard Enterprise Development LP
forgesup 23.1.2
================================================================================
*Released: May 2024*
Product Description
---------------------------
- Provides the HPE Forge support package which contains modulefiles (tcl & lua),
set_default files, and content projection files for Forge 23.1.2.
- The only supported install directory for forgesup is /opt/cray/pe.
- The only supported install directory for Lenaro forge is /opt/forge.
- Drop the license file into: /opt/forge/23.1.2/
- Currently, forge-23.1.2 by default drops logfiles into the $HOME directory
which is not projected on a EX system. In order for forge-23.1.2 to successfully
launch an application on EX perform the following configuration:
export ALLINEA_SESSION_PATH=ProjectedDirectory
e.g:
export ALLINEA_SESSION_PATH=/lus/USERNAME
Changelog
---------------------------
=======================================================================
## [23.1.2] - 2024-04-26 (24.05)
=======================================================================
### Features
* PE-53213: Updated Forgesup to support Forge 23.1.2
=======================================================================
## [23.1] - 2024-02-29 (24.03)
=======================================================================
### Features
* PE-49958: Implemented Auto-gen release notes/changelog tool
* Updated supported version to 23.1
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- This forgesup 23.1.2 package has a dependency on Forge 23.1.2.
Documentation
---------------------------
- The Forge user guide can be found in /opt/forge/23.1.2/doc/userguide-forge.pdf
- The Forge release notes can be found in /opt/forge/23.1.2/doc/RELEASE-NOTES
- The Forgesup release notes can be found in /opt/cray/pe/forgesup/23.1.2/
Installation Instructions
---------------------------
- rpm -ivh forgesup-23.1.2-20240513190506_dd371b3b512d-1.sles15sp5.x86_64.rpm
To make forge 23.1.2 the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_forge_23.1.2
Legal Notices
---------------------------
Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
gdb4hpc 4.16.3
================================================================================
*Released: October 2024*
Product Description
---------------------------
- gdb4hpc is a GDB-based parallel debugger used to debug applications compiled with
CCE, AOCC, GNU, and Intel Fortran, C and C++ compilers. It allows programmers to
either launch an application or attach to an already running application that
was launched on the system. Additionally, it provides comparative debugging
technology that enables programmers to compare data structures between two
executing applications. Comparative debugging should be used in conjunction
with the CCDB GUI tool accessed by loading the cray-ccdb module.
- Some features of gdb include:
* Command line parallel debugger allows for launching/attaching applications.
* Utilizes process sets to operate on a subset of application ranks.
* GDB-like feel, also implements a gdbmode to enable a true parallel gdb.
* GPU debugging is supported for OpenMP 4.0+ GPU directives; OpenMP 5.0 on AMD
and Nvidia GPU's.
* Workload manager support via Common Tools Interface (cray-cti).
Changelog
---------------------------
=======================================================================
## [4.16.3] - 2024-09-19 (24.10)
=======================================================================
### Bug Fixes
* CPE-5960: Fix failure to launch application when using certain acceleration runtimes
* No not generate missing MPI breakpoint if a program use mpi_init_thread
* PE-52432: Load MRNet filter library from complete path
* PE-54147: Use main function from debug information
* Fix printing std::unique_ptr with newer stdc++
* Fix print of character arrays shorted by set print elements
* Fix backend gdb crash on vector<vector<string>>
### Features
* CPE-615: Add python mode documentation
* CPE-2316: Add "what's new in 4.16.3" document
* CPE-633: support finish command in python mode
* CPE-2350: Autocomplete struct members for `print`
* PE-53102: Set python breakpoints and step/next in python
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-53101: Evaluate python statements with the print command
* PE-55035: Python mode and python backtraces
* PE-53105: Launch applications with the same syntax as an srun command
* PE-54824: Support non-MPI PALS launches
* PE-54073: Print job output on failed launch
* PE-53771: Pass arguments to launched app on the end of the launch command
=======================================================================
## [4.16.2] - 2024-05-2 (24.06)
=======================================================================
### Bug Fixes
* PE-52737: Fix backend crash when debugging Intel OneAPI GPUs
### Features
* PE-47910: Run job cleanup in background
* PE-53716: Added user guide for using the Python gdb extension
* PE-51960: Added support for rhel89/93 & gcc13
* PE-53828: Implement Flux attach
* Automatically load python extensions when debugger starts
* PE-53100: Support for aggregated gdb python extension commands py-print and py-locals if underlying gdb has python extensions loaded
* PE-53100: Support for aggregated gdb python extension commands py-bt, py-list, py-up, and py-down if underlying gdb has python extensions loaded
* Handle "~" in the --debug launch argument
* PE-52589: Tweak default assertion script behavior - now assertion scripts stop iff an assertion fails default
* PE-51936: Added tab completion for the print command
=======================================================================
## [4.16.1] - 2024-02-7 (24.03)
=======================================================================
### Bug Fixes
* PE-52387: Fix segfault from list command
* PE-51694: Fix occasional crash when operating on a subset of ranks
* PE-44112: Track job status while running for quicker timeout and exit
* Fix recursive source command behavior
* Properly format /csv output with data over 1 million items
* PE-51165: Query ZMQNet for correct rank and target PID
### Features
* PE-51935: Tab completion with file names when setting breakpoints
* PE-51935: Tab completion with function names when setting breakpoints
* PE-50319: Improve feedback when switching command modes
* PE-51749: Tab completion for help, set, show commands
* PE-51752: Moved vscode plugin to gdb4hpc and packaged executable
* PE-51598: Add save all command
* PE-51254: Save and restore assertion scripts and decompositions
* PE-51253: Save and restore breakpoints
* Update included hpcc_demo
* Add set print value-caching
* Save decomposition values as convenience variables
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- Type `man gdb4hpc` with the gdb4hpc module loaded to read the gdb4hpc(1) man page.
Simple usage examples are provided at the end.
Also, type `help` at the gdb4hpc command line for more information on commands.
Installation Instructions
---------------------------
- rpm -ivh gdb4hpc-4.16.3-20241007211728_0d207e436ee4-315.sles15sp6.x86_64.rpm
To make gdb4hpc 4.16.3 the default version of gdb4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_gdb4hpc_4.16.3
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/gdb4hpc/4.16.3/ATTRIBUTIONS_gdb4hpc.txt
# HDF5 1.14.3.3
## Purpose:
This HDF5 release contains the following:
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 9.4 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* AMD ROCm 6.2
* AOCC 4.2
* Intel OneAPI 2024.2.0
* RHEL gcc-toolset-13
## Product and OS Dependencies:
The HDF5 1.14.3.3 release is supported on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES and RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
## Notes and Limitations:
Users are encouraged to use the Cray compiler scripts (cc, ftn, CC) to include the HDF5 header files and link in the HDF5 libraries, rather than the HDF5 compiler scripts (h5cc, h5fc, h5c++) included in the release.
## Documentation:
http://www.hdfgroup.org/HDF5/doc/index.html
## Modulefile:
`module load cray-hdf5`
OR
`module load cray-hdf5-parallel`
## Product description:
HDF5 is a data model, library, and file format for storing and managing data. It supports an unlimited variety of datatypes, and is designed for flexible and efficient I/O and for high volume and complex data. HDF5 is portable and is extensible, allowing applications to evolve in their use of HDF5. The HDF5 Technology suite includes tools and applications for managing, manipulating, viewing, and analyzing data in the HDF5 format.
## Installation:
`rpm -ivh cray-hdf5-1.14.3.3-*-202409181934.85340b36f6da1.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_hdf5_1.14.3.3`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
Cray LibSci 24.11.0
=====================
Purpose:
--------
Cray LibSci 24.11.0 provides scientific libraries for Cray
HPC systems. Cray LibSci is supported on the host CPU but
not on the accelerator of these systems.
The Cray LibSci 24.11.0 release provides updated support for
the following:
* SLES15 SP6 (x86_64)
* AMD ROCm 6.2.1
* Intel oneAPI 2024.2.0
Cray LibSci 24.11.0 includes the following versions of publicly
available libraries:
* LAPACK 3.10.1 - For further information, see
http://www.netlib.org/lapack
* ScaLAPACK 2.2.0 - (Scalable LAPACK) For further information, see
http://www.netlib.org/scalapack.
* QDWH 2.0.0 KSVD 1.0.0 - Polar decomposition and SVD packages, see
https://github.com/ecrc/qdwh
https://github.com/ecrc/ksvd
Key Changes and Bugs Closed:
----------------------------
Changes in Cray LibSci 24.11.0
* Support for AMD MI300A and Turin
* Miscellaneous bug fixes
Changes in Cray LibSci 24.07.0
* Miscellaneous bug fixes
* Enabled module to set LD_LIBRARY_PATH when PE_LD_LIBRARY_PATH=system
* Removed Iterative Refinement Toolkit (IRT) support
Changes in Cray LibSci 24.03.0
* CAST-34956 - Lua module environment variable issue
Changed in Cray LibSci 23.12.5
* CAST-33777 - LibSci mutex contention issue
* Removed support for Intel KNL
Product and OS Dependencies:
----------------------------
The Cray LibSci 24.11.0 release requires the following:
* SLES 15 SP5/SP6 or RHEL 8.10/9.4
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 17.x or later (SLES)
* CCE 18.x or later (RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* AOCC 4.1.0 or later
* AMD ROCm 6.0.0 or later
* Intel 2023.2.0 or later
* Nvidia 23.11 or later (aarch64) and 23.3 or later (x86_64)
Notes and Limitations:
----------------------
OMP threaded versions:
The CrayPE 2.1.2 and later releases add support for link line generation
for the multi-threaded versions of the libsci library based on the OpenMP
flags the user specifies for each compiler:
* CCE by default links to the OpenMP LibSci library. CrayPE will link in
the serial version of LibSci when the CCE flag -hnoomp is used.
* GNU by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the GNU flag -fopenmp is used.
* INTEL by default links serial LibSci library. CrayPE will link in the
OpenMP version of LibSci when the INTEL flag -qopenmp is used.
Stack size limit:
The 'ulimit -s unlimited' system stack size setting is required for
cray-libsci on all supported Cray platforms. This is typically set as a
system default by admin but may otherwise need to be set at runtime.
Non-default dynamic linking:
When using a non-default version of cray-libsci with dynamic linking
users should set at runtime and at linktime after loading the desired
cray-libsci module--or set the equivalent for their linux shell:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci man page for additional information.
See the csmlversion man page for information to display version information
on the currently loaded scientific libraries.
Modulefile:
-----------
module load cray-libsci
Installation instructions:
--------------------------
LibSci is now packaged into separate compiler specific RPMs to allow
rpmbuild to correctly include compiler dependencies.
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2023
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
/opt/cray/libsci/24.11.0/ATTRIBUTIONS
Cray LibSci_ACC 24.11.0
=======================
Purpose:
--------
The Cray LibSci_ACC 24.11.0 release provides accelerated versions of
scientific libraries for HPE Cray systems with accelerators.
Product and OS Dependencies:
----------------------------
Cray LibSci_ACC 24.11.0 requires the following platform:
HPE Cray EX system with AMD MI250X
HPE Cray EX system with AMD MI300A
Cray LibSci_ACC 24.11.0 supports the following OS:
RHEL 8.10 x86_64
RHEL 9.4 x86_64
SLES 15 SP5 x86_64
SLES 15 SP6 x86_64
Notes and Limitations:
----------------------
LAPACK workspace calculations from other implementations or hard-coded
values may not be compatible with cray-libsci_acc. Workspaces reported from
a query to the corresponding cray-libsci_acc function should be used.
The current supported usecase is a one-rank to one-gpu mapping for apps.
Performance improvements can be achieved in programs calling cray-libsci_acc
subroutines by using pinned memory. See the intro_libsci_acc man page for
details.
Use of the aprun option "-cc none" or the srun option "--cpu_bind=none"
to disable core affinity is strongly suggested to maintain performance.
When using non-default cray-libsci_acc versions users should set equivalent
at runtime and linktime after loading the desired cray-libsci_acc module:
export LD_LIBRARY_PATH=$CRAY_LD_LIBRARY_PATH:$LD_LIBRARY_PATH
Documentation:
--------------
See the intro_libsci_acc man page for additional information.
Modulefile:
-----------
module load cray-libsci_acc
Sample Installation instructions:
---------------------------------
RPM install command:
rpm -ivh cray-libsci-acc-24.11.0-*.##ARCH##.rpm
The "*" in the install command represents compiler version combinations.
To make this the default version:
##PREFIX##/admin-pe/set_default_files/set_default_libsci_acc_24.11.0
License:
--------
Except for the third party modules and software licensed by HPE
through proprietary agreements, components, files or programs
contained within this package or product are Copyright -2024 Hewlett
Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in
this package are detailed in the file:
##PREFIX##/libsci_acc/24.11.0/ATTRIBUTIONS_libsci_acc_24.11.0.txt
Cray Lmod 8.7.37
================================================================================
Release Date:
--------------------------------------------------------------------------------
Nov, 2024
Purpose:
--------------------------------------------------------------------------------
Provide a Lmod 8.7.37 package for CPE customers
Bugs fixed in this release:
--------------------------------------------------------------------------------
N/A
Documentation:
--------------------------------------------------------------------------------
See CPE's Installation and User Guides for documentation.
Also see Lmod's official website: https://lmod.readthedocs.io
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 8.7.37 release is dependent on the following
software:
bc
sed
lua >= 5.3
lua-luaposix
lua-luafilesystem
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh cray-lmod-8.7.37-1.sles15sp6.x86_64.rpm
To make this the default version, update the symbolic "lmod" link
to the desired Lmod version directory.
Lmod Scripts 3.2.1
================================================================================
Release Date:
--------------------------------------------------------------------------------
December, 2023
Purpose:
--------------------------------------------------------------------------------
Updates package license.
Bugs fixed in this release:
--------------------------------------------------------------------------------
Documentation:
--------------------------------------------------------------------------------
See system Installation and User Guides for documentation
Dependencies:
--------------------------------------------------------------------------------
The Lmod Scripts 3.2.1 release is dependent on the following
software:
set_default_3
Lua
Lmod
Installation instructions:
--------------------------------------------------------------------------------
rpm -Uvh lmod_scripts-3.2.1-202408292053.acf0b96af7dbd-0.noarch.rpm
To make this the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_lmod_scripts_3.2.1
Product description:
--------------------------------------------------------------------------------
Contains Lua scripts which support the Cray implementation of Lmod
Copyright 2020-2023 Hewlett Packard Enterprise Development LP
modules 3.2.11.7
==================
Release Date:
-------------
Dec, 2023
Purpose:
--------
- Package dependency update
Documentation:
---------------
See man-pages for module and modulefile.
Cray MPICH 8.1.31:
=======================================
Release Date:
-------------
October 10, 2024
Purpose:
--------
Cray MPICH 8.1.31 is based upon ANL MPICH 3.4a2 with support for libfabric
and is optimized for the Cray Programming Environment.
Major Differences Cray MPICH 8.1.31 from the XC Cray MPICH include:
- Uses the new ANL MPICH CH4 code path and libfabric for network
support.
- Does not support -default64 mode for Fortran
- Does not support C++ language bindings
New Cray MPICH features for HPE Cray EX and Apollo systems:
- Starting from the 8.1.26 release, Cray MPICH supports the Intel Sapphire Rapids CPU HBM
processor architecture.
- On systems with AMD GPUs, Cray MPICH 8.1.26 supports all ROCm
versions starting from ROCm 5.0, including the latest ROCm 5.5.0
release.
The Cray MPICH 8.1.25 release and prior versions of
Cray MPICH are only compatible with ROCm versions up to (and
including) the ROCm 5.4.0 release.
- On Slinghot-11 systems, Cray MPICH uses the libfabric "cxi" provider
by default. On Slingshot-10 and Apollo systems, Cray MPICH uses the
libfabric "verbs;ofi_rxm" provider by default.
- Cray MPICH offers support for multiple NICs per node. Starting with
version 8.0.8, by default Cray MPICH will use all available NICs on
a node. Several rank-to-NIC assignment policies are supported. For
details on choosing a policy for assigning ranks to NICS, or for
selecting a subset of available NICs, please see the following
environment variables documented in the mpi man page.
MPICH_OFI_NIC_VERBOSE
MPICH_OFI_NIC_POLICY
MPICH_OFI_NIC_MAPPING
MPICH_OFI_NUM_NICS
- Enhancements to the MPICH_OFI_NIC_POLICY NUMA mode have been added.
Starting with version 8.0.14, if the user selects the NUMA policy,
the NIC closest to the rank is selected. A NIC no longer needs to
reside in the same numa node as the rank. If multiple NICs are
assigned to the same numa node, the local ranks will round-robin
between them. Numa distances are analyzed to select the closest NIC.
- On Slingshot-10 and Apollo systems, Cray MPICH supports runtime switching
to the UCX netmod starting with version 8.0.14. To do this load the
craype-network-ucx module and module swap between Cray-MPICH and
Cray-MPICH-UCX modules. For more information including relevant
environment variables reference the intro_mpi man page with the
Cray-MPICH-UCX module loaded.
- Lmod support for HPE Cray EX starting with Cray MPICH 8.0.16.
Key Changes and Bugs Closed:
----------------------------
Changes in Cray MPICH 8.1.31
Features and Bug Fixes:
- CPE-1426 - Add check for craype in the MPICH compiler wrappers
- CPE-5627 - Avoid creating a HWCOLL tree for a MPI internal temporary communicator
- CPE-5674 - Additional checks for NULL pointer in RMA managed memory support code
- PE-31920 - Add support for Slingshot 11 hardware collectives
- PE-51714 - Add gtl symlinks to mpich libdirs
- PE-54333 - Bugfix for MPI-IO timers on aarch64
- PE-54675 - MPI-IO: Check for NULL filename in ad_cray MPI_File_open()
Product and OS Dependencies:
----------------------------
The Cray MPICH 8.1.31 release is supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product and OS Dependencies by network type:
--------------------------------------------------+
| Shasta |
----------------------------+---------------------+
craype | >= 2.7.6 |
----------------------------+---------------------+
cray-pals | >= 1.0.6 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.9.0 |
----------------------------+---------------------+
One or more compilers:
* AMD ROCM 6.0 or later
* AOCC 4.1 or later
* CCE 17.0 or later
* GNU 12.3 or later
* Intel 2022.1 or later
* Nvidia 23.3 or later
Notes and Limitations:
----------------------
Limitations in Cray MPICH 8.1.31:
- Cray MPICH 8.1.31 can support only ~2040 simultaneous MPI
communicators. This limit is less the XC Cray MPICH limit of
~4090 simultaneous communicators. Cray intends to raise the
limit in a future release of Cray MPICH for Shasta to at least
the XC limit.
Documentation:
--------------
For more information see the intro_mpi man page.
Modulefile:
-----------
module load cray-mpich/8.1.31
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright -2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/mpich/8.1.31/ATTRIBUTIONS
Copyright -2024 Hewlett Packard Enterprise Development LP
Copyright 2022-2024 Hewlett Packard Enterprise Development LP
Product Release Information
================================================================================
Product identification:
-----------------------
HPE Cray MPIxlate: version 1.0.6 (built on 2024-10-11T21:12:12Z from b8b8498)
Purpose:
--------
HPE Cray MPIxlate enables applications compiled using an MPI library that
is not binary compatible with HPE Cray MPI, to be run without recompilation
on supported HPE platforms.
Warnings & Limitations:
-----------------------
- See NOTES in mpixlate(1)
Changes from previous release:
------------------------------
- New features:
* None
- Defects Fixed:
* None
Product dependencies:
---------------------
cray-mpich[-ucx] >= 8.1.31
Documentation:
--------------
mpixlate(1)
Environment Modules
-------------------
module load cray-mpixlate/1.0.6
================================================================================
cray-mrnet 5.1.4
================================================================================
*Released: September 2024*
Product Description
---------------------------
- MRNet is a customizable, high-performance software infrastructure for
building scalable tools and applications. It supports efficient
multicast and data aggregation functionality using a tree of processes
between the tool's front-end and back-ends. MRNet-based tools may use
these internal processes to distribute many important tool activities,
for example to reduce data analysis time and keep tool front-end loads
manageable.
MRNet-based tool components communicate across logical channels called
streams. At MRNet internal processes, filters are bound to these streams to
synchronize and aggregate dataflows. Using filters, MRNet can efficiently
compute averages, sums, and other more complex aggregations and analyses
on tool data. MRNet also supports facilities that allow tool developers
dynamically load new tool-specific filters into the system.
Changelog
---------------------------
=======================================================================
## [5.1.4] - 2024-08-20 (24.09)
=======================================================================
### Features
* Build rpms for rhel 8.10
* Build on rhel 9.4 and sles15sp6
=======================================================================
## [5.1.3] - 2024-04-22 (24.05)
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
=======================================================================
## [5.1.2] - 2023-09-25 (23.10)
=======================================================================
### Features
* Use gcc toolset 12 on redhat
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-mrnet-5.1.4-20240918212944_6215112f9656-45.sles15sp6.x86_64.rpm
To make cray-mrnet 5.1.4 the default version of cray-mrnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-mrnet_5.1.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/mrnet/5.1.4/ATTRIBUTIONS_mrnet.txt
# NetCDF 4.9.0.15
## Purpose:
This NetCDF release contains the following:
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 9.4 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* AMD ROCm 6.2
* AOCC 4.2
* Intel OneAPI 2024.2.0
* RHEL gcc-toolset-13
## Product and OS Dependencies:
The NetCDF 4.9.0.15 release is supported on the following systems, requiring the following software products:
* Cray HDF5 1.14.3.*
* CrayPE 2.1.2 or later
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES and RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
Unidata now packages Netcdf-4 and legacy Netcdf-3 separately. HPE has decided not to continue supplying the legacy Netcdf-3 package. Due to CCE changes a version of netcdf built with "-sreal64" is neither needed nor provided.
NetCDF is supported on the host CPU but not on the accelerator.
## Documentation:
http://www.unidata.ucar.edu/software/netcdf/docs
## Modulefile:
`module load cray-netcdf`
OR
`module load cray-netcdf-hdf5parallel`
## Product Description:
NetCDF (network Common Data Form) is a set of interfaces for array-oriented data access and a freely-distributed collection of data access libraries for C, Fortran, C++, Java, and other languages. The netCDF libraries support a machine-independent format for representing scientific data. Together, the interfaces, libraries, and format support the creation, access, and sharing of scientific data.
## Installation:
`rpm -ivh cray-netcdf-4.9.0.15-*202408301459.56ee3555db9bb-32.sles15sp6.x86_64.rpm`
The "*" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_netcdf_4.9.0.15`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
cray-papi
=================
Release date:
-------------
November 2024
Package:
--------
cray-papi-7.1.0.4-202408292039.f388603a41f63-1 x86_64
Purpose:
--------
New version of papi 7.1.0.4 release 1
Documentation:
--------------
Overview: https://github.com/icl-utk-edu/papi
Web Site: https://icl.utk.edu/papi
Product description:
--------------------
PAPI aims to provide the tool designer and application engineer with a
consistent interface and methodology for use of the performance counter
hardware found in most major microprocessors. PAPI enables software
engineers to see, in near real time, the relation between software
performance and processor events.
Dependencies:
-------------
For a list of software used when validating this version of
PAPI on Cray and HPE systems, see the HPE Cray Programming
Environment release announcements.
Copyright 2015-2017,2019-2024 Hewlett Packard Enterprise Development LP
# Parallel NetCDF 1.12.3.15
## Purpose:
This Parallel NetCDF release contains the following:
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 9.4 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* AMD ROCm 6.2
* AOCC 4.2
* Intel OneAPI 2024.2.0
* RHEL gcc-toolset-13
See the Parallel NetCDF documentation for details and usage information.
## Product and OS Dependencies:
This Parallel NetCDF 1.12.3.15 release is supported on on the following systems, requiring the following software products:
* CrayPE 2.1.2 or later
* CrayPE 2.1.2 or later
* SLES 15 SP5 (x86_64)
* SLES 15 SP6 (x86_64)
* RHEL 8.10 (x86_64)
* Apollo RHEL 8.10 (x86_64)
* RHEL 9.4 (x86_64)
* cray-mpich/8.1.0 or later
Supported on the following HPE systems:
* HPE Cray EX systems with CLE
* HPE Cray XD systems with CLE
One or more of the following compiler major versions:
* CCE 18.x or later (SLES and RHEL)
* GCC 12.3 or later (SLES)
* gcc-toolset-10.3/11.2/12.2 (RHEL 8.10)
* gcc-toolset-11.2/12.2/13.1 (RHEL 9.4)
* AOCC 4.2.0 or later
* AMD ROCm 6.2.1 or later (SLES and RHEL) or AMD ROCm 6.2 or later (Apollo RHEL 8.10)
* Intel 2024.2.0 or later
## Notes and Limitations:
For certain F77 source files, when compiling with `gcc/10+`, it may be necessary to configure/compile with:
`export FCFLAGS="-fallow-argument-mismatch"`
`export FFLAGS="-fallow-argument-mismatch"`
This will turn mismatch errors between actual and dummy argument lists to warnings. See:
https://github.com/Unidata/netcdf-fortran/issues/212
https://gcc.gnu.org/gcc-10/changes.html
## Documentation:
https://parallel-netcdf.github.io/wiki/Documentation.html
## Modulefile:
`module load cray-parallel-netcdf`
## Product Description:
Parallel NetCDF is a library providing high-performance I/O while maintaining file-format compatibility with Unidata's NetCDF.
## Installation:
`rpm -ivh cray-parallel-netcdf-1.12.3.15-*202409181646.e4bd95c9c3df5.@ARCH@.rpm`
The "`*`" in the install command represents compiler version combinations.
To make this the default version, execute:
`/opt/cray/pe/admin-pe/set_default_files/set_default_parallel-netcdf_1.12.3.15`
Certain components, files or programs contained within this package or product are Copyright 2019-2024 Hewlett Packard Enterprise Development LP.
Perftools 24.11.0
=================
Release Date: Novemer, 2024
Purpose:
========
This is a feature and bugfix release for the following systems:
- HPE Cray EX and HPE Cray Supercomputer Systems with HPCM
- HPE Cray EX and HPE Cray Supercomputer Systems with CSM
- HPE Apollo 2000 Gen 10 Plus Systems (x86)
Key enhancements or changes from the previous release: <REVIEW>
======================================================
o Add support for ROCm 6.2.0
o Add support for CUDA 12.5
o Upgrade to PAPI 7.1.0.4
o Upgrade to DWARF 0.11.0
o Second GA release for Apprentice 3
Bugs Fixed: <REVIEW and TRIM for relevancy, REMOVE ticket number>
===========
o CAST-36691 5UF209HRVG - Perftools on Fortran w/ MI100
o CAST-36503 Cray Perftools 23.12 - User Section - elevate
o CAST-36251 Crash in Cray Perftools 23.03 - elevated
o CAST-35795 Fatal pat_build error when a binary is linked to a library whose path contains the word perftools
o CAST-35428 Craypat-instrumented app segfaults
o CAST-32364 CUDA code instrumented with perftools runs into a Fatal error in PMPI_Barrier
o CAST-28839 (OLCFDEV - 510) link error when loading perftools-lite-gpu
o CAST-26638 [rznevada] perftools hipcc options causes linker failure with -fgpu-rdc
o CPE-6002 Selected MPI wrapper entry points require Fortran character string length argument
o CPE-5793 Support Uncore events for Intel Sapphire Rapids and Icelake processors
o CPE-5786 Use of pat_opts/pat_build with non-MPI program results in undefined PMPI_Query_thread
o CPE-5751 App3: Fix mac build failure
o CPE-5619 Verify perftools python3.12 support
o CPE-5567 App3: clicking callpath results in core dump
o CPE-5488 Add hipExtLaunchKernel wrapper
o PE-55496 pat_build -g ! syntax does not disable tracing group when group is part of a larger trace group
o CPE-1172 conda3.10+python tracing+unset PYTHONPATH: no site module import
o CPE-1288 App3: Fix scrolling in callgraph
o CPE-1273 App3: Hammer in Activity graph in app3..
o CPE-325 perftools-base/feature_pre_rocm_6.2.13620: pat[FATAL][11]: __pat_dso_ra_to_dso_ranges: Failed to find address 0 in dsos!
o PE-55299 fix aarch64 builds
o PE-55290 Fails to build a program with PrgEnv-gnu and perftools-lite
o PE-54970 fabric trace group segfaults
o PE-54803 perftools/24.07.0: MI300 incorrectly identified as Antero on RH/8.10
o PE-54476 multiple versions of Mac desktop installer going into rpm
o PE-54428 function search does not work in timeline view app3
o PE-54425 perftools/24.07.0: tealeaf fails on MI300 on snowdon with perftools-lite
o PE-54411 'pat_build -S' triggers unjustified runtime error 'Cannot call MPI_INIT or MPI_INIT_THREAD more than once' when running instrumented binary
o PE-54409 perftools/24.07.0: no installers are available in desktop_installers
o PE-54390 Crash on remote experiment from Mac client
o PE-54368 lib_pat_base.so of perftools/23.09.0 has undefined symbol __pat_hip_util_report_versions
o PE-54366 CRAYPAT_LD_LIBRARY_PATH wrong in perftools-base module 23.05.0 and 23.09.0
o PE-54357 App3: Hide and seek flamegraph
o PE-54134 perftools/24.03.0 release notes say Development version of PerfTools.
o PE-54034 PerfTools RHEL 9.3 aarch64 builds fail
o PE-54008 Selecting a region in the timeline view does not shade the entire selection
o PE-53874 App3: Fit and finish work on Flamegraph
o PE-53696 flame graph selection is getting stuck
o PE-53686 The selection inside the flame graph seems to be one row low.
o PE-53668 perftools/24.03.0: segfault with aocc tracing -O1 or greater
o PE-52622 perftools/24.03.0: -g!acc doesn't work for disabling ACC
o PE-52515 App3: find glib-compile-resources on windows.
o PE-52373 perftools/24.03.0: warning misleading for SP4 + ROCM/6.0.0
o PE-51866 Perftools-lite profile Lustre File Information has all zeros in OST list
o PE-51709 CPE Docs: man/rst mismatch pat_api
o PE-51599 new develop versions not getting installed on pinoak
o PE-50818 perftools/23.12.0.1: Grace sampling counter collection fails on blancapeak nodes on snowdon
o PE-50769 Some CrayPat 'acc' source files should be renamed to contain 'cuda'
o PE-49683 perftools/23.09.0: all cp2k experiments fail with: duplicate MPI_INIT with libunwind
o PE-49558 Properly guard tracing file operations
o PE-49339 Upstream PAPI CUDA: Updated component returns default for number of counters
o PE-44960 pat_report/23.02.0: trim out __pat_memset
o PE-43727 perftools/22.12.0: Consider increasing PAT_RT_ACC_CID_TO_EID_BUFFER_SIZE default
o PE-43510 App2 Remote Host Crash
o CPE-4020 UTK PAPI: _papi_hwi_native_name_to_code sensitivity with delay init components
o PE-42895 perftools/22.09.0: intel jobs on pea2k occassionally fail with inet_connect failed
o PE-40597 Several ETC functions in poca's profile should be hidden
o PE-37927 QEMU, SVE: Illegal instruction in fte_opt/incld05
o CPE-4544 perftools/20.10.0: any tracing experiment causes rajaperf to segfault
o PE-24392 perftools and perftools-lite-loops do not get loops within important nekbone routine
Notes:
======
o This release of Perftools only supports ROCm 6.1.0 and later
o This release of Perftools only supports CUDA 12.0 and later
Known Issues: <REVIEW and TRIM for relevancy, REMOVE ticket number>
=============
o CAST-36837 CPE 24.07 : Missing perftools documentation
o CAST-36364 Apps instrumented with perftools-lite-gpu get an MPI error
o CAST-36096 perftools/24.07.0: WRF hits SEGV when callstack_mode=libunwind
o CAST-32297 RFE: Apprentice2's Mosaic report shows 'No point-to-point data found' for shmem code
o CPE-6028 Perftools/24.11: sampling fails with GPU codes on bardpeak nodes(RH9.4) on snowdon
o CPE-5972 Perftools/24.11: several compilers fail with PAT_RT_ACC_RECORD=-1
o CPE-5955 venv site-packages not being added to sys.path
o CPE-5771 App3: in mac package, help pdf isn't end up in package
o CPE-5762 App3: Make mac version handle command line open
o CPE-5659 App3: Callgraph Fit and Finish tasks
o CPE-725 App3: resizing window in timeline view loses zoom info
o CPE-1450 Fix derived metrics for mem_bw (AMD processors)
o CPE-1046 Apprentice3 on Windows crashes, operates strangely, messes with environment
o CPE-1374 Improve visibility of acc regions in profiles.
o PE-55175 perftools/24.07.0: all sampling fails with tealeaf on blancapeak nodes on snowdon
o CPE-981 perftools/24.11.0: sampling cp2k experiments fail with 'invalid memory reference'
o CPE-1401 Adding -g hip to APA config hangs simulation
o CPE-1087 perftools/24.07.0: aocc/4.2.0 reports all show top function as LO_MEMORY
o CPE-1806 app3/24.07.0: no data loads when displaying app3 back to my laptop from pinoak
o CPE-611 app3/24.07.0: initial window load time is about 10x longer than app2
o CPE-579 app3/24.11.0: cmd.exe window just hangs after clicking Browse for SSH key
o CPE-729 App3: Open file doesn't retain directory state between openings
o CPE-1259 App3: app3 defaults to too tall.
o CPE-610 app2/app3 show empty calltree/flame graph for small full trace example
o CPE-1147 app3: fv3 crashes on start
o CPE-1413 perftools/24.03.0: OpenACC full-trace pat_report fails at end of run
o CPE-1189 App3: Get rid of cmd.exe in app3
o CPE-1452 variable scoping for himeno not working
o CPE-724 App3: Give more meaningful about info, like branch
o CPE-728 Fix the redraw/update logic for the top panel of the time line
o CPE-1757 app2/24.03.0: windows client hangs with password timeout
o CPE-3974 Highlighted flame graph sections flash everytime a new section is highlighted
o CPE-1301 perftools/24.03.0: nvidia/23.11 runtime failures for all sweep3d experiments
o CPE-1316 App2: Extra preceding chars in Overview piechart labels
o CPE-731 App3: Make final icons and splash screens
o CPE-732 App3: Make app3 specific help work on windows
o CPE-730 App3: Make app3 specific help work on mac
o CPE-1029 Legal and copyright issues in Apprentice2 source
o CPE-1289 Perftools(-lite)-instrumented program segfaults in MPI_File_write_all
o CPE-1496 perftools/23.12.0: Sampling experiments hang with cuda codes on pinoak intermittently
o CPE-1500 Perftools/23.12: Tracing Experiment GH200 Counter Issue
o CPE-1514 perftools/23.12: Sampling Experiment GH200 Signal Issue
o CPE-2232 nvidia compiler issues bad DWARF entry
o CPE-3960 perftools/23.12.0: ==LO_MEMORY== with aocc sampling reports
o CPE-727 App3: Fix noteview width issues, especially resizing
o CPE-1005 cce/16.0.1: himeno (OpenACC + CAF) fails on >1 rank on tromper
o CPE-865 PAPI ROCm: Missed Reads Intercept Mode
o CPE-1519 Several apps segfault at end of run on Apollo
o CPE-3992 Perftools @ 0d28114: Failure tracing Gemma user functions
o CPE-3248 Segfault running perftools-lite-gpu binary
o CPE-2231 Perftools: AMD Counter Report Results
o CPE-808 PAPI ROCM: Perftools reports zero counter with rewritten component
o CPE-3998 CrayPat: Perl Table Performance Issues for Large Numbers of Entries
o CPE-3418 tealeaf+hip segfaults 2% of the time on pea2k in PMPI_Waitall
o CPE-1536 Chroma coredumps when PAT-instrumented with '-Drtenv=PAT_RT_PERFCTR=default -g mpi -w'
o CPE-1565 Chroma hangs when PAT-instrumented with '-w -g mpi'
o CPE-3891 perftools/22.06.0: kripke-hip fails to pat_build with release pkg
o CPE-3386 pat_report of a fortran program does not show callchain unless I use -h profile_generate
o CPE-1572 Perftools report showing GPU time larger than runtime in UMT
o CPE-1560 perftools segmentation fault with Panzer at runtime, pat_run works. AMDGPU app (Kokkos w/ hip backend)
o CPE-3425 occa example with pat_build trace gets seg fault
o CPE-1745 pat_build changes linked mpi library
o CPE-1537 perftools/22.04.0: collecting MI200 counters for multiple devices leads to failure
o CPE-3429 pat_report from sampling kripke run - function ==LO_MEMORY==
o CPE-3436 UTK PAPI CUDA component restart w/ new event failure
o CPE-3419 Perftools Lite GPU A100 Runtime Warnings
o CPE-1567 perftools crashing
o CPE-3372 Instrumenting Comb with perftools-lite-gpu causes runtime segfault
o CPE-3307 pat_built IOR causes file open failures for segmented, shared file collective test.
o CPE-4034 miniqmc (implemented with OpenMP Target offload to nvidia v100) fails to run when built with the perftools module loaded
o CPE-3609 pat_report: Thread Time is longer than Wallclock Time
o CPE-3555 pat_build with '-t tracefile' breaking up long functions names and leading to several warnings and un-instrumented functions
o CPE-3922 pat_report -s demangle option has no effect
o CPE-3552 LLNL Kokkos mini app - poor clang performance - poor perftools information
o CPE-3894 pat_report/7.1.1: change OACC label to GPU
o CPE-3749 pat_report with LANL code flag does not show user routines
Deprecations and Removals: <REVIEW>
==========================
o Reveal is no longer supported
Dependencies:
=============
o A PDF reader (such as evince, acroread or okular) is required to use the
app2 online help.
o For a list of software used when validating this version of
Perftools on Cray and HPE systems, see the HPE Cray Programming Environment
release announcements.
Installation instructions:
==========================
For Apollo 80 systems, please see the HPE Cray Programming Environments
Installation Guide: Apollo 80 (ARM) System (S-8013).
For Apollo 2000 systems, please see the HPE Cray Programming Environments
Installation Guide: Apollo 2000 Gen10 Plus (x86) System (S-8012).
For HPE Cray EX (Shasta Architecture) systems, refer to the Cray Asynchronous
Installer Guide (S-8003).
Installation of app2 remote client (+ server) on Mac systems:
-------------------------------------------------------------
Apprentice2Installer-24.11.0.dmg
Apprentice3Installer-24.11.0.dmg
The Cray Apprentice2 and Apprentice3 installers for Mac are included in the
perftools-clients rpm, and placed in
$CRAYPAT_ROOT/share/desktop_installers/
on a Cray Shasta User Access Node (UAN) or on a Cray login node when the
perftools software is installed.
Download the Cray Apprentice2 or Apprentice3 installer onto a desktop or laptop
running Mac OS El Capitan through Mojave. Double click on installer
to begin installation. The installer will walk you through the
process for your system.
Installation of app2 remote client (+ server) on Windows 10 systems:
--------------------------------------------------------------------
Apprentice2Installer-24.11.0.exe
Apprentice3Installer-24.11.0.exe
The Cray Apprentice2 and Apprentice3 installers for Windows are included in the
perftools-clients rpm, and placed in
$CRAYPAT_ROOT/share/desktop_installers/
on a Cray Shasta User Access Node (UAN) or on a Cray login node when the
perftools software is installed.
Download the Cray Apprentice2 installer onto a desktop or laptop
running Windows 10. Double click on installer to begin installation.
The installer will walk you through the process for your system.
Documentation:
==============
See the following man pages:
app2, grid_order, intro_craypat, pat_build, pat_help, pat_info, pat_opts,
pat_report, pat_run, pat_view
intro_papi
perftools-base, perftools-lite, perftools-preload
accpc, cray_cassini, cray_pm, hwpc, nwpc, papi_counters, uncore
PAPIlicnotices
Search for perftools on https://support.hpe.com to access documentation
on Cray Performance Measurement and Analysis Tools
License:
========
Except for the third party modules discussed below and software licensed
by HPE through proprietary agreements, components, files or programs
contained within this package or product are Copyright 2001-2024
Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software contained in this
package are detailed in the file:
$CRAYPAT_ROOT/ATTRIBUTIONS_perftools.txt
Cray PMI 6.1.15
==============================================================================
Release Date:
--------------
May 30, 2024
Purpose:
--------
The Cray Process Manager Interface Library provides the interface between the
application launcher and other communication libraries such as MPICH and SHMEM.
Cray PMI 6.1.15 is optimized for the Cray Programming Environment.
New Cray PMI features for HPE Cray EX and Apollo systems:
Key Changes and Bugs Closed:
----------------------------
Starting with Cray-PMI 6.1.0 the cray-pmi and cray-pmi-lib modules have been
combined into a single cray-pmi module. The cray-pmi-lib module will no longer
be installed by new cray-pmi rpms. When the cray-pmi module is loaded, the
pmi libraries will be linked with as-needed flags.
Bug fixes new to Cray PMI 6.1.15 include:
- PE-52482 - Bugfix for jobs using MPICH_RANK_REORDER_DISPLAY=1
- PE-53689 - Enable module to set LD_LIBRARY_PATH when PE_LD_LIBRARY_PATH=system
Product and OS Dependencies:
----------------------------
The Cray PMI 6.1.15 release is supported on the following systems:
* HPE Cray EX systems with CLE
* HPE Apollo systems as part of the Cray Programming Environment
Product Dependencies:
----------------------------------------+
cray-pals | >= 1.0.6 |
-----------------------+----------------+
slurm | >= 20.02 |
-----------------------+----------------+
Notes and Limitations:
----------------------
Documentation:
--------------
For more information see the intro_pmi man page.
Modulefile:
-----------
module load cray-pmi/6.1.15
License:
--------
Except for the third party components and software licensed by HPE
through proprietary agreements, components, files or programs contained
within this package or product are Copyright 2020-2021 Hewlett Packard
Enterprise Development LP.
Attribution notices for open source licensed software for this
package are detailed in the file:
/opt/cray/pe/pmi/6.1.15/ATTRIBUTIONS
cray-python 3.11.7
====================
Release Date
------------
July 2024
Purpose
-------
Cray Python is an implementation of the Python programming language for the Cray
Programming Environment. The numpy and scipy modules are configured to call Cray
Libsci routines. The mpi4py module is configured to call Cray MPICH routines.
Cray Python is designed to run Python codes on the compute nodes of an HPE
supercomputer. HPE does not make changes to the Python source or any of its
libraries nor does it plan to make changes in future releases.
The cray-python 3.11.7 release contains
- python-3.11.7
- numpy-1.24.4
- scipy-1.10.1
- mpi4py-3.1.4
- dask-2023.6.1
Product and OS Dependencies
---------------------------
The cray-python 3.11.7 release is supported on
- Cray EX systems running SLES 15 or RHEL 8
Documentation
-------------
https://www.python.org/doc
Changelog
---------
https://docs.python.org/release/3.11.7/whatsnew/changelog.html
Modulefile
----------
module load cray-python/3.11.7
Installation
------------
rpm -ihv cray-python-3.11.7-20240617153007.0687944-1.sles15sp4.x86_64.rpm
To make this the default version, execute
[PREFIX]/admin-pe/set_default_files/set_default_python_3.11.7
Certain components, files, or programs contained within this package are
© Copyright 2021-2024 Hewlett Packard Enterprise Development LP
cray-R 4.4.0
============
Release Date
------------
March 2024
Purpose
-------
The cray-R 4.4.0 release.
cray-R is configured to call cray-libsci routines.
Product and OS Dependencies
---------------------------
The cray-R 4.4.0 release is supported on
- Cray EX systems running SLES 15 or RHEL 8
Documentation
-------------
https://cran.r-project.org/manuals.html
Modulefile
----------
module load cray-R/4.4.0
Installation
------------
rpm -ihv cray-R-4.4.0-20240617153119.a134495-1.sles15sp4.x86_64.rpm
To make this the default version, execute:
[PREFIX]/admin-pe/set_default_files/set_default_R_4.4.0
Certain components, files or programs contained within this package or product are
Copyright 2018-2024 Hewlett Packard Enterprise Development LP
sanitizers4hpc 1.1.4
================================================================================
*Released: October 2024*
Product Description
---------------------------
- Sanitizers4hpc is a debugging tool to aid in the detection of memory leaks
and errors in parallel applications. Using LLVM's AddressSanitizer or
LeakSanitizer as a data source, Sanitizers4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior.
Notes
---------------------------
- Shared library exposure in previous versions of sanitizers4hpc.
Previous versions of sanitizers4hpc incorrectly exported internal sanitizers4hpc
libraries into /opt/cray/pe/lib64, causing other programs that had that path in
their runpath or LD_LIBRARY_PATH to load libraries they didn't expect.
This has been fixed in the 22.08 release of sanitizers4hpc. However, links will
be present in /opt/cray/pe/lib64 pointing to older versions of sanitizers4hpc,
if an older version is installed because old installations will still modify
/opt/cray/pe/lib64 when ldconfig is run.
To clean up libraries left by previous versions of sanitizers4hpc:
Option 1:
1. Uninstall all previously installed versions of sanitizers4hpc, or remove
the .cray_dynamic_file_list file from all previously installed versions
of sanitizers4hpc, typically installed in /opt/cray/pe/sanitizers4hpc.
2. Remove any links in /opt/cray/pe/lib64 pointing into a sanitizers4hpc installation.
3. run ldconfig
Option 2:
1. Uninstall all previous versions of santizers4hpc.
Changelog
---------------------------
=======================================================================
## [1.1.4] - 2024-09-20 (24.10)
=======================================================================
### Bug Fixes
* CPE-6064: Don't reset ZMQNet install directory
* PE-54417: Strip trailing BuildId if present
* PE-54265: Automatically preload libfabric if linked
* PE-53866: Improve ThreadSanitizers and Nvidia Compute Sanitizers aggregation
* PE-53603: Update ZMQNet submodule for libsodium support
* PE-51193: Activate PALS startup barrier manually through libpals
* PE-49611: Update ZMQNet
### Features
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* Add builds for rhel 9.4 and sles15sp6
* PE-51960: Added support for rhel89/93 & gcc13
* Use gcc toolset 12 on redhat
=======================================================================
## [1.1.1] - 2023-07-7 (23.08)
=======================================================================
### Features
* PE-47186: Add Sanitizers4hpc User Guide
* PE-48278: Supply CUDA Sanitizer options via frontend argument
* Use native compilers on sles
* PE-48186: Support SHMEM non-shared heap checking, HTML documentation in share/doc
=======================================================================
## [1.1.0] - 2023-04-11 (23.05)
=======================================================================
### Bug Fixes
* PE-45171: s4hStarter was not exiting properly on ALPS
* PE-45185: Use Clang path to add LLVM utilities to PATH
* PE-45170: Fix log directory creation with CCE 15 Sanitizers
### Features
* PE-46016: Add option to filter output not matching files / functions
* Update to build with gcc-toolset-10 on redhat
* PE-45209: Update CUDA-Memcheck to Nvidia Compute Sanitizer
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh sanitizers4hpc-1.1.4-20241007211939_dceb16585e19-66.sles15sp6.x86_64.rpm
To make sanitizers4hpc 1.1.4 the default version of sanitizers4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_sanitizers4hpc_1.1.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2022-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/sanitizers4hpc/1.1.4/ATTRIBUTIONS_sanitizers4hpc.txt
Cray OpenSHMEMX 11.7.3:
===============================
Release Date:
-------------
November, 2024
Purpose:
--------
OpenSHMEM is a Partitioned Global Address Space (PGAS) library interface
specification, which is the culmination of a standardization effort among
many implementers and users of SHMEM programming model. SHMEM has a long
history as a parallel programming model on HPE Cray supercomputer systems.
For the past two decades SHMEM library implementation in HPE Cray systems
evolved through different generations. Cray OpenSHMEMX is a proprietary,
OpenSHMEM specification compliant SHMEM implementation for HPE Cray
product line.
Bugs Closed:
------------
The following bugs are fixed as part of the Cray OpenSHMEMX 11.7.3
release:
- Fix support for running with an unequal number of PEs per node
Product and OS Dependencies:
----------------------------
The Cray OpenSHMEMX 11.7.3 release is supported on the following
Cray systems:
* HPE Cray EX systems with CLE
Product and OS Dependencies by network type:
--------------------------------------------------+
| HPE Slingshot |
----------------------------+---------------------+
craype | >= 2.7.3 |
----------------------------+---------------------+
cray-pals | >= 0.3.5 |
----------------------------+---------------------+
cray-pmi | >= 6.0.1 |
----------------------------+---------------------+
libfabric | >= 1.9.0 |
----------------------------+---------------------+
cray-dsmml | >= 0.2.2 |
----------------------------+---------------------+
One or more compilers:
* AOCC 2.2 or later
* CCE 9.1 or later
* GNU 9.1 or later
* Intel 19.0 or later
* Nvidia 20.7 or later
Notes and Limitations:
----------------------
Announcements, release information, supported environments, limitations,
usage models, and backward compatibility informations about this product
can be viewed in the following location:
https://pe-cray.github.io/cray-openshmemx/
Documentation:
--------------
Use the Cray OpenSHMEMX man pages for more information on the library
functions and use intro_shmem(3) man page for general information.
Initial support for Cray OpenSHMEMX man pages are derived from OpenSHMEM
standards specification document
Use https://pe-cray.github.io/whitepapers/ for access to different
Cray OpenSHMEMX specific whitepapers
Modulefile:
-----------
module load cray-openshmemx/11.7.3
License:
--------
Components, files, and programs contained within this package or
product are Copyright Hewlett Packard Enterprise Development LP
cray-stat 4.12.4
================================================================================
*Released: September 2024*
Product Description
---------------------------
- The Stack Trace Analysis Tool (STAT) is a highly scalable, lightweight
tool that gathers and merges stack traces from all of the processes of
a parallel application to form call graph prefix trees.
Notes
---------------------------
- To enable gathering stack traces on an Nvidia GPU, the environment variable
STAT_GDB must be set to either cuda-gdb, which will require cuda-gdb to be
available in PATH. Or it can be set a specific debugger. We suggest the
version of cuda-gdb packaged with gdb4hpc, as in:
export STAT_GDB=/opt/cray/pe/gdb4hpc/$GDB4HPC_VERSION/libexec/cuda110-gdb-guard
After which stat-cl would be called using the options: -w -G -i
Changelog
---------------------------
=======================================================================
## [4.12.4] - 2024-08-20 (24.09)
=======================================================================
### Features
* Support rhel 8.10
* Build on rhel 9.4 and sles15sp6
* PE-53556: STAT dotfiles compatible with other dotfile viewers
=======================================================================
## [4.12.3] - 2024-04-23 (24.05)
=======================================================================
### Features
* PE-51960: Added support for rhel89/93 & gcc13
* Update to gcc toolset 12 on redhat
* Update to gcc toolset 12 on redhat
=======================================================================
## [4.12.1] - 2023-07-11 (23.08)
=======================================================================
### Features
* Use native compilers on sles
* Use native sles compilers
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- https://computing.llnl.gov/code/STAT/
Installation Instructions
---------------------------
- rpm -ivh --oldpackage cray-stat-4.12.4-20240918190627_f9d30a511f99-61.sles15sp6.x86_64.rpm
To make cray-stat 4.12.4 the default version of cray-stat, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-stat_4.12.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/stat/4.12.4/ATTRIBUTIONS_stat.txt
totalviewsup 2024.1.21
================================================================================
*Released: March 2024*
Product Description
---------------------------
- Provides the HPE Totalview support package which contains modulefiles (tcl & lua),
set_default files, and content projection files for Totalview 2024.1.21.
- The only supported install directory for HPE totalviewsup is /opt/cray/pe.
- The only supported install directory for Perforce Totalview is /opt/totalview.
- Drop the license file into: /opt/totalview/2024.1.21/
Changelog
---------------------------
=======================================================================
## [2023.4.16] - 2024-02-26 (24.03)
=======================================================================
### Features
* PE-49958: Implemented the auto-gen release notes/changelog tool
- Updated supported version to 2023.4.16
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- This totalviewsup 2024.1.21 package has a dependency on Totalview 2024.1.21.
Documentation
---------------------------
- Totalview docs can be found in /opt/toolworks/totalview.2024.1.21/doc/
- Totalview user guide:
/opt/toolworks/totalview.2024.1.21/doc/TotalView_User_Guide.pdf
- Totalview installation guide:
/opt/toolworks/totalview.2024.1.21/doc/TotalView_Installation_Guide.pdf
- The Totalview release notes:
/opt/toolworks/totalview.2024.1.21/doc/TotalView_Change_Log.pdf
- The Totalviewsup support package release notes can be found in:
/opt/cray/pe/totalviewsup/2024.1.21/release_notes.md
Installation Instructions
---------------------------
- rpm -ivh totalviewsup-2024.1.21-20240513190717_eed2518e7091-1.sles15sp5.x86_64.rpm
To make Totalview 2024.1.21 the default version, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_totalview_2024.1.21
Legal Notices
---------------------------
Copyright 2007-2024 Hewlett Packard Enterprise Development LP.
CM-PE-INTEGRATION CHANGELOG
===========================
24.07 (2023-06-05)
* Remove rpm queries from 77-deploy-pe.sh for improved performance
* Remove find commands from 77-deploy-pe.sh for improved performance
* Replace the systemd file with a new pe.service that depends on pe.mount
* CAST-35461 fix setting MODULEPATH in csh.cshrc.local
* Replace find commands with for loops to allow using symlink paths in gen_modulefiles.sh
24.03 (2023-02-16)
* Fix regex in gen_modulefiles for Intel OneAPI
* Add a umask 022 to ensure CPE access is not limited
* Add nfs-utils as an rpm dependencies
23.12 (2023-11-27)
* Determine the craype-target architecture during shell initialization
* Add support for compute nodes running on aarch64 hardware
* Update gen_modulefiles.sh to better support new compiler versions
* Add better logging information to `77-deploy-pe`
23.05 (2023-05-10)
* Allow sites to override the lmod install path by setting `lmod_prefix_path`
in `cray-pe-configuration.sh` and `cray-pe-configuration.csh`. Sites can
now use newer versions of lmod provided by the OS distribution.
* Update `76-add-pe-to-fstab` so that `/pe` is not added to `/etc/fstab` more
then once.
23.03 (2023-03-03)
* Spread the squashfs image mounts across NUMA domains to balance memory
usage across NUMA nodes.
* Add RPM dependency on `numactl`
23.02 (2023-01-30)
* Update shell profile scripts to initialize lmod using HPE provided package.
* Remove leading and trailing `:` in `LMOD_SYSTEM_DEFAULT_MODULES` that is no
longer an acceptable format in new versions of lmod.
22.12 (2022-12-12)
* Add a `site_module_list` to `cray-pe-configuration.sh` and
`cray-pe-configuration.csh` to allow sites to add modules loaded at login
without the need to modify HPE defaults `init_module_list`.
22.11 (2022-11-10)
* Update `gen_modulefiles.sh` to recreating symlinks to ensure idempotence.
22.10 (2022-10-03)
* Changes for HPCM 1.8 to ensure that `/pe` is mounted in `76-add-pe-to-fstab`
before running `77-deploy-pe`
22.09 (2022-08-23)
* Update `pe_overlay.sh` to only remove workdirs when unmounts are successful.
* Update `gen_modulefiles.sh` to run `one_off_set_defaults` after generating
all modulefiles.
22.08 (2022-07-22)
* Enable older PE images to deploy on system with newer minor base OS version.
* Update `gen_modulefiles.sh` to use the latest available version of
`craypkg-gen`.
22.05 (2022-04-26)
* Remove `/opt/modulefiles` from `MODULEPATH`.
22.04 (2022-03-28)
* Add a temporary workaround in `pe_overlay.sh` that copies lmod GPU
modulefiles into the PE overlay's upper layer so they are visible after
`/opt/cray/pe` is mounted.
valgrind4hpc 2.13.4
================================================================================
*Released: September 2024*
Product Description
---------------------------
- Valgrind4hpc is a Valgrind-based debugging tool to aid in the detection of memory
leaks and errors in parallel applications. Valgrind4hpc aggregates any duplicate
messages across ranks to help provide an understandable picture of
program behavior. Valgrind4hpc manages starting and redirecting output from many
copies of Valgrind, as well as deduplicating and filtering Valgrind messages.
If your program can be debugged with Valgrind, it can be debugged with Valgrind4hpc.
Changelog
---------------------------
=======================================================================
## [2.13.4] - 2024-08-20 (24.09)
=======================================================================
### Bug Fixes
* PE-54291: Finish analysis early if job exited unexpectedly
### Features
* Support rhel 8.10
* Support rhel 8.10
* Add builds for rhel 9.4 and sles15sp6
* PE-54471: Add suppressions for aarch64 libcxi
* PE-55037: Remove deprecated exp-sgcheck tool support
=======================================================================
## [2.13.3] - 2024-04-23 (24.05)
=======================================================================
### Bug Fixes
* PE-51571: Parse arguments before starting network
### Features
* PE-51960: Added support for rhel89/93 & gcc13
* Update Valgrind to 3.22, support syscall userfaultfd
* Build with gcc toolset 12 on redhat
=======================================================================
## [2.13.1] - 2023-07-7 (23.08)
=======================================================================
### Features
* PE-47184: Add valgrind4hpc user guide
* Use native compilers on sles
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-mrnet >= 5.1, < 6 installed
- cray-cti >= 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Documentation
---------------------------
- See man valgrind4hpc.
Installation Instructions
---------------------------
- rpm -ivh valgrind4hpc-2.13.4-20240919180133_f0f08f05f65e-406.sles15sp6.x86_64.rpm
To make valgrind4hpc 2.13.4 the default version of valgrind4hpc, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_valgrind4hpc_2.13.4
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2010-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/valgrind4hpc/2.13.4/ATTRIBUTIONS_valgrind4hpc.txt
cray-zmqnet 1.0.0
================================================================================
*Released: <RELEASE_DATE>*
Product Description
---------------------------
- zmqnet is a library for creating a network tree between applications
and HPC jobs using zmq.
Changelog
---------------------------
=======================================================================
## [unreleased]
=======================================================================
### Bug Fixes
* Missing apollo install yamls PE-55041
* PE-54822: Throw exception when fail to detect hostname
* PE-53720: Include capnp tools in support directory
* PE-53603: Show diagnostic when libsodium cannot be loaded
* PE-51694: Make pings thread safe
* PE-51165: Assign rank and PID in packed mode
* PE-49776: Check TMPDIR before using it
* PE-49611: Detect spurious timeouts and fix backend timeout setting
* PE-48636: Remove message traversal limit
* Fix install path exported by lmod modulefile on relocated install
* PE-45208: Don't remove auth keyfile until setup completed
* Fix rarely dropped messages during startup
* Ensure nodes in newly created communicators are fully connected before returning new communicator to user
### Features
* Build rpms for rhel 8.10
* Build on sles sp6 and rhel 9.4
* PE-53605: Build and package libsodium dependency
* PE-51960: Added support for rhel89/93 & gcc13
* PE-44112: Add optional heartbeat monitor thread to AsyncFrontend
* PE-50464: Implement configurable port base
* Move to gcc-toolset-12 on redhat
* PE-48567: ZMQNet documentation
* Introduce forceDisconnect function to AsyncFrontend
* PE-41205: Add option to disable encryption at build and run time
=======================================================================
## [1.0.0] - 2022-9-26 (22.10)
=======================================================================
* Initial release
OS Dependencies
---------------------------
- HPE CSM systems with SLES 15 SP4
- HPE HPCM systems with SLES 15 SP5 and RHEL 8.8
- HPE Apollo systems with RHEL 8.8
Product Dependencies
---------------------------
- cray-cti 2.19, < 3 installed
- cdst-support >= 2.14, < 3 installed
Installation Instructions
---------------------------
- rpm -ivh cray-zmqnet-1.0.0-20240903164731_a460c82994fa-72.sles15sp6.x86_64.rpm
To make cray-zmqnet 1.0.0 the default version of cray-zmqnet, execute:
/opt/cray/pe/admin-pe/set_default_files/set_default_cray-zmqnet_1.0.0
Legal Notices
---------------------------
Certain components, files or programs contained within this package or product are Copyright 2020-2024 Hewlett Packard Enterprise Development LP.
Attribution notices for open source licensed software for this package are detailed in the file:
/opt/cray/pe/zmqnet/1.0.0/PLACEHOLDER_ATTRIBUTIONS_zmqnet.txt