hpcg_c2_profile.txt
CrayPat/X: Version 23.09.0 Revision 6034a9414 sles15.4_x86_64 08/01/23 18:55:19
Number of PEs (MPI ranks): 2
Numbers of PEs per Node: 2
Numbers of Threads per PE: 1
Number of Cores per Socket: 64
Execution start time: Tue Jul 28 08:39:53 2026
System name and speed: nid002970 2.247 GHz (nominal)
AMD Rome CPU Family: 23 Model: 49 Stepping: 0
Core Performance Boost: All 2 PEs have CPB capability
Current path to data file:
/work/project/project/user/runs/sweep/hpcg_c2//exp_A (RTS)
Notes for table 1:
This table shows functions that have significant exclusive time,
averaged across ranks.
For further explanation, see the "General table notes" below, or
use: pat_report -v -O profile ...
Table 1: Profile by Function Group and Function
Time% | Time | Imb. | Imb. | Calls | Group
| | Time | Time% | | Function
| | | | | PE=HIDE
100.0% | 26.005014 | -- | -- | 93,623.0 | Total
|-----------------------------------------------------------------------------
| 55.3% | 14.380659 | -- | -- | 25,450.0 | USER
||----------------------------------------------------------------------------
|| 38.4% | 9.981425 | 2.562270 | 40.9% | 1.0 | main
|| 9.3% | 2.427058 | 0.001801 | 0.1% | 2,906.0 | ComputeSPMV_ref.LOOP@li.59
|| 1.2% | 0.308044 | 0.279944 | 95.2% | 2,906.0 | ComputeSPMV_ref.REGION@li.59
||============================================================================
| 33.5% | 8.713801 | -- | -- | 56,528.0 | MPI
||----------------------------------------------------------------------------
|| 15.4% | 4.001970 | 3.309368 | 90.5% | 7,918.0 | MPI_Wait
|| 9.6% | 2.493849 | 1.266445 | 67.4% | 7,918.0 | MPI_Send
|| 2.5% | 0.638062 | 0.635000 | 99.8% | 14,717.0 | MPI_Wtime
|| 2.3% | 0.599880 | 0.143558 | 38.6% | 7,918.0 | MPI_Irecv
|| 1.4% | 0.366104 | 0.364205 | 99.7% | 7,919.0 | MPI_Comm_size
|| 1.3% | 0.346517 | 0.345243 | 99.8% | 7,919.0 | MPI_Comm_rank
|| 1.0% | 0.267340 | 0.085277 | 48.4% | 2,216.0 | MPI_Allreduce
||============================================================================
| 7.6% | 1.986112 | -- | -- | 2,219.0 | MPI_SYNC
||----------------------------------------------------------------------------
|| 7.6% | 1.977159 | 1.797257 | 90.9% | 2,216.0 | MPI_Allreduce(sync)
||============================================================================
| 3.5% | 0.900875 | -- | -- | 9,424.0 | OMP
||----------------------------------------------------------------------------
|| 1.1% | 0.283359 | 0.254946 | 94.7% | 2,906.0 | ComputeSPMV_ref.REGION@li.59(ovhd)
|=============================================================================
======================== Additional details ========================
General table notes:
The default notes for a table are based on the default definition of
the table, and do not account for the effects of command-line options
that may modify the content of the table.
Detailed notes, produced by the pat_report -v option, do account for
all command-line options, and also show how data is aggregated, and
if the table content is limited by thresholds, rank selections, etc.
An imbalance metric in a line is based on values in main threads
across multiple ranks, or on values across all threads, as applicable.
An imbalance percent in a line is relative to the maximum value
for that line across ranks or threads, as applicable.
If the number of Calls for a function is shown as "--", then that
function was not traced and the other values in its line summarize
the data collected for functions that it calls and that were traced.
Experiment: trace
Original path to data file:
/mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpcg_c2/exp_A/xf-files (RTS)
Original program:
/mnt/lustre/a2fs-work3/work/project/project/user/builds/hpcg/xhpcg
Instrumented with: pat_build -g mpi,io -w -o xhpcg+pat xhpcg
Instrumented program:
/mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpcg_c2/./xhpcg+pat
Program invocation:
/mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpcg_c2/./xhpcg+pat
Exit Status: 0 for 2 PEs
Memory pagesize: 4 KiB
Memory hugepagesize: Not Available
Programming environment: CRAY
Runtime environment variables:
CRAYPAT_COMPILER_OPTIONS=1
CRAYPAT_GCC_LIB_PATH=/opt/cray/pe/gcc-libs
CRAYPAT_LD_LIBRARY_PATH=/opt/cray/pe/gcc-libs/opt/cray/pe/perftools/23.09.0/lib64
CRAYPAT_OPTS_EXECUTABLE=libexec64/opts
CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0
CRAYPE_VERSION=2.7.23
CRAY_BINUTILS_VERSION=/opt/cray/pe/cce/16.0.1
CRAY_CC_VERSION=16.0.1
CRAY_DSMML_VERSION=0.2.2
CRAY_FFTW_VERSION=3.3.10.5
CRAY_FTN_VERSION=16.0.1
CRAY_LIBSCI_VERSION=23.09.1.1
CRAY_MPICH_VERSION=8.1.27
CRAY_PERFTOOLS_VERSION=23.09.0
FFTW_VERSION=3.3.10.5
LIBSCI_VERSION=23.09.1.1
LMOD_FAMILY_COMPILER_VERSION=16.0.1
LMOD_FAMILY_CRAYPE_CPU_VERSION=false
LMOD_FAMILY_CRAYPE_NETWORK_VERSION=false
LMOD_FAMILY_CRAYPE_VERSION=2.7.23
LMOD_FAMILY_LIBFABRIC_VERSION=1.12.1.2.2.0.0
LMOD_FAMILY_MPI_VERSION=8.1.27
LMOD_FAMILY_PERFTOOLS_VERSION=false
LMOD_FAMILY_PRGENV_VERSION=8.4.0
LMOD_VERSION=8.7.19
MPICH_DIR=/opt/cray/pe/mpich/8.1.27/ofi/crayclang/14.0
OMP_NUM_THREADS=1
PAT_RT_EXPDIR_BASE=/work/project/project/user/runs/sweep/hpcg_c2
PAT_RT_EXPDIR_NAME=exp_A
PAT_RT_EXPDIR_REPLACE=1
PAT_RT_PERFCTR=PAPI_FP_OPS,PAPI_FP_INS,PAPI_TOT_INS,PAPI_TOT_CYC,cray_rapl:::PACKAGE_ENERGY,cray_rapl:::PP0_ENERGY,cray_zenl3:::UNC_L3_CACHE_MISSES,cray_zenl3:::UNC_L3_CACHE_REQUESTS,cray_zenl3:::UNC_L3_MISS_LATENCY
PAT_RT_PERFCTR_DISABLE_COMPONENTS=nvml,rocm_smi
PERFTOOLS_VERSION=23.09.0
PMI_CONTROL_PORT=28852
PMI_JOBID=14534135
PMI_LOCAL_RANK=0
PMI_LOCAL_SIZE=2
PMI_RANK=0
PMI_SHARED_SECRET=CHANGE_ME
PMI_SIZE=2
PMI_UNIVERSE_SIZE=2
Report time environment variables:
CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0
Number of MPI control variables collected: 136
(To see the list, specify: -s mpi_cvar=show)
Report command line options: -O profile
Operating system:
Linux 5.14.21-150400.24.228-default #1 SMP PREEMPT_DYNAMIC Tue Jul 7 09:49:36 UTC 2026 (9ba75fc)
Hardware performance counter events:
PAPI_TOT_INS Instructions completed
PAPI_FP_INS Floating point instructions
PAPI_TOT_CYC Total cycles
PAPI_FP_OPS Floating point operations
UNC_L3_CACHE_REQUESTS Requests to L3 cache
UNC_L3_MISS_LATENCY Accumulated L3 miss latency (total cycles for all transactions divided by 16)
UNC_L3_CACHE_MISSES L3 cache misses by request type
PACKAGE_ENERGY Energy used by chip package
PP0_ENERGY Energy used by all cores in package
Estimated minimum instrumentation overhead per call of a traced function,
which was subtracted from the data shown in this report
(for raw data, use the option: -s overhead=include):
Time 5.182 microsecs
Number of traced functions that were called: 21
(To see the list, specify: -s traced_functions=show)
Warnings:
OpenMP regions included 1 region with no end address, and
1 region with an invalid address range, and they were ignored.
An exit() call or a STOP statement can cause missing end addresses.
Invalid address ranges indicate a problem with data collection.