Opens a larger view. Escape closes it.

hardware-counters

hpl_c32_hwpc.txt

CrayPat/X:  Version 23.09.0 Revision 6034a9414 sles15.4_x86_64  08/01/23 18:55:19

Number of PEs (MPI ranks):   32
                           
Numbers of PEs per Node:     32
                           
Numbers of Threads per PE:    1
                           
Number of Cores per Socket:  64

Execution start time:  Tue Jul 28 09:14:52 2026

System name and speed:  nid006182  2.218 GHz (nominal)

AMD   Rome                 CPU  Family: 23  Model: 49  Stepping:  0

Core Performance Boost:  All 32 PEs have CPB capability

Current path to data file:
  /work/project/project/user/runs/sweep/hpl_c32//exp_A   (RTS)


Notes for table 1:

  This table shows HW performance counter data for the whole program,
    averaged across ranks or threads, as applicable.
  For further explanation, see the "General table notes" below, or 
    use:  pat_report -v -O hwpc ...

Table 1:  Program HW Performance Counter Data

PE=HIDE

  
==============================================================================
  Total
------------------------------------------------------------------------------
  Thread Time                                 36.068617 secs
  PAPI_TOT_INS             2.426 G/sec   87,518,913,189 instr
  PAPI_FP_INS              1.341 G/sec   48,380,194,891 ops
  PAPI_TOT_CYC                           55,735,809,931 cycles
  PAPI_FP_OPS              6.535 G/sec  235,711,426,215 ops
  UNC_L3_MISS_LATENCY                     1,807,028,124 
  UNC_L3_CACHE_MISSES                        64,107,346 
  PACKAGE_ENERGY               4 W                  131 J
  PP0_ENERGY                   0 W                 1.89 J
  HW FP Ops / User time    6.535 G/sec  235,711,426,215 ops  52.9%peak(DP)
  HW FP Ops / Inst                               269.3% 
  Instr per cycle                                  1.57 inst/cycle
  MIPS                 84,443.45 M/sec                  
  MFLOPS (aggregate)  227,428.41 M/sec                  
  Average Time per Call                        0.000021 secs
  CrayPat Overhead : Time   8.5%                        
==============================================================================

========================  Additional details  ========================

General table notes:

    The default notes for a table are based on the default definition of
    the table, and do not account for the effects of command-line options
    that may modify the content of the table.
    
    Detailed notes, produced by the pat_report -v option, do account for
    all command-line options, and also show how data is aggregated, and
    if the table content is limited by thresholds, rank selections, etc.
    
    An imbalance metric in a line is based on values in main threads
    across multiple ranks, or on values across all threads, as applicable.
    
    An imbalance percent in a line is relative to the maximum value
    for that line across ranks or threads, as applicable.
    
    If the number of Calls for a function is shown as "--", then that
    function was not traced and the other values in its line summarize
    the data collected for functions that it calls and that were traced.
    
Experiment:  trace

Original path to data file:
  /mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpl_c32/exp_A/xf-files   (RTS)

Original program:
  /mnt/lustre/a2fs-work3/work/project/project/user/builds/hpl/xhpl

Instrumented with:  pat_build -g mpi -w -o xhpl+pat xhpl

Instrumented program:
  /mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpl_c32/./xhpl+pat

Program invocation:
  /mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/hpl_c32/./xhpl+pat

Exit Status:  0 for 32 PEs

Memory pagesize:  4 KiB

Memory hugepagesize:  Not Available

Programming environment:  CRAY

Runtime environment variables:
  CRAYPAT_COMPILER_OPTIONS=1
  CRAYPAT_GCC_LIB_PATH=/opt/cray/pe/gcc-libs
  CRAYPAT_LD_LIBRARY_PATH=/opt/cray/pe/gcc-libs/opt/cray/pe/perftools/23.09.0/lib64
  CRAYPAT_OPTS_EXECUTABLE=libexec64/opts
  CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0
  CRAYPE_VERSION=2.7.23
  CRAY_BINUTILS_VERSION=/opt/cray/pe/cce/16.0.1
  CRAY_CC_VERSION=16.0.1
  CRAY_DSMML_VERSION=0.2.2
  CRAY_FTN_VERSION=16.0.1
  CRAY_LIBSCI_VERSION=23.09.1.1
  CRAY_MPICH_VERSION=8.1.27
  CRAY_PERFTOOLS_VERSION=23.09.0
  LIBSCI_VERSION=23.09.1.1
  LMOD_FAMILY_COMPILER_VERSION=16.0.1
  LMOD_FAMILY_CRAYPE_CPU_VERSION=false
  LMOD_FAMILY_CRAYPE_NETWORK_VERSION=false
  LMOD_FAMILY_CRAYPE_VERSION=2.7.23
  LMOD_FAMILY_LIBFABRIC_VERSION=1.12.1.2.2.0.0
  LMOD_FAMILY_MPI_VERSION=8.1.27
  LMOD_FAMILY_PERFTOOLS_VERSION=false
  LMOD_FAMILY_PRGENV_VERSION=8.4.0
  LMOD_VERSION=8.7.19
  MPICH_DIR=/opt/cray/pe/mpich/8.1.27/ofi/crayclang/14.0
  OMP_NUM_THREADS=1
  PAT_RT_EXPDIR_BASE=/work/project/project/user/runs/sweep/hpl_c32
  PAT_RT_EXPDIR_NAME=exp_A
  PAT_RT_EXPDIR_REPLACE=1
  PAT_RT_PERFCTR=PAPI_FP_OPS,PAPI_FP_INS,PAPI_TOT_INS,PAPI_TOT_CYC,cray_rapl:::PACKAGE_ENERGY,cray_rapl:::PP0_ENERGY,cray_zenl3:::UNC_L3_CACHE_MISSES,cray_zenl3:::UNC_L3_CACHE_REQUESTS,cray_zenl3:::UNC_L3_MISS_LATENCY
  PAT_RT_PERFCTR_DISABLE_COMPONENTS=nvml,rocm_smi
  PERFTOOLS_VERSION=23.09.0
  PMI_CONTROL_PORT=32000
  PMI_JOBID=14534278
  PMI_LOCAL_RANK=0
  PMI_LOCAL_SIZE=32
  PMI_RANK=0
  PMI_SHARED_SECRET=CHANGE_ME
  PMI_SIZE=32
  PMI_UNIVERSE_SIZE=32

Report time environment variables:
    CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0

Number of MPI control variables collected:  136

  (To see the list, specify: -s mpi_cvar=show)

Report command line options:  -O hwpc

Operating system:
  Linux 5.14.21-150400.24.228-default #1 SMP PREEMPT_DYNAMIC Tue Jul 7 09:49:36 UTC 2026 (9ba75fc)

Hardware performance counter events:
   PAPI_TOT_INS           Instructions completed
   PAPI_FP_INS            Floating point instructions
   PAPI_TOT_CYC           Total cycles
   PAPI_FP_OPS            Floating point operations
   UNC_L3_CACHE_REQUESTS  Requests to L3 cache
   UNC_L3_MISS_LATENCY    Accumulated L3 miss latency (total cycles for all transactions divided by 16)
   UNC_L3_CACHE_MISSES    L3 cache misses by request type
   PACKAGE_ENERGY         Energy used by chip package
   PP0_ENERGY             Energy used by all cores in package

Estimated minimum instrumentation overhead per call of a traced function,
  which was subtracted from the data shown in this report
  (for raw data, use the option:  -s overhead=include):
    Time  1.804  microsecs

Number of traced functions that were called:  22

  (To see the list, specify:  -s traced_functions=show)