Opens a larger view. Escape closes it.

hardware-counters

openfoam_c8_hwpc.txt

CrayPat/X:  Version 23.09.0 Revision 6034a9414 sles15.4_x86_64  08/01/23 18:55:19

Number of PEs (MPI ranks):    8
                           
Numbers of PEs per Node:      8
                           
Numbers of Threads per PE:    1
                           
Number of Cores per Socket:  64

Execution start time:  Tue Jul 28 09:32:44 2026

System name and speed:  nid002983  1.999 GHz (nominal)

AMD   Rome                 CPU  Family: 23  Model: 49  Stepping:  0

Core Performance Boost:  All 8 PEs have CPB capability

Current path to data file:
  /work/project/project/user/runs/sweep/openfoam_c8//exp_A   (RTS)


Notes for table 1:

  This table shows HW performance counter data for the whole program,
    averaged across ranks or threads, as applicable.
  For further explanation, see the "General table notes" below, or 
    use:  pat_report -v -O hwpc ...

Table 1:  Program HW Performance Counter Data

PE=HIDE

  
==============================================================================
  Total
------------------------------------------------------------------------------
  Thread Time                              23.594545 secs
  PAPI_TOT_INS           3.036 G/sec  71,631,475,129 instr
  PAPI_FP_INS            1.277 G/sec  30,131,239,711 ops
  PAPI_TOT_CYC                        38,138,950,336 cycles
  PAPI_FP_OPS            0.733 G/sec  17,286,284,771 ops
  PACKAGE_ENERGY            11 W                 265 J
  PP0_ENERGY                 0 W                2.34 J
  HW FP Ops / User time  0.733 G/sec  17,286,284,771 ops  5.7%peak(DP)
  HW FP Ops / Inst                             24.1% 
  Instr per cycle                               1.88 inst/cycle
==============================================================================

========================  Additional details  ========================

General table notes:

    The default notes for a table are based on the default definition of
    the table, and do not account for the effects of command-line options
    that may modify the content of the table.
    
    Detailed notes, produced by the pat_report -v option, do account for
    all command-line options, and also show how data is aggregated, and
    if the table content is limited by thresholds, rank selections, etc.
    
    An imbalance metric in a line is based on values in main threads
    across multiple ranks, or on values across all threads, as applicable.
    
    An imbalance percent in a line is relative to the maximum value
    for that line across ranks or threads, as applicable.
    
    If the number of Calls for a function is shown as "--", then that
    function was not traced and the other values in its line summarize
    the data collected for functions that it calls and that were traced.
    
Experiment:  trace

Original path to data file:
  /mnt/lustre/a2fs-work3/work/project/project/user/runs/sweep/openfoam_c8/exp_A/xf-files   (RTS)

Original program:  simpleFoam

Instrumented with:  pat_run -w -- simpleFoam

Program invocation:  simpleFoam -parallel

Exit Status:  0 for 8 PEs

Memory pagesize:  4 KiB

Memory hugepagesize:  Not Available

Programming environment:  GNU

Runtime environment variables:
  CRAYPAT_COMPILER_OPTIONS=1
  CRAYPAT_GCC_LIB_PATH=/opt/cray/pe/gcc-libs
  CRAYPAT_LD_LIBRARY_PATH=/opt/cray/pe/gcc-libs/opt/cray/pe/perftools/23.09.0/lib64
  CRAYPAT_OPTS_EXECUTABLE=libexec64/opts
  CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0
  CRAYPE_VERSION=2.7.23
  CRAY_DSMML_VERSION=0.2.2
  CRAY_LIBSCI_VERSION=23.09.1.1
  CRAY_MPICH_VERSION=8.1.27
  CRAY_PERFTOOLS_VERSION=23.09.0
  GCC_VERSION=11.2.0
  GNU_VERSION=11.2.0
  LIBSCI_VERSION=23.09.1.1
  LMOD_FAMILY_COMPILER_VERSION=11.2.0
  LMOD_FAMILY_CRAYPE_CPU_VERSION=false
  LMOD_FAMILY_CRAYPE_NETWORK_VERSION=false
  LMOD_FAMILY_CRAYPE_VERSION=2.7.23
  LMOD_FAMILY_LIBFABRIC_VERSION=1.12.1.2.2.0.0
  LMOD_FAMILY_MPI_VERSION=8.1.27
  LMOD_FAMILY_PERFTOOLS_VERSION=false
  LMOD_FAMILY_PRGENV_VERSION=8.4.0
  LMOD_VERSION=8.7.19
  MPICH_DIR=/opt/cray/pe/mpich/8.1.27/ofi
  MPI_ARCH_PATH=/opt/cray/pe/mpich/8.1.27/ofi
  OMP_NUM_THREADS=1
  PAT_RT_EXPDIR_BASE=/work/project/project/user/runs/sweep/openfoam_c8
  PAT_RT_EXPDIR_NAME=exp_A
  PAT_RT_EXPDIR_REPLACE=1
  PAT_RT_EXPERIMENT=trace
  PAT_RT_PERFCTR=PAPI_FP_OPS,PAPI_FP_INS,PAPI_TOT_INS,PAPI_TOT_CYC,cray_rapl:::PACKAGE_ENERGY,cray_rapl:::PP0_ENERGY,cray_zenl3:::UNC_L3_CACHE_MISSES,cray_zenl3:::UNC_L3_CACHE_REQUESTS,cray_zenl3:::UNC_L3_MISS_LATENCY,
  PAT_RT_PERFCTR_DISABLE_COMPONENTS=nvml,rocm_smi
  PERFTOOLS_VERSION=23.09.0
  PMI_CONTROL_PORT=27715
  PMI_JOBID=14534429
  PMI_LOCAL_RANK=0
  PMI_LOCAL_SIZE=8
  PMI_RANK=0
  PMI_SHARED_SECRET=CHANGE_ME
  PMI_SIZE=8
  PMI_UNIVERSE_SIZE=8
  WM_PROJECT_VERSION=v2212

Report time environment variables:
    CRAYPAT_ROOT=/opt/cray/pe/perftools/23.09.0

Number of MPI control variables collected:  136

  (To see the list, specify: -s mpi_cvar=show)

Report command line options:  -O hwpc

Operating system:
  Linux 5.14.21-150400.24.228-default #1 SMP PREEMPT_DYNAMIC Tue Jul 7 09:49:36 UTC 2026 (9ba75fc)

Hardware performance counter events:
   PAPI_TOT_INS           Instructions completed
   PAPI_FP_INS            Floating point instructions
   PAPI_TOT_CYC           Total cycles
   PAPI_FP_OPS            Floating point operations
   UNC_L3_CACHE_REQUESTS  Requests to L3 cache
   UNC_L3_MISS_LATENCY    Accumulated L3 miss latency (total cycles for all transactions divided by 16)
   UNC_L3_CACHE_MISSES    L3 cache misses by request type
   PACKAGE_ENERGY         Energy used by chip package
   PP0_ENERGY             Energy used by all cores in package

Instrumentation overhead could not be estimated.