HPCQCMark: A New Modular HPC-QC Benchmarking Framework

Supercomputing centers all over the world have started integrating Quantum Processing Units (QPU) with their supercomputers. These new hybrid architectures require software stacks with specific environments, interfaces, tools,... This has led to a need for ways to quickly evaluate the readiness and the performance of these new software stacks. While benchmarking methods exist for the individual HPC or QC systems, combined HPC-QC benchmarking is still mostly a blind spot. We thus propose a new modular, easy to customize, benchmarking framework called 'HPCQCMark' to evaluate HPC-QC systems and especially their software stack. We added modular components to the framework which cover relevant HPC-QC workflows and widely used QC programming environments. Finally, we perform experiments on Riken R-CCS's and TGCC's HPC-QC environments to validate the ability of the framework to evaluate the impact of HPC-QC software stacks on code execution time.