在风起云涌的AI江湖,NVIDIA凭借其CUDA生态和优秀的硬件大杀四方,立下赫赫战功,而另一家公司AMD也不甘示弱,带着他的生态解决方案ROCm开始了与不世出的NVIDA的正面硬钢,"ROCm is the answer to CUDA", AMD官网如是说。ROCm全称是Radeon Open Compute,从功能上,它是AMD提供的一套用于支持异构计算和GPU加速计算的开发工具和平台。
根据ROCm的官方介绍,这套框架不但支持AMD专业的计算卡,也支持AMD消费级的电脑显卡,之前有搭建过N卡CUDA的学习平台,这里尝试基于AMDGPU,搭建一个ROCm的学习平台。
平台信息
基于Ubuntu 20.04.6 LTS x86_64,显卡为AMD Ryzen 5 5600G with Radeon Graphics集显,应该是VEGA系列,支持VULKAN,OPENCL,当然,不支持CUDA。
搭建步骤
执行如下命令序列,添加用户组和安装ROCm一步到位:
sudo apt update && sudo apt dist-upgrade
sudo apt-get install wget gnupg2
sudo usermod -a -G video $LOGNAME
sudo usermod -a -G render $LOGNAME
echo 'ADD_EXTRA_GROUPS=1' | sudo tee -a /etc/adduser.conf
echo 'EXTRA_GROUPS=video' | sudo tee -a /etc/adduser.conf
echo 'EXTRA_GROUPS=render' | sudo tee -a /etc/adduser.conf
sudo wget https://repo.radeon.com/amdgpu-install/22.10/ubuntu/focal/amdgpu-install_22.10.50100-1_all.deb
sudo apt-get install ./amdgpu-install_22.10.50100-1_all.deb
sudo amdgpu-install --usecase=dkms
amdgpu-install -y --usecase=rocm
echo 'export PATH=$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin' | sudo tee -a /etc/profile.d/rocm.sh
安装结束后,ROCm开发SDK将会出现在/opt目录下, 包括LLVM编译器, opencl, profile, tools等开发工具,便于用户开发自己的基于AMDGPU加速的应用程序。总的来说, ROCm SDK提供了完整的栈支持,包括运行时、编译器、调试器、性能分析工具等,以满足不同开发和优化需求。
AMDGPU编译器目录
测试环境
执行rocm-smi获取显卡设备信息,执行时发现在获取SCLK和功耗两个参数时报错,可能是SDK和显卡兼容方面的问题,不过没有影响后面的简单测试,所以也就没有理会。
AMD一直提倡一种混合异构架构(HSA),这种架构下CPU和GPU乃至各种异构算力被一视同仁,被纳入统一的编程模型开发,从rocminfo工具的输出可以看到这一点,每一个异构算力被认为是一个agent:
$ sudo /opt/rocm/bin/rocminfo
我的计算平台有两个AGENT,分别是CPU和GPU,CPU是通用算例,有12个compute unit,对应的是6核12线程SMT。
GPU Agent信息,计算单元数量,计算最大的TENSOR维数信息,QUEUE数量,WAVE(Warpper)大小等信息:
opencl支持信息
ROCm不直接支持CUDA,但是 support another GPU programming mode opencl,通过clinfo查看:
/opt/rocm/opencl/bin/clinfo
docker容器运行测试
下载pytorch环境的docker:
sudo docker run -it -v $HOME:/data --privileged --rm --device=/dev/kfd --device=/dev/dri --group-add video --name pytorch rocm/pytorch:latest
之后,在docker终端中执行如下命令,验证对CUDA的支持(猜测是利用CUDA的生态,底层是CUDA转OpenCL的算子实现):
>>> import torch
>>> torch.cuda.is_available()
输出为TRUE,说明AMDGPU的硬件加速平台搭建成功了。
简单分析
细心的同学可能注意到,在启动docker的测试命令中,传入了一个设备参数--device=/dev/kfd给到DOCKER环境,这个非常重要,kfd本身就是代表AMDGPU异构计算的GPU设备驱动(KMD)的设备节点,它是用户操作GPU的基础。
架构上,AMDKFD驱动程序是Radeon GPU计算软件栈的Linux内核代码,也是该公司ROCm产品的一部分,从 功能上可以理解为在 DRM 子系统中提供了 CPU 与 GPU 沟通的快速通道,使得两者可以平等的访问内存资源而无需额外拷贝。
我们可以在运行上面的测试时,简单追踪以下对KFD内核驱动的调用,以验证加速环境确实使用的AMDGPU显卡,KFD是一个字符设备,所以可以追踪其中的几个FOPS调用,不出所料,在docker中执行如上命令后,内核中则追踪到了如下对KFD的调用栈:
这个例子说明了ROCm穿上了CUDA的外衣,摇身一变实现了对TF框架的支持,但是核心引擎仍然用的是AMDGPU自己的加速实现,包括AMD的编译器,AMD的底层KMD KFD,数学加速库等等实现。
ROCm和CUDA编程模型对比
1.NVIDIA和AMD都支持OpenCL,毕竟CL是个开放标准。
2.OpenACC对标OpenMP,网上有很多例子.
3.HIP对标Cuda,Cuda Source可以翻译为 HIP,然后由ROCm编译为AMDGPU上可运行的代码。
大概意思针对异构计算,深度系学习场景,双方各自都有底牌,目前OpenCL打个平手,HIP和CUDA相比较生态弱一些,OpenACC和OpenMP旗鼓相当。
AMDGPU对CUDA支持方式的分析
以下内容来源于网上的资料和自己不负责任的分析,基于一个原理,计算机中的任何问题都可以通过增加一个中间层来解决:
实现方式是针对hip api(Heterogeneous-Computing Interface for Portability)做CUDA的接口套壳,即将cuda的API接口作为标准接口,用AMD ROCm实现cuda的API(目的就是保证对外的API与CUDA完全相同),但实际调用 HIP+ROCm 的相关接口实现(即实际在A卡上运行),编译生成动态库libcuda*.so,并替换cuda相关动态库,从而完成适配,达到兼容CUDA生态的接口的目的。ROCm也提供了HIPIFY工具,用于将CUDA源代码转换为HIP源代码,实现CUDA代码到HIP的移植。
ROCm API libraries — ROCm Documentation
Hipify工具
HIP是 CUDA API 的”山寨克隆“版。除了一些不常用的功能(e.g. managed memory)外,几乎全盘拷贝 CUDA API,是 CUDA 的一个子集。HIP让开发人员能够使用HIPIFY将CUDA应用程序移植到ROCm,HIPIFY会自动转换CUDA应用程序成为HIP内核语言和运行时API,使用NVIDIA的CUDA编译器或AMDCLANG编译为目标GPU的运行代码。
基于AMDGPU如何运行OpenCL测试用例
参考网络上基于CPU算例的OpenCL的例子,写一个cl的helloworld demo,这个并不太难,因为OpenCL是开源机构Khronos Group定义的标准,在这个标准下所有的头文件,运行时标准等等都是定义好的,所以源码级没有太多改动,基本上拷贝过来就能跑。重点是分析其基于AMDGPU的执行机制。
下面是一份简单的opencl的代码,基本上和C没有什么差别,除了需要提供device端的代码,没有也没有关系,简单的测试用例可以只在主机上跑。
#include <stdio.h>
#include <stdlib.h>
#include <alloca.h>
#include <CL/cl.h>
void displayPlatformInfo(cl_platform_id id,
cl_platform_info param_name,
const char* paramNameAsStr)
{
cl_int error = 0;
size_t paramSize = 0;
error = clGetPlatformInfo( id, param_name, 0, NULL, ¶mSize );
char* moreInfo = (char*)alloca( sizeof(char) * paramSize);
error = clGetPlatformInfo( id, param_name, paramSize, moreInfo, NULL );
if (error != CL_SUCCESS ) {
perror("Unable to find any OpenCL platform information");
return;
}
printf("%s: %s\n", paramNameAsStr, moreInfo);
}
int main(void) {
/* OpenCL 1.1 data structures */
cl_platform_id* platforms;
/* OpenCL 1.1 scalar data types */
cl_uint numOfPlatforms;
cl_int error;
/*
Get the number of platforms
Remember that for each vendor's SDK installed on the computer,
the number of available platform also increased.
*/
error = clGetPlatformIDs(0, NULL, &numOfPlatforms);
if(error != CL_SUCCESS) {
perror("Unable to find any OpenCL platforms");
exit(1);
}
// Allocate memory for the number of installed platforms.
// alloca(...) occupies some stack space but is automatically freed on return
platforms = (cl_platform_id*) alloca(sizeof(cl_platform_id) * numOfPlatforms);
printf("Number of OpenCL platforms found: %d\n", numOfPlatforms);
error = clGetPlatformIDs(numOfPlatforms, platforms, NULL);
if(error != CL_SUCCESS) {
perror("Unable to find any OpenCL platforms");
exit(1);
}
// We invoke the API 'clPlatformInfo' twice for each parameter we're trying to extract
// and we use the return value to create temporary data structures (on the stack) to store
// the returned information on the second invocation.
for(cl_uint i = 0; i < numOfPlatforms; ++i) {
displayPlatformInfo( platforms[i], CL_PLATFORM_PROFILE, "CL_PLATFORM_PROFILE" );
displayPlatformInfo( platforms[i], CL_PLATFORM_VERSION, "CL_PLATFORM_VERSION" );
displayPlatformInfo( platforms[i], CL_PLATFORM_NAME, "CL_PLATFORM_NAME" );
displayPlatformInfo( platforms[i], CL_PLATFORM_VENDOR, "CL_PLATFORM_VENDOR" );
displayPlatformInfo( platforms[i], CL_PLATFORM_EXTENSIONS, "CL_PLATFORM_EXTENSIONS" );
}
return 0;
}
编译
ROCm环境安装了OpenCL开发所需要的编译器,OpenCL运行时环境,以及标准的Khronos Group头文件,使用如下命令编译:
/opt/rocm/llvm/bin/clang opencl.c -I/opt/rocm/opencl/include -L/opt/rocm/opencl/lib -lOpenCL
编译,运行测试没有问题
strace追踪系统调用,发现opencl的测试用例确实打开了/dev/kfd设备节点,并对GPU进行IOCTL操作:
strace -tt -T -f -e trace=file,close,openat,ioctl -o strace.log ./a.out
这个用例比较简单,调用的IOCTL 列表如下:
开发OpenCL Kernel测试用例
前面的例子只有主机侧的代码,没有GPU运行的代码,实际上没有调用AMDGPU的异构计算能力,参考网上的代码,写一个实现两个一维向量加和的kernel,投到AMDGPU上得到计算结果:
#include <stdio.h>
#include <stdlib.h>
#include <alloca.h>
#include <CL/cl.h>
#pragma warning( disable : 4996 )
int main() {
cl_int error;
cl_platform_id platforms;
cl_device_id devices;
cl_context context;
FILE *program_handle;
size_t program_size;
char *program_buffer;
cl_program program;
size_t log_size;
char *program_log;
char kernel_name[] = "createBuffer";
cl_kernel kernel;
cl_command_queue queue;
//获取平台
error = clGetPlatformIDs(1, &platforms, NULL);
if (error != 0) {
printf("Get platform failed!");
return -1;
}
//获取设备
error = clGetDeviceIDs(platforms, CL_DEVICE_TYPE_GPU, 1, &devices, NULL);
if (error != 0) {
printf("Get device failed!");
return -1;
}
//创建上下文
context = clCreateContext(NULL,1,&devices,NULL,NULL,&error);
if (error != 0) {
printf("Creat context failed!");
return -1;
}
//创建程序;注意要用"rb"
program_handle = fopen("kernel.cl","rb");
if (program_handle == NULL) {
printf("The kernle can not be opened!");
return -1;
}
fseek(program_handle,0,SEEK_END);
program_size = ftell(program_handle);
rewind(program_handle);
program_buffer = (char *)malloc(program_size+1);
program_buffer[program_size] = '\0';
error=fread(program_buffer,sizeof(char),program_size,program_handle);
if (error == 0) {
printf("Read kernel failed!");
return -1;
}
fclose(program_handle);
program = clCreateProgramWithSource(context,1,(const char **)&program_buffer,
&program_size,&error);
if (error < 0) {
printf("Couldn't create the program!");
return -1;
}
//编译程序
error = clBuildProgram(program,1,&devices,NULL,NULL,NULL);
if (error < 0) {
//确定日志文件的大小
clGetProgramBuildInfo(program,devices,CL_PROGRAM_BUILD_LOG,0,NULL,&log_size);
program_log = (char *)malloc(log_size+1);
program_log[log_size] = '\0';
//读取日志
clGetProgramBuildInfo(program, devices, CL_PROGRAM_BUILD_LOG,
log_size+1, program_log, NULL);
printf("%s\n",program_log);
free(program_log);
return -1;
}
free(program_buffer);
//创建命令队列
queue = clCreateCommandQueue(context, devices, CL_QUEUE_PROFILING_ENABLE, &error);
if (error < 0) {
printf("Coudn't create the command queue");
return -1;
}
//创建内核
kernel = clCreateKernel(program,kernel_name,&error);
if (kernel==NULL) {
printf("Couldn't create kernel!\n");
return -1;
}
//初始化参数
float result[100];
float a_in[100];
float b_in[100];
for (int i = 0; i < 100; i++) {
a_in[i] = i;
b_in[i] = i*2.0;
}
//创建缓存对象
cl_mem memObject1 = clCreateBuffer(context,CL_MEM_READ_ONLY|CL_MEM_COPY_HOST_PTR,sizeof(float)*100,a_in,&error);
if (error < 0) {
printf("Creat memObject1 failed!\n");
return -1;
}
cl_mem memObject2 = clCreateBuffer(context, CL_MEM_READ_ONLY | CL_MEM_COPY_HOST_PTR,
sizeof(float) * 100, b_in, &error);
if (error < 0) {
printf("Creat memObject2 failed!\n");
return -1;
}
cl_mem memObject3 = clCreateBuffer(context, CL_MEM_WRITE_ONLY ,
sizeof(float) * 100, NULL, &error);
if (error < 0) {
printf("Creat memObject3 failed!\n");
return -1;
}
//设置内核参数
error = clSetKernelArg(kernel,0,sizeof(cl_mem),&memObject1);
error|= clSetKernelArg(kernel, 1, sizeof(cl_mem), &memObject2);
error |= clSetKernelArg(kernel, 2, sizeof(cl_mem), &memObject3);
if (error != CL_SUCCESS) {
printf("Error setting kernel arguments!\n");
return -1;
}
//执行内核
size_t globalWorkSize[1] = {100};
size_t localWorkSize[1] = {1};
error = clEnqueueNDRangeKernel(queue,kernel,1,NULL,globalWorkSize,
localWorkSize,0,NULL,NULL);
if (error != CL_SUCCESS) {
printf("Error queuing kernel for execution!\n");
return -1;
}
//读取执行结果
error = clEnqueueReadBuffer(queue,memObject3,CL_TRUE,0,100*sizeof(float),
result,0,NULL,NULL);
if (error != CL_SUCCESS) {
printf("Error reading result buffer!\n");
return -1;
}
//显示结果
for (int i = 0; i < 100; i++) {
printf("%f ",result[i]);
}
printf("\n");
//释放资源
clReleaseDevice(devices);
clReleaseContext(context);
clReleaseCommandQueue(queue);
clReleaseProgram(program);
clReleaseKernel(kernel);
clReleaseMemObject(memObject1);
clReleaseMemObject(memObject2);
clReleaseMemObject(memObject3);
return 0;
}
设备端代码:
__kernel void createBuffer(__global const float *a_in,
__global const float *b_in,
__global float *result) {
int gid = get_global_id(0);
result[gid] = a_in[gid] + b_in[gid];
}
编译命令不变,kernel.cl会被主文件读入,然后被ROCm动态编译为GPU端指令,通过ROCm runtime加载道GPU端运行,得到计算结果,计算结果符合预期:
作为驱动开发者,实际上最关心的是KFD端的调用序列,通过追踪可以看到,此时由于加入了设备端计算的功能,KFD的IOCTL调用序列明显比前面长了好多,其中包括了COMMAND QUEUE创建的IOCTL也被调用到,因为设备端代码要通过COMMAND QUEUE传递给AMDGPU去执行。对应此用例,TRACE到的KFD主要调用流程如下:
root@love-A520MS:/sys/kernel/debug/tracing# cat trace
# tracer: function
#
# entries-in-buffer/entries-written: 0/0 #P:12
#
# _-----=> irqs-off
# / _----=> need-resched
# | / _---=> hardirq/softirq
# || / _--=> preempt-depth
# ||| / _-=> migrate-disable
# |||| / delay
# TASK-PID CPU# ||||| TIMESTAMP FUNCTION
# | | | ||||| | |
root@love-A520MS:/sys/kernel/debug/tracing# cat trace
# tracer: function
#
# entries-in-buffer/entries-written: 36/36 #P:12
#
# _-----=> irqs-off
# / _----=> need-resched
# | / _---=> hardirq/softirq
# || / _--=> preempt-depth
# ||| / _-=> migrate-disable
# |||| / delay
# TASK-PID CPU# ||||| TIMESTAMP FUNCTION
# | | | ||||| | |
a.out-3866 [010] ..... 2681.619393: kfd_open <-chrdev_open
a.out-3866 [010] ..... 2681.619397: <stack trace>
=> kfd_open
=> chrdev_open
=> do_dentry_open
=> vfs_open
=> path_openat
=> do_filp_open
=> do_sys_openat2
=> do_sys_open
=> __x64_sys_openat
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [010] ..... 2681.619472: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
a.out-3866 [010] ..... 2681.619473: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_driver_open_kms
=> drm_file_alloc
=> drm_open
=> drm_stub_open
=> chrdev_open
=> do_dentry_open
=> vfs_open
=> path_openat
=> do_filp_open
=> do_sys_openat2
=> do_sys_open
=> __x64_sys_openat
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [010] ..... 2681.619522: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
a.out-3866 [010] ..... 2681.619523: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_driver_open_kms
=> drm_file_alloc
=> drm_open
=> drm_stub_open
=> chrdev_open
=> do_dentry_open
=> vfs_open
=> path_openat
=> do_filp_open
=> do_sys_openat2
=> do_sys_open
=> __x64_sys_openat
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [010] ..... 2681.619618: amdgpu_vm_set_pasid <-amdgpu_vm_fini
a.out-3866 [010] ..... 2681.619619: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_vm_fini
=> amdgpu_driver_postclose_kms
=> drm_file_free.part.0
=> drm_close_helper.isra.0
=> drm_release
=> __fput
=> ____fput
=> task_work_run
=> exit_to_user_mode_prepare
=> syscall_exit_to_user_mode
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [010] ..... 2681.619632: amdgpu_vm_set_pasid <-amdgpu_amdkfd_gpuvm_acquire_process_vm
a.out-3866 [010] ..... 2681.619632: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_amdkfd_gpuvm_acquire_process_vm
=> kfd_process_device_init_vm
=> kfd_ioctl_acquire_vm
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [010] ..... 2681.619634: amdgpu_vm_set_pasid <-amdgpu_amdkfd_gpuvm_acquire_process_vm
a.out-3866 [010] ..... 2681.619635: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_amdkfd_gpuvm_acquire_process_vm
=> kfd_process_device_init_vm
=> kfd_ioctl_acquire_vm
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [001] ..... 2681.644166: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
a.out-3866 [001] ..... 2681.644170: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_driver_open_kms
=> drm_file_alloc
=> drm_open
=> drm_stub_open
=> chrdev_open
=> do_dentry_open
=> vfs_open
=> path_openat
=> do_filp_open
=> do_sys_openat2
=> do_sys_open
=> __x64_sys_openat
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [001] ..... 2681.644827: amdgpu_vm_set_pasid <-amdgpu_vm_fini
a.out-3866 [001] ..... 2681.644829: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_vm_fini
=> amdgpu_driver_postclose_kms
=> drm_file_free.part.0
=> drm_close_helper.isra.0
=> drm_release
=> __fput
=> ____fput
=> task_work_run
=> exit_to_user_mode_prepare
=> syscall_exit_to_user_mode
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3869 [006] ..... 2681.691350: pqm_create_queue <-kfd_ioctl_create_queue
a.out-3869 [006] ..... 2681.691355: <stack trace>
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3869 [006] ..... 2681.691355: register_process <-pqm_create_queue
a.out-3869 [006] ..... 2681.691356: <stack trace>
=> register_process
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3869 [006] ..... 2681.691356: update_qpd_v9 <-register_process
a.out-3869 [006] ..... 2681.691357: <stack trace>
=> update_qpd_v9
=> register_process
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3869 [006] ..... 2681.692511: pqm_create_queue <-kfd_ioctl_create_queue
a.out-3869 [006] ..... 2681.692513: <stack trace>
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [001] ..... 2681.860371: pqm_create_queue <-kfd_ioctl_create_queue
a.out-3866 [001] ..... 2681.860377: <stack trace>
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [001] ..... 2681.861108: pqm_create_queue <-kfd_ioctl_create_queue
a.out-3866 [001] ..... 2681.861110: <stack trace>
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3869 [006] ..... 2681.861627: pqm_create_queue <-kfd_ioctl_create_queue
a.out-3869 [006] ..... 2681.861630: <stack trace>
=> pqm_create_queue
=> kfd_ioctl_create_queue
=> kfd_ioctl
=> __x64_sys_ioctl
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
a.out-3866 [001] ..... 2681.887874: kfd_release <-__fput
a.out-3866 [001] ..... 2681.887882: <stack trace>
=> kfd_release
=> __fput
=> ____fput
=> task_work_run
=> do_exit
=> do_group_exit
=> __x64_sys_exit_group
=> do_syscall_64
=> entry_SYSCALL_64_after_hwframe
kworker/1:0-3510 [001] ..... 2681.888555: amdgpu_vm_set_pasid <-amdgpu_vm_release_compute
kworker/1:0-3510 [001] ..... 2681.888559: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_vm_release_compute
=> amdgpu_amdkfd_gpuvm_release_process_vm
=> kfd_process_destroy_pdds
=> kfd_process_wq_release
=> process_one_work
=> worker_thread
=> kthread
=> ret_from_fork
kworker/1:0-3510 [001] ..... 2681.893914: amdgpu_vm_set_pasid <-amdgpu_vm_fini
kworker/1:0-3510 [001] ..... 2681.893919: <stack trace>
=> amdgpu_vm_set_pasid
=> amdgpu_vm_fini
=> amdgpu_driver_postclose_kms
=> drm_file_free.part.0
=> drm_close_helper.isra.0
=> drm_release
=> __fput
=> delayed_fput
=> process_one_work
=> worker_thread
=> kthread
=> ret_from_fork
root@love-A520MS:/sys/kernel/debug/tracing#
完整的KFD调用序列记录如下,方便以后分析:
5684 00:08:54.545211 ioctl(5, AMDKFD_IOC_GET_VERSION, 0x7ffe0edc1e00) = 0 <0.000005>
5684 00:08:54.549152 ioctl(5, AMDKFD_IOC_GET_PROCESS_APERTURES_NEW, 0x7ffe0edc1ab0) = 0 <0.000005>
5684 00:08:54.549169 ioctl(5, AMDKFD_IOC_ACQUIRE_VM, 0x7ffe0edc1ab0) = 0 <0.000033>
5684 00:08:54.549262 ioctl(5, AMDKFD_IOC_SET_MEMORY_POLICY, 0x7ffe0edc1ab0) = 0 <0.000004>
5684 00:08:54.549301 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1970) = 0 <0.000007>
5684 00:08:54.549333 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1990) = 0 <0.000091>
5684 00:08:54.581556 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffe0edc1a40) = 0 <0.000006>
5684 00:08:54.581583 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffe0edc1e30) = 0 <0.000004>
5684 00:08:54.581626 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1b90) = 0 <0.000012>
5684 00:08:54.581677 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1c60) = 0 <0.000239>
5684 00:08:54.581933 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1db0) = 0 <0.000014>
5684 00:08:54.582012 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1ad0) = 0 <0.000022>
5684 00:08:54.582043 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1b00) = 0 <0.000029>
5684 00:08:54.582084 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1ca0) = 0 <0.000004>
5684 00:08:54.582259 ioctl(5, AMDKFD_IOC_SET_SCRATCH_BACKING_VA, 0x7ffe0edc1d40) = 0 <0.000002>
5684 00:08:54.582322 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1750) = 0 <0.000010>
5684 00:08:54.582342 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1780) = 0 <0.000031>
5684 00:08:54.582388 ioctl(5, AMDKFD_IOC_SET_TRAP_HANDLER, 0x7ffe0edc1e10) = 0 <0.000006>
5687 00:08:54.582511 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5684 00:08:54.587645 ioctl(5, AMDKFD_IOC_GET_TILE_CONFIG, 0x7ffe0edc1310) = 0 <0.000005>
5684 00:08:54.587777 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19d0) = 0 <0.000153>
5684 00:08:54.587945 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000246>
5684 00:08:54.588269 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19d0) = 0 <0.000146>
5684 00:08:54.588429 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000035>
5684 00:08:54.588477 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1be0) = 0 <0.000007>
5689 00:08:54.650506 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef744e0) = 0 <0.000028>
5689 00:08:54.650547 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74510) = 0 <0.000222>
5689 00:08:54.650832 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74490) = 0 <0.000009>
5689 00:08:54.650851 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef744c0) = 0 <0.000035>
5689 00:08:54.650897 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74700) = 0 <0.000006>
5689 00:08:54.650964 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74240) = 0 <0.000008>
5689 00:08:54.650982 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000034>
5689 00:08:54.651053 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74200) = 0 <0.000008>
5689 00:08:54.651090 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000036>
5689 00:08:54.651186 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74240) = 0 <0.000376>
5689 00:08:54.651573 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000114>
5689 00:08:54.651697 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef74420) = 0 <0.000177>
5689 00:08:54.651914 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef742c0) = 0 <0.000008>
5689 00:08:54.651945 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74330) = 0 <0.000025>
5689 00:08:54.651981 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74710) = 0 <0.000007>
5689 00:08:54.652000 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74710) = 0 <0.000006>
5689 00:08:54.652067 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74510) = 0 <0.000010>
5689 00:08:54.652086 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74540) = 0 <0.000024>
5689 00:08:54.652175 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745f0) = 0 <0.000009>
5689 00:08:54.652196 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74620) = 0 <0.000028>
5687 00:08:54.652231 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000008>
5687 00:08:54.652251 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689 00:08:54.652295 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745a0) = 0 <0.000048>
5689 00:08:54.652353 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef745d0) = 0 <0.000029>
5689 00:08:54.652446 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74350) = 0 <0.000010>
5689 00:08:54.652467 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000024>
5689 00:08:54.652531 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74310) = 0 <0.000008>
5689 00:08:54.652565 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000030>
5689 00:08:54.652654 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74350) = 0 <0.000390>
5689 00:08:54.653057 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000119>
5689 00:08:54.653190 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef74530) = 0 <0.000068>
5689 00:08:54.653271 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74820) = 0 <0.000007>
5689 00:08:54.653290 ioctl(5, AMDKFD_IOC_SET_EVENT <unfinished ...>
5689 00:08:54.653366 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74620) = 0 <0.000010>
5689 00:08:54.653386 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74650) = 0 <0.000025>
5689 00:08:54.653480 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU <unfinished ...>
5687 00:08:54.653532 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000005>
5687 00:08:54.653551 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689 00:08:54.653590 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74a30) = 0 <0.000025>
5689 00:08:54.836246 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef73c80) = 0 <0.000022>
5689 00:08:54.836303 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef73cf0) = 0 <0.000049>
5689 00:08:54.836417 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef73da0) = 0 <0.000019>
5689 00:08:54.836447 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef73dd0) = 0 <0.000031>
5689 00:08:54.836509 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74690) = 0 <0.000007>
5689 00:08:54.836582 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74590) = 0 <0.000010>
5689 00:08:54.836603 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef745c0) = 0 <0.000029>
5689 00:08:54.836696 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000007>
5689 00:08:54.836714 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000023>
5689 00:08:54.836800 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000007>
5689 00:08:54.836818 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000027>
5689 00:08:54.837235 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000018>
5689 00:08:54.837266 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000085>
5689 00:08:54.837497 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74840) = 0 <0.000009>
5689 00:08:54.837519 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74840) = 0 <0.000025>
5689 00:08:54.837558 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000007>
5689 00:08:54.837577 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000005>
5689 00:08:54.837599 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000007>
5689 00:08:54.837618 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837632 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837647 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837662 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837676 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837691 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837705 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000008>
5689 00:08:54.837723 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837738 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837752 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837766 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689 00:08:54.837835 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef748b0) = 0 <0.000011>
5689 00:08:54.837857 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef748e0) = 0 <0.000080>
5689 00:08:54.837951 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.837971 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000009>
5689 00:08:54.837999 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000009>
5689 00:08:54.838024 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838046 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838067 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838088 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838109 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838130 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838151 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838172 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838193 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838214 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838236 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838257 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838278 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838299 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689 00:08:54.838321 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5684 00:08:54.838720 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc14a0) = 0 <0.000020>
5684 00:08:54.838757 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc14d0) = 0 <0.000032>
5684 00:08:54.838963 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1840) = 0 <0.000014>
5684 00:08:54.838994 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1870) = 0 <0.000032>
5684 00:08:54.839099 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc17f0) = 0 <0.000044>
5684 00:08:54.839154 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1820) = 0 <0.000024>
5684 00:08:54.839247 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc15a0) = 0 <0.000008>
5684 00:08:54.839266 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000027>
5684 00:08:54.839331 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1560) = 0 <0.000007>
5684 00:08:54.839366 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000032>
5684 00:08:54.839457 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc15a0) = 0 <0.000281>
5684 00:08:54.839754 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000104>
5684 00:08:54.839873 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7ffe0edc1780) = 0 <0.000162>
5684 00:08:54.840049 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7ffe0edc1a70) = 0 <0.000006>
5684 00:08:54.840071 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7ffe0edc1a70) = 0 <0.000003>
5684 00:08:54.840148 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1870) = 0 <0.000010>
5684 00:08:54.840169 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc18a0) = 0 <0.000032>
5684 00:08:54.840267 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU <unfinished ...>
5687 00:08:54.840306 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000007>
5687 00:08:54.840324 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5684 00:08:54.840351 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1c80) = 0 <0.000033>
5684 00:08:54.840433 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1a90) = 0 <0.000007>
5684 00:08:54.840452 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1a90) = 0 <0.000024>
5684 00:08:54.840489 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000005>
5684 00:08:54.840506 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840520 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840534 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840548 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840562 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840576 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840589 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840603 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840617 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840630 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840644 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840658 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840672 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840686 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840700 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840714 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840728 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840741 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840755 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840769 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840782 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840796 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840810 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840824 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840837 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840854 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840869 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840883 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000009>
5684 00:08:54.840902 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684 00:08:54.840916 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840930 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684 00:08:54.840998 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19b0) = 0 <0.000130>
5684 00:08:54.841144 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000119>
5684 00:08:54.841363 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc16e0) = 0 <0.000008>
5684 00:08:54.841382 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1750) = 0 <0.000023>
5684 00:08:54.841416 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7ffe0edc18c0) = 0 <0.000025>
5684 00:08:54.841452 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1b60) = 0 <0.000004>
5684 00:08:54.841466 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1b60) = 0 <0.000004>
5689 00:08:54.841551 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7fae7ef748a0) = 0 <0.000007>
5689 00:08:54.841637 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745d0) = 0 <0.000150>
5689 00:08:54.841800 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74600) = 0 <0.000090>
5689 00:08:54.841996 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74300) = 0 <0.000010>
5689 00:08:54.842018 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74370) = 0 <0.000024>
5689 00:08:54.842054 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef744e0) = 0 <0.000033>
5689 00:08:54.842099 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74780) = 0 <0.000005>
5689 00:08:54.842172 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef744e0) = 0 <0.000011>
5689 00:08:54.842194 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74510) = 0 <0.000029>
5689 00:08:54.842235 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74780) = 0 <0.000004>
5689 00:08:54.842440 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c30) = 0 <0.000011>
5689 00:08:54.842468 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c70) = 0 <0.000011>
5689 00:08:54.842517 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bf0) = 0 <0.000006>
5689 00:08:54.842536 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c40) = 0 <0.000010>
5689 00:08:54.842603 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74d10) = 0 <0.000006>
5687 00:08:54.842634 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7f7e8da0) = 0 <0.000007>
5689 00:08:54.842654 ioctl(5, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5687 00:08:54.842660 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7f7e8df0) = 0 <0.000007>
5689 00:08:54.842752 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c30) = 0 <0.000007>
5689 00:08:54.842770 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c80) = 0 <0.000006>
5689 00:08:54.842841 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5687 00:08:54.842879 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689 00:08:54.842899 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5687 00:08:54.842906 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689 00:08:54.843095 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c50) = 0 <0.000006>
5689 00:08:54.843114 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74ca0) = 0 <0.000007>
5689 00:08:54.843151 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74ba0) = 0 <0.000006>
5689 00:08:54.843167 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74bf0) = 0 <0.000007>
5689 00:08:54.843220 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bc0) = 0 <0.000006>
5689 00:08:54.843239 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c10) = 0 <0.000006>
5689 00:08:54.843279 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bc0) = 0 <0.000006>
5689 00:08:54.843295 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c10) = 0 <0.000007>
5684 00:08:54.843339 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffe0edc1f60) = 0 <0.000007>
5684 00:08:54.843355 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffe0edc1fb0) = 0 <0.000008>
runtime arch
OpenMP测试:
进入目录/opt/rocm-5.1.0/llvm/examples/openmp/veccopy,执行如下编译:
/opt/rocm-5.1.0/llvm/bin/clang -O3 -target x86_64-pc-linux-gnu -fopenmp -fopenmp-targets=amdgcn-amd-amdhsa -Xopenmp-target=amdgcn-amd-amdhsa -march=gfx908 veccopy.c -o veccopy
rocm_agent_enumerator用于发现支持AMD HSA的agent设备,测试环境发现了两个agent,分别是CPU和GPU。我们测试使用的是gfx908:
编译提示我们用错了offload arch, 所以可能无法将计算offloading 到device.不过没关系,不影响测试:
测试发现,openmp的计算实际上也是offload到GPU上运行的:
完整的TRACE LOG,日后分析:
5355 22:34:07.032008 execve("./veccopy", ["./veccopy"], 0x7ffcd9d23a78 /* 33 vars */) = 0 <0.000279>
5355 22:34:07.032525 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (没有那个文件或目录) <0.000016>
5355 22:34:07.032710 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000016>
5355 22:34:07.032772 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000024>
5355 22:34:07.032832 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000013>
5355 22:34:07.032876 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.032917 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.032958 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355 22:34:07.032997 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.033037 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355 22:34:07.033076 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.033117 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.033156 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000013>
5355 22:34:07.033197 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355 22:34:07.033236 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.033276 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355 22:34:07.033316 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomp.so", O_RDONLY|O_CLOEXEC) = 3 <0.000014>
5355 22:34:07.033584 close(3) = 0 <0.000012>
5355 22:34:07.033631 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.so", O_RDONLY|O_CLOEXEC) = 3 <0.000015>
5355 22:34:07.033862 close(3) = 0 <0.000011>
5355 22:34:07.033905 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libpthread.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000014>
5355 22:34:07.033946 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355 22:34:07.033984 close(3) = 0 <0.000004>
5355 22:34:07.033999 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.034100 close(3) = 0 <0.000003>
5355 22:34:07.034114 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.034132 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.034264 close(3) = 0 <0.000003>
5355 22:34:07.034280 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355 22:34:07.034355 close(3) = 0 <0.000004>
5355 22:34:07.034370 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.034445 close(3) = 0 <0.000003>
5355 22:34:07.034471 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libclang-cpp.so.14git", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.034547 close(3) = 0 <0.000003>
5355 22:34:07.034566 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.034586 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.034602 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034616 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034631 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034645 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034660 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034674 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034688 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034702 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034716 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034730 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034745 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034759 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034774 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034788 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034802 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib", {st_mode=S_IFDIR|0755, st_size=16384, ...}) = 0 <0.000004>
5355 22:34:07.034818 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.034835 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034849 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034864 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034879 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034893 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034907 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034921 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034935 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034952 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034967 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034981 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.034995 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035010 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035024 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.035038 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355 22:34:07.035055 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libm.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355 22:34:07.035136 close(3) = 0 <0.000003>
5355 22:34:07.035152 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.035167 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035182 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035197 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libz.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.035286 close(3) = 0 <0.000003>
5355 22:34:07.035299 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035314 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035329 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035344 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.035428 close(3) = 0 <0.000003>
5355 22:34:07.035447 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.035466 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.035482 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.035498 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.035600 close(3) = 0 <0.000003>
5355 22:34:07.035617 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.035632 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.035647 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.035663 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.035740 close(3) = 0 <0.000003>
5355 22:34:07.042002 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000010>
5355 22:34:07.042076 close(3) = 0 <0.000004>
5355 22:34:07.042102 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.042122 stat("/lib/x86_64-linux-gnu/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042140 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042156 stat("/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042171 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042187 stat("/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042202 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042218 stat("/lib/x86_64-linux-gnu/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042233 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042249 stat("/lib/x86_64-linux-gnu/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042264 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042281 stat("/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042296 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042312 stat("/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042327 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042343 stat("/lib/x86_64-linux-gnu", {st_mode=S_IFDIR|0755, st_size=69632, ...}) = 0 <0.000004>
5355 22:34:07.042360 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042376 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042391 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042407 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042422 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042438 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042453 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042469 stat("/usr/lib/x86_64-linux-gnu/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042484 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042500 stat("/usr/lib/x86_64-linux-gnu/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042515 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042531 stat("/usr/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042555 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042573 stat("/usr/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042588 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042604 stat("/usr/lib/x86_64-linux-gnu", {st_mode=S_IFDIR|0755, st_size=69632, ...}) = 0 <0.000004>
5355 22:34:07.042621 openat(AT_FDCWD, "/lib/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042637 stat("/lib/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042652 openat(AT_FDCWD, "/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042667 stat("/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042682 openat(AT_FDCWD, "/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042698 stat("/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042713 openat(AT_FDCWD, "/lib/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042729 stat("/lib/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042744 openat(AT_FDCWD, "/lib/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042760 stat("/lib/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042774 openat(AT_FDCWD, "/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.042791 stat("/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042806 openat(AT_FDCWD, "/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042821 stat("/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042836 openat(AT_FDCWD, "/lib/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042851 stat("/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355 22:34:07.042868 openat(AT_FDCWD, "/usr/lib/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042884 stat("/usr/lib/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042899 openat(AT_FDCWD, "/usr/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042914 stat("/usr/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042929 openat(AT_FDCWD, "/usr/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042944 stat("/usr/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042959 openat(AT_FDCWD, "/usr/lib/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042974 stat("/usr/lib/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.042989 openat(AT_FDCWD, "/usr/lib/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043004 stat("/usr/lib/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043019 openat(AT_FDCWD, "/usr/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043037 stat("/usr/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043053 openat(AT_FDCWD, "/usr/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043068 stat("/usr/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043083 openat(AT_FDCWD, "/usr/lib/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043099 stat("/usr/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355 22:34:07.043133 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.043168 close(3) = 0 <0.000003>
5355 22:34:07.043184 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.043200 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043216 openat(AT_FDCWD, "/lib/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043231 openat(AT_FDCWD, "/usr/lib/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.043326 statfs("/dev/shm/", {f_type=TMPFS_MAGIC, f_bsize=4096, f_blocks=1966975, f_bfree=1883383, f_bavail=1883383, f_files=1966975, f_ffree=1965794, f_fsid={val=[0, 0]}, f_namelen=255, f_frsize=4096, f_flags=ST_VALID|ST_NOSUID|ST_NODEV}) = 0 <0.000007>
5355 22:34:07.043364 openat(AT_FDCWD, "/dev/shm/__KMP_REGISTERED_LIB_5355_0", O_RDWR|O_CREAT|O_EXCL|O_NOFOLLOW|O_CLOEXEC, 0666) = 3 <0.000026>
5355 22:34:07.043456 close(3) = 0 <0.000005>
5355 22:34:07.043482 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000009>
5355 22:34:07.043564 close(3) = 0 <0.000004>
5355 22:34:07.043655 openat(AT_FDCWD, "/usr/share/locale/zh_CN.UTF-8/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.043674 openat(AT_FDCWD, "/usr/share/locale/zh_CN.UTF-8/LC_MESSAGES/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.043692 openat(AT_FDCWD, "/usr/share/locale/zh/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.043708 openat(AT_FDCWD, "/usr/share/locale/zh/LC_MESSAGES/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.044163 stat("/sys/firmware/devicetree/base/ibm,firmware-versions/open-power", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000019>
5355 22:34:07.044215 stat("/sys/firmware/devicetree/base/cpus/ibm,powerpc-cpu-features", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355 22:34:07.044256 stat("/sys/firmware/acpi", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355 22:34:07.044300 stat("/sys/module/acpi", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355 22:34:07.044350 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.rtl.x86_64.so", O_RDONLY|O_CLOEXEC) = 3 <0.000015>
5355 22:34:07.044578 close(3) = 0 <0.000010>
5355 22:34:07.044620 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000014>
5355 22:34:07.044705 close(3) = 0 <0.000009>
5355 22:34:07.044746 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libelf.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000013>
5355 22:34:07.044940 close(3) = 0 <0.000010>
5355 22:34:07.045224 stat("/dev/nvidia0", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.045241 stat("/sys/module/mdio_thunder/initstate", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.045258 stat("fixme.so", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045273 stat("/dev/kfd", {st_mode=S_IFCHR|0660, st_rdev=makedev(0xea, 0), ...}) = 0 <0.000005>
5355 22:34:07.045292 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.rtl.amdgpu.so", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.045383 close(3) = 0 <0.000004>
5355 22:34:07.045403 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.045421 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.045439 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355 22:34:07.045515 close(3) = 0 <0.000003>
5355 22:34:07.045535 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.045551 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045567 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045582 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045597 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045612 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045627 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045641 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045656 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045671 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045686 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045700 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045715 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045730 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045745 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045760 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045774 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045789 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045804 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045819 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045837 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045852 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045867 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045881 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045896 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045910 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045925 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045940 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045955 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045969 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045984 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.045999 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046014 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046028 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046043 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046058 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046073 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046087 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046102 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046117 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046132 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046146 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046161 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046179 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046195 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046210 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046225 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046239 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046254 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355 22:34:07.046268 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000004>
5355 22:34:07.046300 close(3) = 0 <0.000003>
5355 22:34:07.046316 openat(AT_FDCWD, "/opt/amdgpu/lib/x86_64-linux-gnu/libdrm.so.2", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.046394 close(3) = 0 <0.000003>
5355 22:34:07.046409 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libdrm_amdgpu.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.046426 openat(AT_FDCWD, "/opt/amdgpu/lib/x86_64-linux-gnu/libdrm_amdgpu.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.046498 close(3) = 0 <0.000003>
5355 22:34:07.046513 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libnuma.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355 22:34:07.046530 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libnuma.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355 22:34:07.046612 close(3) = 0 <0.000003>
5355 22:34:07.046927 openat(AT_FDCWD, "/proc/self/status", O_RDONLY) = 3 <0.000013>
5355 22:34:07.046995 close(3) = 0 <0.000005>
5355 22:34:07.047011 openat(AT_FDCWD, "/sys/devices/system/node", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000006>
5355 22:34:07.047051 openat(AT_FDCWD, "/sys/devices/system/node/node0/meminfo", O_RDONLY) = 4 <0.000007>
5355 22:34:07.047106 close(4) = 0 <0.000004>
5355 22:34:07.047129 close(3) = 0 <0.000004>
5355 22:34:07.047151 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000005>
5355 22:34:07.047193 close(3) = 0 <0.000003>
5355 22:34:07.047206 openat(AT_FDCWD, "/proc/self/status", O_RDONLY) = 3 <0.000007>
5355 22:34:07.047267 close(3) = 0 <0.000004>
5355 22:34:07.057387 openat(AT_FDCWD, "/dev/kfd", O_RDWR|O_CLOEXEC) = 3 <0.001855>
5355 22:34:07.059272 ioctl(3, AMDKFD_IOC_GET_VERSION, 0x7ffd164f7190) = 0 <0.000008>
5355 22:34:07.059301 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/system_properties", O_RDONLY) = 4 <0.000014>
5355 22:34:07.059417 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000015>
5355 22:34:07.059544 close(5) = 0 <0.000006>
5355 22:34:07.059571 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 5 <0.000011>
5355 22:34:07.059631 close(5) = 0 <0.000007>
5355 22:34:07.059655 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 5 <0.000009>
5355 22:34:07.059704 close(5) = 0 <0.000006>
5355 22:34:07.059726 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 5 <0.000009>
5355 22:34:07.059800 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 6 <0.000026>
5355 22:34:07.059847 close(5) = 0 <0.000006>
5355 22:34:07.059870 close(4) = 0 <0.000006>
5355 22:34:07.059893 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 4 <0.000010>
5355 22:34:07.059953 close(4) = 0 <0.000006>
5355 22:34:07.059975 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/properties", O_RDONLY) = 4 <0.000006>
5355 22:34:07.060028 close(4) = 0 <0.000004>
5355 22:34:07.060042 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 4 <0.000009>
5355 22:34:07.060085 close(4) = 0 <0.000005>
5355 22:34:07.060100 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 4 <0.000005>
5355 22:34:07.060157 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 5 <0.000013>
5355 22:34:07.060199 stat("/sys/dev/char/226:128/device/drm", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355 22:34:07.060227 ioctl(5, DRM_IOCTL_VERSION, 0x1122ce0) = 0 <0.000004>
5355 22:34:07.060242 ioctl(5, DRM_IOCTL_VERSION, 0x1122ce0) = 0 <0.000004>
5355 22:34:07.060264 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a50) = 0 <0.000004>
5355 22:34:07.060279 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a20) = 0 <0.000030>
5355 22:34:07.060319 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a20) = 0 <0.000038>
5355 22:34:07.060369 openat(AT_FDCWD, "/opt/amdgpu/share/libdrm/amdgpu.ids", O_RDONLY) = 8 <0.000006>
5355 22:34:07.060445 close(8) = 0 <0.000004>
5355 22:34:07.060459 close(7) = 0 <0.000009>
5355 22:34:07.060502 close(5) = 0 <0.000015>
5355 22:34:07.060527 close(4) = 0 <0.000004>
5355 22:34:07.060541 ioctl(3, AMDKFD_IOC_GET_PROCESS_APERTURES_NEW, 0x7ffd164f6e40) = 0 <0.000004>
5355 22:34:07.060555 ioctl(3, AMDKFD_IOC_ACQUIRE_VM, 0x7ffd164f6e40) = 0 <0.000033>
5355 22:34:07.060645 ioctl(3, AMDKFD_IOC_SET_MEMORY_POLICY, 0x7ffd164f6e40) = 0 <0.000004>
5355 22:34:07.060683 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d00) = 0 <0.000007>
5355 22:34:07.060717 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d20) = 0 <0.000224>
5355 22:34:07.060955 openat(AT_FDCWD, "/sys/bus/event_source/devices/amd_iommu_0/events", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = -1 ENOENT (没有那个文件或目录) <0.000010>
5355 22:34:07.060979 openat(AT_FDCWD, "/sys/bus/event_source/devices/amd_iommu/events", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.061002 openat(AT_FDCWD, "/dev/shm/sem.hsakmt_semaphore", O_RDWR|O_NOFOLLOW) = 4 <0.000006>
5355 22:34:07.061040 close(4) = 0 <0.000004>
5355 22:34:07.061054 openat(AT_FDCWD, "/dev/shm/hsakmt_shared_mem", O_RDWR|O_CREAT|O_NOFOLLOW|O_CLOEXEC, 0666) = 4 <0.000005>
5355 22:34:07.061100 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x82, 0x28), 0x7ffd164f7130) = 0 <0.000004>
5355 22:34:07.061123 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x82, 0x28), 0x7ffd164f71a0) = 0 <0.000005>
5355 22:34:07.061141 openat(AT_FDCWD, "/sys/devices/system/cpu/online", O_RDONLY|O_CLOEXEC) = 5 <0.000006>
5355 22:34:07.061169 close(5) = 0 <0.000004>
5355 22:34:07.061183 openat(AT_FDCWD, "/proc/cpuinfo", O_RDONLY) = 5 <0.018582>
5355 22:34:07.080934 close(5) = 0 <0.000015>
5355 22:34:07.081007 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/generation_id", O_RDONLY) = 5 <0.000037>
5355 22:34:07.081143 close(5) = 0 <0.000014>
5355 22:34:07.081182 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/system_properties", O_RDONLY) = 5 <0.000017>
5355 22:34:07.081298 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000015>
5355 22:34:07.081415 close(7) = 0 <0.000011>
5355 22:34:07.081454 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 7 <0.000018>
5355 22:34:07.081544 close(7) = 0 <0.000011>
5355 22:34:07.081579 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 7 <0.000017>
5355 22:34:07.081665 close(7) = 0 <0.000011>
5355 22:34:07.081714 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 7 <0.000016>
5355 22:34:07.081846 close(7) = 0 <0.000011>
5355 22:34:07.081880 close(5) = 0 <0.000011>
5355 22:34:07.081916 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 5 <0.000015>
5355 22:34:07.081997 close(5) = 0 <0.000010>
5355 22:34:07.082032 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/properties", O_RDONLY) = 5 <0.000015>
5355 22:34:07.082163 close(5) = 0 <0.000011>
5355 22:34:07.082199 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/mem_banks/0/properties", O_RDONLY) = 5 <0.000017>
5355 22:34:07.082307 close(5) = 0 <0.000011>
5355 22:34:07.082344 openat(AT_FDCWD, "/sys/devices/system/node/node0", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000015>
5355 22:34:07.082506 close(5) = 0 <0.000010>
5355 22:34:07.082539 openat(AT_FDCWD, "/sys/devices/system/node/node0", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000013>
5355 22:34:07.082641 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000018>
5355 22:34:07.082749 close(7) = 0 <0.000010>
5355 22:34:07.082786 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000019>
5355 22:34:07.082874 close(7) = 0 <0.000012>
5355 22:34:07.082910 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.082996 close(7) = 0 <0.000010>
5355 22:34:07.083030 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.083115 close(7) = 0 <0.000010>
5355 22:34:07.083149 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.083233 close(7) = 0 <0.000011>
5355 22:34:07.083267 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000017>
5355 22:34:07.083374 close(7) = 0 <0.000015>
5355 22:34:07.083427 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.083517 close(7) = 0 <0.000011>
5355 22:34:07.083552 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.083636 close(7) = 0 <0.000011>
5355 22:34:07.083670 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.083775 close(7) = 0 <0.000021>
5355 22:34:07.083824 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.083908 close(7) = 0 <0.000011>
5355 22:34:07.083944 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000016>
5355 22:34:07.084048 close(7) = 0 <0.000011>
5355 22:34:07.084085 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.084171 close(7) = 0 <0.000010>
5355 22:34:07.084206 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.084290 close(7) = 0 <0.000011>
5355 22:34:07.084325 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.084408 close(7) = 0 <0.000010>
5355 22:34:07.084442 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.084526 close(7) = 0 <0.000011>
5355 22:34:07.084561 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000016>
5355 22:34:07.084673 close(7) = 0 <0.000011>
5355 22:34:07.084712 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.084796 close(7) = 0 <0.000011>
5355 22:34:07.084831 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/level", O_RDONLY) = 7 <0.000018>
5355 22:34:07.084917 close(7) = 0 <0.000011>
5355 22:34:07.084953 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/type", O_RDONLY) = 7 <0.000016>
5355 22:34:07.085035 close(7) = 0 <0.000011>
5355 22:34:07.085070 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.085154 close(7) = 0 <0.000011>
5355 22:34:07.085189 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000018>
5355 22:34:07.085648 close(7) = 0 <0.000035>
5355 22:34:07.085723 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000031>
5355 22:34:07.085824 close(7) = 0 <0.000011>
5355 22:34:07.085860 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000018>
5355 22:34:07.085946 close(7) = 0 <0.000011>
5355 22:34:07.085981 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086068 close(7) = 0 <0.000010>
5355 22:34:07.086104 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086190 close(7) = 0 <0.000010>
5355 22:34:07.086223 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/level", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086309 close(7) = 0 <0.000011>
5355 22:34:07.086343 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/type", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086428 close(7) = 0 <0.000010>
5355 22:34:07.086462 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.086547 close(7) = 0 <0.000010>
5355 22:34:07.086580 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.086663 close(7) = 0 <0.000010>
5355 22:34:07.086698 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086782 close(7) = 0 <0.000010>
5355 22:34:07.086816 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000017>
5355 22:34:07.086899 close(7) = 0 <0.000010>
5355 22:34:07.086933 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355 22:34:07.087017 close(7) = 0 <0.000010>
5355 22:34:07.087052 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.087136 close(7) = 0 <0.000010>
5355 22:34:07.087169 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/level", O_RDONLY) = 7 <0.000016>
5355 22:34:07.087253 close(7) = 0 <0.000010>
5355 22:34:07.087286 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/type", O_RDONLY) = 7 <0.000017>
5355 22:34:07.087371 close(7) = 0 <0.000026>
5355 22:34:07.087436 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/size", O_RDONLY) = 7 <0.000025>
5355 22:34:07.087551 close(7) = 0 <0.000010>
5355 22:34:07.087585 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000017>
5355 22:34:07.087668 close(7) = 0 <0.000011>
5355 22:34:07.087702 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355 22:34:07.087784 close(7) = 0 <0.000011>
5355 22:34:07.087827 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355 22:34:07.087913 close(7) = 0 <0.000010>
5355 22:34:07.087947 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355 22:34:07.088031 close(7) = 0 <0.000011>
5355 22:34:07.088066 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.088149 close(7) = 0 <0.000010>
5355 22:34:07.088185 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000017>
5355 22:34:07.088299 close(7) = 0 <0.000011>
5355 22:34:07.088339 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.088427 close(7) = 0 <0.000011>
5355 22:34:07.088463 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/level", O_RDONLY) = 7 <0.000017>
5355 22:34:07.088546 close(7) = 0 <0.000010>
5355 22:34:07.088580 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/type", O_RDONLY) = 7 <0.000017>
5355 22:34:07.088664 close(7) = 0 <0.000011>
5355 22:34:07.088699 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/size", O_RDONLY) = 7 <0.000018>
5355 22:34:07.088784 close(7) = 0 <0.000011>
5355 22:34:07.088819 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.088901 close(7) = 0 <0.000010>
5355 22:34:07.088936 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089019 close(7) = 0 <0.000010>
5355 22:34:07.089053 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089134 close(7) = 0 <0.000010>
5355 22:34:07.089168 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089252 close(7) = 0 <0.000010>
5355 22:34:07.089286 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355 22:34:07.089386 close(7) = 0 <0.000015>
5355 22:34:07.089427 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/level", O_RDONLY) = 7 <0.000017>
5355 22:34:07.089511 close(7) = 0 <0.000010>
5355 22:34:07.089545 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/type", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089628 close(7) = 0 <0.000011>
5355 22:34:07.089662 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089748 close(7) = 0 <0.000011>
5355 22:34:07.089782 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000017>
5355 22:34:07.089865 close(7) = 0 <0.000010>
5355 22:34:07.089899 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355 22:34:07.089983 close(7) = 0 <0.000010>
5355 22:34:07.090017 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000017>
5355 22:34:07.090100 close(7) = 0 <0.000010>
5355 22:34:07.090134 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355 22:34:07.090218 close(7) = 0 <0.000010>
5355 22:34:07.090252 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355 22:34:07.090336 close(7) = 0 <0.000010>
5355 22:34:07.090369 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/level", O_RDONLY) = 7 <0.000016>
5355 22:34:07.090451 close(7) = 0 <0.000018>
5355 22:34:07.090498 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/type", O_RDONLY) = 7 <0.000016>
5355 22:34:07.090585 close(7) = 0 <0.000011>
5355 22:34:07.090619 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/size", O_RDONLY) = 7 <0.000017>
5355 22:34:07.090703 close(7) = 0 <0.000010>
5355 22:34:07.090737 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355 22:34:07.090819 close(7) = 0 <0.000011>
5355 22:34:07.090854 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000018>
5355 22:34:07.090938 close(7) = 0 <0.000010>
5355 22:34:07.090972 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355 22:34:07.091057 close(7) = 0 <0.000010>
5355 22:34:07.091089 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000007>
5355 22:34:07.091127 close(7) = 0 <0.000004>
5355 22:34:07.091140 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091173 close(7) = 0 <0.000004>
5355 22:34:07.091186 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355 22:34:07.091227 close(7) = 0 <0.000004>
5355 22:34:07.091241 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.091275 close(7) = 0 <0.000004>
5355 22:34:07.091289 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/level", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091321 close(7) = 0 <0.000004>
5355 22:34:07.091334 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/type", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091366 close(7) = 0 <0.000003>
5355 22:34:07.091381 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/size", O_RDONLY) = 7 <0.000007>
5355 22:34:07.091425 close(7) = 0 <0.000004>
5355 22:34:07.091438 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091471 close(7) = 0 <0.000003>
5355 22:34:07.091483 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091515 close(7) = 0 <0.000004>
5355 22:34:07.091528 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091560 close(7) = 0 <0.000003>
5355 22:34:07.091572 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000007>
5355 22:34:07.091605 close(7) = 0 <0.000003>
5355 22:34:07.091618 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091650 close(7) = 0 <0.000004>
5355 22:34:07.091663 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/level", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091694 close(7) = 0 <0.000003>
5355 22:34:07.091706 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/type", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091738 close(7) = 0 <0.000003>
5355 22:34:07.091751 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091783 close(7) = 0 <0.000003>
5355 22:34:07.091795 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091827 close(7) = 0 <0.000003>
5355 22:34:07.091840 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091871 close(7) = 0 <0.000004>
5355 22:34:07.091886 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091918 close(7) = 0 <0.000004>
5355 22:34:07.091931 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000006>
5355 22:34:07.091963 close(7) = 0 <0.000004>
5355 22:34:07.091976 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092008 close(7) = 0 <0.000004>
5355 22:34:07.092022 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/level", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092053 close(7) = 0 <0.000003>
5355 22:34:07.092065 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/type", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092098 close(7) = 0 <0.000004>
5355 22:34:07.092110 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/size", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092143 close(7) = 0 <0.000004>
5355 22:34:07.092155 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092187 close(7) = 0 <0.000004>
5355 22:34:07.092200 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092231 close(7) = 0 <0.000003>
5355 22:34:07.092244 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092276 close(7) = 0 <0.000003>
5355 22:34:07.092288 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092320 close(7) = 0 <0.000003>
5355 22:34:07.092333 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092366 close(7) = 0 <0.000003>
5355 22:34:07.092378 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355 22:34:07.092420 close(7) = 0 <0.000003>
5355 22:34:07.092434 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092467 close(7) = 0 <0.000004>
5355 22:34:07.092479 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092513 close(7) = 0 <0.000004>
5355 22:34:07.092526 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092562 close(7) = 0 <0.000004>
5355 22:34:07.092576 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092608 close(7) = 0 <0.000004>
5355 22:34:07.092621 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355 22:34:07.092663 close(7) = 0 <0.000003>
5355 22:34:07.092676 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092709 close(7) = 0 <0.000004>
5355 22:34:07.092721 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092754 close(7) = 0 <0.000004>
5355 22:34:07.092766 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092798 close(7) = 0 <0.000003>
5355 22:34:07.092811 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092845 close(7) = 0 <0.000004>
5355 22:34:07.092858 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355 22:34:07.092901 close(7) = 0 <0.000003>
5355 22:34:07.092914 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355 22:34:07.092947 close(7) = 0 <0.000003>
5355 22:34:07.092959 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.092989 close(7) = 0 <0.000003>
5355 22:34:07.093002 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.093032 close(7) = 0 <0.000003>
5355 22:34:07.093044 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093073 close(7) = 0 <0.000003>
5355 22:34:07.093085 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355 22:34:07.093123 close(7) = 0 <0.000003>
5355 22:34:07.093135 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.093165 close(7) = 0 <0.000003>
5355 22:34:07.093177 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093206 close(7) = 0 <0.000003>
5355 22:34:07.093217 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093246 close(7) = 0 <0.000003>
5355 22:34:07.093258 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093287 close(7) = 0 <0.000003>
5355 22:34:07.093299 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093327 close(7) = 0 <0.000003>
5355 22:34:07.093339 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093367 close(7) = 0 <0.000003>
5355 22:34:07.093379 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.093409 close(7) = 0 <0.000003>
5355 22:34:07.093420 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093449 close(7) = 0 <0.000003>
5355 22:34:07.093461 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093490 close(7) = 0 <0.000003>
5355 22:34:07.093502 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093531 close(7) = 0 <0.000003>
5355 22:34:07.093542 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093571 close(7) = 0 <0.000003>
5355 22:34:07.093583 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093612 close(7) = 0 <0.000003>
5355 22:34:07.093623 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093652 close(7) = 0 <0.000003>
5355 22:34:07.093664 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093693 close(7) = 0 <0.000003>
5355 22:34:07.093705 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093735 close(7) = 0 <0.000003>
5355 22:34:07.093747 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093775 close(7) = 0 <0.000003>
5355 22:34:07.093787 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.093822 close(7) = 0 <0.000003>
5355 22:34:07.093833 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093862 close(7) = 0 <0.000004>
5355 22:34:07.093875 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093904 close(7) = 0 <0.000003>
5355 22:34:07.093916 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093945 close(7) = 0 <0.000003>
5355 22:34:07.093956 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.093985 close(7) = 0 <0.000003>
5355 22:34:07.093997 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094026 close(7) = 0 <0.000003>
5355 22:34:07.094037 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094066 close(7) = 0 <0.000003>
5355 22:34:07.094078 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094107 close(7) = 0 <0.000003>
5355 22:34:07.094119 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094148 close(7) = 0 <0.000003>
5355 22:34:07.094160 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355 22:34:07.094198 close(7) = 0 <0.000003>
5355 22:34:07.094209 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094239 close(7) = 0 <0.000003>
5355 22:34:07.094251 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094279 close(7) = 0 <0.000003>
5355 22:34:07.094291 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094320 close(7) = 0 <0.000003>
5355 22:34:07.094332 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094361 close(7) = 0 <0.000003>
5355 22:34:07.094372 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094401 close(7) = 0 <0.000003>
5355 22:34:07.094413 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094442 close(7) = 0 <0.000003>
5355 22:34:07.094454 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094482 close(7) = 0 <0.000003>
5355 22:34:07.094494 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094522 close(7) = 0 <0.000003>
5355 22:34:07.094534 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094563 close(7) = 0 <0.000003>
5355 22:34:07.094575 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094604 close(7) = 0 <0.000003>
5355 22:34:07.094616 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094644 close(7) = 0 <0.000003>
5355 22:34:07.094656 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094685 close(7) = 0 <0.000004>
5355 22:34:07.094698 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094728 close(7) = 0 <0.000003>
5355 22:34:07.094741 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094774 close(7) = 0 <0.000003>
5355 22:34:07.094786 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094815 close(7) = 0 <0.000003>
5355 22:34:07.094826 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094856 close(7) = 0 <0.000003>
5355 22:34:07.094867 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.094897 close(7) = 0 <0.000003>
5355 22:34:07.094909 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094937 close(7) = 0 <0.000003>
5355 22:34:07.094949 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.094978 close(7) = 0 <0.000003>
5355 22:34:07.094990 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095020 close(7) = 0 <0.000003>
5355 22:34:07.095032 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095060 close(7) = 0 <0.000003>
5355 22:34:07.095072 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095101 close(7) = 0 <0.000003>
5355 22:34:07.095112 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095141 close(7) = 0 <0.000003>
5355 22:34:07.095152 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095181 close(7) = 0 <0.000003>
5355 22:34:07.095193 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095222 close(7) = 0 <0.000003>
5355 22:34:07.095235 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355 22:34:07.095273 close(7) = 0 <0.000003>
5355 22:34:07.095285 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095315 close(7) = 0 <0.000003>
5355 22:34:07.095327 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/level", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095357 close(7) = 0 <0.000003>
5355 22:34:07.095369 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/type", O_RDONLY) = 7 <0.000010>
5355 22:34:07.095406 close(7) = 0 <0.000004>
5355 22:34:07.095426 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/size", O_RDONLY) = 7 <0.000014>
5355 22:34:07.095465 close(7) = 0 <0.000004>
5355 22:34:07.095478 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095508 close(7) = 0 <0.000003>
5355 22:34:07.095520 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095550 close(7) = 0 <0.000003>
5355 22:34:07.095562 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095592 close(7) = 0 <0.000003>
5355 22:34:07.095605 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095646 close(7) = 0 <0.000003>
5355 22:34:07.095658 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095687 close(7) = 0 <0.000003>
5355 22:34:07.095702 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/level", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095732 close(7) = 0 <0.000003>
5355 22:34:07.095744 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095773 close(7) = 0 <0.000003>
5355 22:34:07.095785 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095815 close(7) = 0 <0.000004>
5355 22:34:07.095828 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095858 close(7) = 0 <0.000004>
5355 22:34:07.095870 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095900 close(7) = 0 <0.000004>
5355 22:34:07.095912 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355 22:34:07.095942 close(7) = 0 <0.000003>
5355 22:34:07.095954 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.095983 close(7) = 0 <0.000003>
5355 22:34:07.095995 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096024 close(7) = 0 <0.000003>
5355 22:34:07.096036 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096064 close(7) = 0 <0.000003>
5355 22:34:07.096076 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096104 close(7) = 0 <0.000003>
5355 22:34:07.096116 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096145 close(7) = 0 <0.000003>
5355 22:34:07.096157 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096186 close(7) = 0 <0.000003>
5355 22:34:07.096198 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355 22:34:07.096228 close(7) = 0 <0.000003>
5355 22:34:07.096240 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096268 close(7) = 0 <0.000003>
5355 22:34:07.096280 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096309 close(7) = 0 <0.000003>
5355 22:34:07.096321 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355 22:34:07.096350 close(7) = 0 <0.000003>
5355 22:34:07.096362 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/level", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096391 close(7) = 0 <0.000003>
5355 22:34:07.096403 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/type", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096432 close(7) = 0 <0.000003>
5355 22:34:07.096443 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096472 close(7) = 0 <0.000003>
5355 22:34:07.096484 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096513 close(7) = 0 <0.000003>
5355 22:34:07.096525 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096553 close(7) = 0 <0.000003>
5355 22:34:07.096565 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096594 close(7) = 0 <0.000003>
5355 22:34:07.096608 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/shared_cpu_map", O_RDONLY) = 7 <0.000010>
5355 22:34:07.096645 close(7) = 0 <0.000003>
5355 22:34:07.096664 close(5) = 0 <0.000003>
5355 22:34:07.096681 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/io_links/0/properties", O_RDONLY) = 5 <0.000008>
5355 22:34:07.096735 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096767 close(7) = 0 <0.000003>
5355 22:34:07.096779 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 7 <0.000005>
5355 22:34:07.096821 close(7) = 0 <0.000003>
5355 22:34:07.096834 close(5) = 0 <0.000003>
5355 22:34:07.096846 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 5 <0.000005>
5355 22:34:07.096875 close(5) = 0 <0.000003>
5355 22:34:07.096887 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 5 <0.000005>
5355 22:34:07.096936 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 7 <0.000029>
5355 22:34:07.096989 stat("/sys/dev/char/226:128/device/drm", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355 22:34:07.097017 ioctl(7, DRM_IOCTL_VERSION, 0x11233f0) = 0 <0.000006>
5355 22:34:07.097034 ioctl(7, DRM_IOCTL_VERSION, 0x11233f0) = 0 <0.000003>
5355 22:34:07.097055 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69e0) = 0 <0.000004>
5355 22:34:07.097069 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69b0) = 0 <0.000343>
5355 22:34:07.097422 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69b0) = 0 <0.000010>
5355 22:34:07.097444 openat(AT_FDCWD, "/opt/amdgpu/share/libdrm/amdgpu.ids", O_RDONLY) = 9 <0.000008>
5355 22:34:07.097527 close(9) = 0 <0.000003>
5355 22:34:07.097541 close(8) = 0 <0.000004>
5355 22:34:07.097568 close(7) = 0 <0.000016>
5355 22:34:07.097592 close(5) = 0 <0.000003>
5355 22:34:07.097605 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/mem_banks/0/properties", O_RDONLY) = 5 <0.000009>
5355 22:34:07.097653 close(5) = 0 <0.000004>
5355 22:34:07.097666 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/0/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.097735 close(5) = 0 <0.000005>
5355 22:34:07.097751 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/1/properties", O_RDONLY) = 5 <0.000007>
5355 22:34:07.097823 close(5) = 0 <0.000004>
5355 22:34:07.097835 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/2/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.097903 close(5) = 0 <0.000006>
5355 22:34:07.097920 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/3/properties", O_RDONLY) = 5 <0.000007>
5355 22:34:07.097991 close(5) = 0 <0.000003>
5355 22:34:07.098003 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/4/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098070 close(5) = 0 <0.000005>
5355 22:34:07.098086 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/5/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098154 close(5) = 0 <0.000005>
5355 22:34:07.098170 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/6/properties", O_RDONLY) = 5 <0.000007>
5355 22:34:07.098241 close(5) = 0 <0.000003>
5355 22:34:07.098254 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/7/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098321 close(5) = 0 <0.000005>
5355 22:34:07.098338 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/8/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098406 close(5) = 0 <0.000003>
5355 22:34:07.098419 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/9/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098488 close(5) = 0 <0.000005>
5355 22:34:07.098504 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/10/properties", O_RDONLY) = 5 <0.000007>
5355 22:34:07.098576 close(5) = 0 <0.000003>
5355 22:34:07.098588 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/11/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098656 close(5) = 0 <0.000004>
5355 22:34:07.098668 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/12/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098736 close(5) = 0 <0.000005>
5355 22:34:07.098752 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/13/properties", O_RDONLY) = 5 <0.000007>
5355 22:34:07.098822 close(5) = 0 <0.000003>
5355 22:34:07.098835 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/io_links/0/properties", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098875 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 7 <0.000005>
5355 22:34:07.098903 close(7) = 0 <0.000003>
5355 22:34:07.098917 close(5) = 0 <0.000003>
5355 22:34:07.098928 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/generation_id", O_RDONLY) = 5 <0.000006>
5355 22:34:07.098959 close(5) = 0 <0.000003>
5355 22:34:07.098986 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x21, 0x4), 0x7ffd164f6f24) = 0 <0.000004>
5355 22:34:07.099000 ioctl(3, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffd164f6dd0) = 0 <0.000006>
5355 22:34:07.099024 ioctl(3, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffd164f71c0) = 0 <0.000004>
5355 22:34:07.099070 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6f20) = 0 <0.000012>
5355 22:34:07.099119 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6ff0) = 0 <0.000212>
5355 22:34:07.099343 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f7140) = 0 <0.000013>
5355 22:34:07.099424 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6e60) = 0 <0.000023>
5355 22:34:07.099458 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6e90) = 0 <0.000029>
5355 22:34:07.099499 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f7030) = 0 <0.000004>
5355 22:34:07.099513 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000006>
5355 22:34:07.099556 close(5) = 0 <0.000003>
5355 22:34:07.099668 ioctl(3, AMDKFD_IOC_SET_SCRATCH_BACKING_VA, 0x7ffd164f70d0) = 0 <0.000003>
5355 22:34:07.099735 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ae0) = 0 <0.000015>
5355 22:34:07.099762 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b10) = 0 <0.000056>
5355 22:34:07.099829 ioctl(3, AMDKFD_IOC_SET_TRAP_HANDLER, 0x7ffd164f71a0) = 0 <0.000004>
5355 22:34:07.099909 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c50) = 0 <0.000008>
5355 22:34:07.099926 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6c80) = 0 <0.000033>
5358 22:34:07.099980 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.100017 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c00) = 0 <0.000007>
5355 22:34:07.100033 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6c30) = 0 <0.000028>
5355 22:34:07.100071 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f6e70) = 0 <0.000005>
5355 22:34:07.100130 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f69b0) = 0 <0.000010>
5355 22:34:07.100148 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000024>
5355 22:34:07.100212 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6970) = 0 <0.000006>
5355 22:34:07.100243 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000022>
5355 22:34:07.100317 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f69b0) = 0 <0.000294>
5355 22:34:07.100621 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000092>
5355 22:34:07.100724 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6b90) = 0 <0.000531>
5355 22:34:07.101297 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a30) = 0 <0.000006>
5355 22:34:07.101324 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6aa0) = 0 <0.000025>
5355 22:34:07.101363 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6e80) = 0 <0.000005>
5358 22:34:07.101374 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.001391>
5355 22:34:07.101379 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6e80) = 0 <0.000002>
5355 22:34:07.101445 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c80) = 0 <0.000008>
5355 22:34:07.101463 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6cb0) = 0 <0.000028>
5355 22:34:07.101546 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000008>
5355 22:34:07.101563 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000032>
5358 22:34:07.101610 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000004>
5358 22:34:07.101626 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.101655 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000042>
5355 22:34:07.101706 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355 22:34:07.101792 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355 22:34:07.101809 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000027>
5355 22:34:07.101868 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000006>
5355 22:34:07.101898 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355 22:34:07.101974 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000309>
5355 22:34:07.102294 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000114>
5355 22:34:07.102419 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000064>
5355 22:34:07.102495 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358 22:34:07.102507 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000878>
5355 22:34:07.102512 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355 22:34:07.102581 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355 22:34:07.102599 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355 22:34:07.102679 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355 22:34:07.102694 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358 22:34:07.102744 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000006>
5358 22:34:07.102760 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.102774 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000041>
5355 22:34:07.102826 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355 22:34:07.102910 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355 22:34:07.102926 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000029>
5355 22:34:07.102988 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000006>
5355 22:34:07.103018 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000022>
5355 22:34:07.103092 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000327>
5355 22:34:07.103429 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000115>
5355 22:34:07.103556 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000064>
5355 22:34:07.103632 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358 22:34:07.103645 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000881>
5355 22:34:07.103649 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355 22:34:07.103720 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355 22:34:07.103738 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355 22:34:07.103816 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355 22:34:07.103832 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358 22:34:07.103884 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000006>
5358 22:34:07.103901 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.103912 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000041>
5355 22:34:07.103967 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355 22:34:07.104052 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355 22:34:07.104069 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355 22:34:07.104125 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000005>
5355 22:34:07.104154 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000022>
5355 22:34:07.104228 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000321>
5355 22:34:07.104560 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000092>
5355 22:34:07.104664 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000066>
5355 22:34:07.104741 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358 22:34:07.104754 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000850>
5355 22:34:07.104758 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355 22:34:07.104825 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355 22:34:07.104842 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000027>
5355 22:34:07.104925 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355 22:34:07.104940 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358 22:34:07.104989 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000005>
5358 22:34:07.105005 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.105019 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000040>
5355 22:34:07.105070 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355 22:34:07.105196 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000012>
5355 22:34:07.105235 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355 22:34:07.105298 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000007>
5355 22:34:07.105333 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000031>
5355 22:34:07.105425 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000357>
5355 22:34:07.105803 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000108>
5355 22:34:07.105938 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000067>
5355 22:34:07.106022 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000008>
5358 22:34:07.106039 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.001030>
5355 22:34:07.106045 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000003>
5355 22:34:07.106129 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000009>
5355 22:34:07.106149 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355 22:34:07.106278 stat("fixme.so", <unfinished ...>
5358 22:34:07.106288 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.106294 <... stat resumed>0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000007>
5358 22:34:07.106302 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000009>
5358 22:34:07.106309 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.106321 openat(AT_FDCWD, "/sys/bus/pci/devices", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000010>
5355 22:34:07.106392 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:03:00.0/uevent", O_RDONLY) = 7 <0.000010>
5355 22:34:07.106455 close(7) = 0 <0.000005>
5355 22:34:07.106476 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.106517 close(7) = 0 <0.000004>
5355 22:34:07.106532 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.3/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.106570 close(7) = 0 <0.000004>
5355 22:34:07.106585 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.3/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.106621 close(7) = 0 <0.000004>
5355 22:34:07.106635 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.1/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.106672 close(7) = 0 <0.000004>
5355 22:34:07.106692 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.1/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.106730 close(7) = 0 <0.000004>
5355 22:34:07.106744 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:01.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.106781 close(7) = 0 <0.000005>
5355 22:34:07.106797 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.2/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.106838 close(7) = 0 <0.000004>
5355 22:34:07.106853 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.3/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.106890 close(7) = 0 <0.000004>
5355 22:34:07.106904 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.106940 close(7) = 0 <0.000004>
5355 22:34:07.106955 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.1/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.106991 close(7) = 0 <0.000004>
5355 22:34:07.107005 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.6/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.107041 close(7) = 0 <0.000004>
5355 22:34:07.107056 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.6/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107092 close(7) = 0 <0.000004>
5355 22:34:07.107107 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.107143 close(7) = 0 <0.000005>
5355 22:34:07.107159 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.1/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107200 close(7) = 0 <0.000004>
5355 22:34:07.107214 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.4/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107257 close(7) = 0 <0.000004>
5355 22:34:07.107272 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.4/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.107309 close(7) = 0 <0.000004>
5355 22:34:07.107324 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:02:02.0/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107361 close(7) = 0 <0.000004>
5355 22:34:07.107375 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.2/uevent", O_RDONLY) = 7 <0.000010>
5355 22:34:07.107428 close(7) = 0 <0.000004>
5355 22:34:07.107443 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.2/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107485 close(7) = 0 <0.000004>
5355 22:34:07.107499 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107540 close(7) = 0 <0.000004>
5355 22:34:07.107554 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107596 close(7) = 0 <0.000004>
5355 22:34:07.107611 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.1/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107651 close(7) = 0 <0.000004>
5355 22:34:07.107666 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.2/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107707 close(7) = 0 <0.000004>
5355 22:34:07.107722 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:04:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107762 close(7) = 0 <0.000004>
5355 22:34:07.107777 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.0/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107816 close(7) = 0 <0.000004>
5355 22:34:07.107831 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.7/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.107871 close(7) = 0 <0.000004>
5355 22:34:07.107886 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.0/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107926 close(7) = 0 <0.000004>
5355 22:34:07.107940 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.5/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.107981 close(7) = 0 <0.000004>
5355 22:34:07.108004 close(5) = 0 <0.000005>
5355 22:34:07.108019 openat(AT_FDCWD, "/sys/bus/pci/devices", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000006>
5355 22:34:07.108059 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:03:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.108102 close(7) = 0 <0.000004>
5355 22:34:07.108118 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108152 close(7) = 0 <0.000004>
5355 22:34:07.108166 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.3/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108201 close(7) = 0 <0.000004>
5355 22:34:07.108216 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.3/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108250 close(7) = 0 <0.000004>
5355 22:34:07.108264 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.1/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108298 close(7) = 0 <0.000004>
5355 22:34:07.108313 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.1/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108347 close(7) = 0 <0.000004>
5355 22:34:07.108361 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:01.0/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108395 close(7) = 0 <0.000004>
5355 22:34:07.108409 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.2/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108443 close(7) = 0 <0.000004>
5355 22:34:07.108457 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.3/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108491 close(7) = 0 <0.000004>
5355 22:34:07.108506 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108541 close(7) = 0 <0.000004>
5355 22:34:07.108555 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.1/uevent", O_RDONLY) = 7 <0.000009>
5355 22:34:07.108598 close(7) = 0 <0.000004>
5355 22:34:07.108613 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.6/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108648 close(7) = 0 <0.000004>
5355 22:34:07.108663 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.6/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108697 close(7) = 0 <0.000004>
5355 22:34:07.108711 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108746 close(7) = 0 <0.000004>
5355 22:34:07.108760 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.1/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.108794 close(7) = 0 <0.000005>
5355 22:34:07.108810 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.4/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.108851 close(7) = 0 <0.000004>
5355 22:34:07.108866 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.4/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108900 close(7) = 0 <0.000004>
5355 22:34:07.108914 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:02:02.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.108949 close(7) = 0 <0.000004>
5355 22:34:07.108964 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.2/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109010 close(7) = 0 <0.000004>
5355 22:34:07.109025 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.2/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109059 close(7) = 0 <0.000004>
5355 22:34:07.109074 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109108 close(7) = 0 <0.000005>
5355 22:34:07.109123 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.0/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.109164 close(7) = 0 <0.000004>
5355 22:34:07.109179 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.1/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109213 close(7) = 0 <0.000004>
5355 22:34:07.109227 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.2/uevent", O_RDONLY) = 7 <0.000005>
5355 22:34:07.109261 close(7) = 0 <0.000004>
5355 22:34:07.109275 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:04:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109309 close(7) = 0 <0.000004>
5355 22:34:07.109324 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.0/uevent", O_RDONLY) = 7 <0.000006>
5355 22:34:07.109372 close(7) = 0 <0.000004>
5355 22:34:07.109388 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.7/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.109450 close(7) = 0 <0.000006>
5355 22:34:07.109475 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.0/uevent", O_RDONLY) = 7 <0.000008>
5355 22:34:07.109537 close(7) = 0 <0.000006>
5355 22:34:07.109562 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.5/uevent", O_RDONLY) = 7 <0.000007>
5355 22:34:07.109619 close(7) = 0 <0.000004>
5355 22:34:07.109665 close(5) = 0 <0.000004>
5355 22:34:07.109693 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000010>
5355 22:34:07.109719 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355 22:34:07.109740 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = 5 <0.000009>
5355 22:34:07.109781 close(5) = 0 <0.000004>
5355 22:34:07.109815 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000007>
5355 22:34:07.109852 close(5) = 0 <0.000007>
5355 22:34:07.109872 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000005>
5355 22:34:07.109896 close(5) = 0 <0.000003>
5355 22:34:07.109909 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000005>
5355 22:34:07.109932 close(5) = 0 <0.000009>
5355 22:34:07.109955 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.109982 close(5) = 0 <0.000005>
5355 22:34:07.109998 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000007>
5355 22:34:07.110022 close(5) = 0 <0.000003>
5355 22:34:07.110034 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110055 close(5) = 0 <0.000003>
5355 22:34:07.110067 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110087 close(5) = 0 <0.000003>
5355 22:34:07.110099 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110118 close(5) = 0 <0.000003>
5355 22:34:07.110129 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110149 close(5) = 0 <0.000003>
5355 22:34:07.110160 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000009>
5355 22:34:07.110193 close(5) = 0 <0.000004>
5355 22:34:07.110206 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110226 close(5) = 0 <0.000003>
5355 22:34:07.110238 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355 22:34:07.110258 close(5) = 0 <0.000003>
5355 22:34:07.111651 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000011>
5358 22:34:07.111683 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.005370>
5358 22:34:07.111710 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000020>
5355 22:34:07.111752 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358 22:34:07.111761 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355 22:34:07.111992 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000236>
5358 22:34:07.112005 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.112013 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358 22:34:07.112030 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000021>
5355 22:34:07.112038 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000022>
5358 22:34:07.112051 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.112060 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000015>
5355 22:34:07.112149 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000016>
5355 22:34:07.112188 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000016>
5355 22:34:07.112401 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000011>
5355 22:34:07.112431 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355 22:34:07.112513 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000009>
5355 22:34:07.112541 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000009>
5355 22:34:07.112639 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000016>
5355 22:34:07.112674 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000015>
5355 22:34:07.112759 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355 22:34:07.112794 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000012>
5355 22:34:07.112878 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000011>
5358 22:34:07.112902 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000847>
5358 22:34:07.112928 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000017>
5355 22:34:07.112960 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358 22:34:07.112979 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355 22:34:07.113106 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000142>
5355 22:34:07.113120 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000009>
5355 22:34:07.113149 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000012>
5358 22:34:07.113225 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.113234 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358 22:34:07.113252 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000021>
5355 22:34:07.113260 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000022>
5358 22:34:07.113276 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.113283 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000014>
5355 22:34:07.113470 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000014>
5355 22:34:07.113502 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355 22:34:07.113586 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000010>
5355 22:34:07.113618 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000012>
5355 22:34:07.113711 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000009>
5355 22:34:07.113741 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000011>
5355 22:34:07.113815 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355 22:34:07.113840 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000015>
5355 22:34:07.113913 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000016>
5358 22:34:07.113947 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000667>
5358 22:34:07.113975 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000019>
5355 22:34:07.114014 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358 22:34:07.114024 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355 22:34:07.114100 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000083>
5355 22:34:07.114115 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000012>
5355 22:34:07.114140 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000014>
5355 22:34:07.114222 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000018>
5355 22:34:07.114258 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5358 22:34:07.114271 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.114285 <... ioctl resumed>, 0x7ffd164f7a00) = 0 <0.000022>
5358 22:34:07.114306 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000031>
5358 22:34:07.114329 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.114504 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000009>
5355 22:34:07.114533 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355 22:34:07.114607 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000010>
5355 22:34:07.114632 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000013>
5355 22:34:07.114727 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000017>
5355 22:34:07.114760 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000009>
5355 22:34:07.114843 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000015>
5355 22:34:07.114872 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000013>
5355 22:34:07.114953 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000014>
5358 22:34:07.114989 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000656>
5358 22:34:07.115015 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000019>
5358 22:34:07.115056 ioctl(3, AMDKFD_IOC_SET_EVENT <unfinished ...>
5355 22:34:07.115062 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358 22:34:07.115088 <... ioctl resumed>, 0x7f0a22a66d70) = 0 <0.000027>
5355 22:34:07.115157 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000090>
5355 22:34:07.115171 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000012>
5355 22:34:07.115206 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000013>
5355 22:34:07.115302 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358 22:34:07.115316 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.115326 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000019>
5358 22:34:07.115343 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000024>
5355 22:34:07.115351 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5358 22:34:07.115370 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355 22:34:07.115376 <... ioctl resumed>, 0x7ffd164f7a00) = 0 <0.000022>
5355 22:34:07.115584 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000014>
5355 22:34:07.115622 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000016>
5355 22:34:07.115705 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000015>
5355 22:34:07.115734 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000013>
5355 22:34:07.115830 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000014>
5355 22:34:07.115862 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000013>
5355 22:34:07.115944 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355 22:34:07.115977 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000011>
5355 22:34:07.116137 openat(AT_FDCWD, "/dev/shm/__KMP_REGISTERED_LIB_5355_0", O_RDONLY|O_NOFOLLOW|O_CLOEXEC) = 5 <0.000010>
5355 22:34:07.116231 close(5) = 0 <0.000012>
5355 22:34:07.116259 unlink("/dev/shm/__KMP_REGISTERED_LIB_5355_0") = 0 <0.000019>
5369 22:34:07.116369 +++ exited with 0 +++
5368 22:34:07.116374 +++ exited with 0 +++
5367 22:34:07.116376 +++ exited with 0 +++
5365 22:34:07.116380 +++ exited with 0 +++
5366 22:34:07.116393 +++ exited with 0 +++
5363 22:34:07.116399 +++ exited with 0 +++
5364 22:34:07.116401 +++ exited with 0 +++
5360 22:34:07.116405 +++ exited with 0 +++
5362 22:34:07.116411 +++ exited with 0 +++
5361 22:34:07.116414 +++ exited with 0 +++
5359 22:34:07.116416 +++ exited with 0 +++
5358 22:34:07.116722 <... ioctl resumed> <unfinished ...>) = ?
5358 22:34:07.116762 +++ exited with 0 +++
5355 22:34:07.133444 +++ exited with 0 +++
参考资料
百度安全验证
AMD的ROCM平台是什么? - 知乎
https://cgmb-rocm-docs.readthedocs.io/_/downloads/en/latest/pdf/
OpenCL编程详细解析与实例 - 知乎
第1章 简介异构计算 - OpenCL 2.0 异构计算 - 开发文档 - 文江博客
HIP-ROCM架构概述 - 知乎
ROCm兼容cuda方案和验证 - 知乎
ROCm API libraries — ROCm Documentation
源码编译安装ROCm以运行tensorflow-rocm(适用于Ubuntu 23.04) - 小蓝博客
AMD 推出 HIP SDK:拓展 ROCm 方案,为 CUDA 应用程序提供支持_腾讯新闻
https://dev.to/shawonashraf/setting-up-your-amd-gpu-for-tensorflow-in-ubuntu-20-04-31f5
GPU memory — ROCm Documentation
Index of /amdgpu-install/
https://www.cnblogs.com/lllzhuang/articles/16083003.html