基于AMDGPU-ROCm的深度学习环境搭建

在风起云涌的AI江湖,NVIDIA凭借其CUDA生态和优秀的硬件大杀四方,立下赫赫战功,而另一家公司AMD也不甘示弱,带着他的生态解决方案ROCm开始了与不世出的NVIDA的正面硬钢,"ROCm is the answer to CUDA", AMD官网如是说。ROCm全称是Radeon Open Compute,从功能上,它是AMD提供的一套用于支持异构计算和GPU加速计算的开发工具和平台。

根据ROCm的官方介绍,这套框架不但支持AMD专业的计算卡,也支持AMD消费级的电脑显卡,之前有搭建过N卡CUDA的学习平台,这里尝试基于AMDGPU,搭建一个ROCm的学习平台。

平台信息

基于Ubuntu 20.04.6 LTS x86_64,显卡为AMD Ryzen 5 5600G with Radeon Graphics集显,应该是VEGA系列,支持VULKAN,OPENCL,当然,不支持CUDA。

搭建步骤

执行如下命令序列,添加用户组和安装ROCm一步到位:

sudo apt update && sudo apt dist-upgrade
sudo apt-get install wget gnupg2 
sudo usermod -a -G video $LOGNAME
sudo usermod -a -G render $LOGNAME
echo 'ADD_EXTRA_GROUPS=1' | sudo tee -a /etc/adduser.conf
echo 'EXTRA_GROUPS=video' | sudo tee -a /etc/adduser.conf
echo 'EXTRA_GROUPS=render' | sudo tee -a /etc/adduser.conf
sudo wget https://repo.radeon.com/amdgpu-install/22.10/ubuntu/focal/amdgpu-install_22.10.50100-1_all.deb
sudo apt-get install ./amdgpu-install_22.10.50100-1_all.deb 
sudo amdgpu-install --usecase=dkms
amdgpu-install -y --usecase=rocm
echo 'export PATH=$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin' | sudo tee -a /etc/profile.d/rocm.sh

安装结束后,ROCm开发SDK将会出现在/opt目录下, 包括LLVM编译器, opencl, profile, tools等开发工具,便于用户开发自己的基于AMDGPU加速的应用程序。总的来说, ROCm SDK提供了完整的栈支持,包括运行时、编译器、调试器、性能分析工具等,以满足不同开发和优化需求。

AMDGPU编译器目录

测试环境

执行rocm-smi获取显卡设备信息,执行时发现在获取SCLK和功耗两个参数时报错,可能是SDK和显卡兼容方面的问题,不过没有影响后面的简单测试,所以也就没有理会。

AMD一直提倡一种混合异构架构(HSA),这种架构下CPU和GPU乃至各种异构算力被一视同仁,被纳入统一的编程模型开发,从rocminfo工具的输出可以看到这一点,每一个异构算力被认为是一个agent:

$ sudo /opt/rocm/bin/rocminfo

我的计算平台有两个AGENT,分别是CPU和GPU,CPU是通用算例,有12个compute unit,对应的是6核12线程SMT。

GPU Agent信息,计算单元数量,计算最大的TENSOR维数信息,QUEUE数量,WAVE(Warpper)大小等信息:

opencl支持信息

ROCm不直接支持CUDA,但是 support another GPU programming mode opencl,通过clinfo查看:

/opt/rocm/opencl/bin/clinfo

docker容器运行测试

下载pytorch环境的docker:

sudo docker run -it -v $HOME:/data --privileged --rm --device=/dev/kfd --device=/dev/dri --group-add video --name pytorch rocm/pytorch:latest

之后,在docker终端中执行如下命令,验证对CUDA的支持(猜测是利用CUDA的生态,底层是CUDA转OpenCL的算子实现):

>>> import torch
>>> torch.cuda.is_available()

输出为TRUE,说明AMDGPU的硬件加速平台搭建成功了。

简单分析

细心的同学可能注意到,在启动docker的测试命令中,传入了一个设备参数--device=/dev/kfd给到DOCKER环境,这个非常重要,kfd本身就是代表AMDGPU异构计算的GPU设备驱动(KMD)的设备节点,它是用户操作GPU的基础。

架构上,AMDKFD驱动程序是Radeon GPU计算软件栈的Linux内核代码,也是该公司ROCm产品的一部分,从 功能上可以理解为在 DRM 子系统中提供了 CPU 与 GPU 沟通的快速通道,使得两者可以平等的访问内存资源而无需额外拷贝。

我们可以在运行上面的测试时,简单追踪以下对KFD内核驱动的调用,以验证加速环境确实使用的AMDGPU显卡,KFD是一个字符设备,所以可以追踪其中的几个FOPS调用,不出所料,在docker中执行如上命令后,内核中则追踪到了如下对KFD的调用栈:

这个例子说明了ROCm穿上了CUDA的外衣,摇身一变实现了对TF框架的支持,但是核心引擎仍然用的是AMDGPU自己的加速实现,包括AMD的编译器,AMD的底层KMD KFD,数学加速库等等实现。

ROCm和CUDA编程模型对比

1.NVIDIA和AMD都支持OpenCL,毕竟CL是个开放标准。

2.OpenACC对标OpenMP,网上有很多例子.

3.HIP对标Cuda,Cuda Source可以翻译为 HIP,然后由ROCm编译为AMDGPU上可运行的代码。

大概意思针对异构计算,深度系学习场景,双方各自都有底牌,目前OpenCL打个平手,HIP和CUDA相比较生态弱一些,OpenACC和OpenMP旗鼓相当。

AMDGPU对CUDA支持方式的分析

以下内容来源于网上的资料和自己不负责任的分析,基于一个原理,计算机中的任何问题都可以通过增加一个中间层来解决:

实现方式是针对hip api(Heterogeneous-Computing Interface for Portability)做CUDA的接口套壳,即将cuda的API接口作为标准接口,用AMD ROCm实现cuda的API(目的就是保证对外的API与CUDA完全相同),但实际调用 HIP+ROCm 的相关接口实现(即实际在A卡上运行),编译生成动态库libcuda*.so,并替换cuda相关动态库,从而完成适配,达到兼容CUDA生态的接口的目的。ROCm也提供了HIPIFY工具,用于将CUDA源代码转换为HIP源代码,实现CUDA代码到HIP的移植。

ROCm API libraries — ROCm Documentation

Hipify工具

HIP是 CUDA API 的”山寨克隆“版。除了一些不常用的功能(e.g. managed memory)外,几乎全盘拷贝 CUDA API,是 CUDA 的一个子集。HIP让开发人员能够使用HIPIFY将CUDA应用程序移植到ROCm,HIPIFY会自动转换CUDA应用程序成为HIP内核语言和运行时API,使用NVIDIA的CUDA编译器或AMDCLANG编译为目标GPU的运行代码。

基于AMDGPU如何运行OpenCL测试用例

参考网络上基于CPU算例的OpenCL的例子,写一个cl的helloworld demo,这个并不太难,因为OpenCL是开源机构Khronos Group定义的标准,在这个标准下所有的头文件,运行时标准等等都是定义好的,所以源码级没有太多改动,基本上拷贝过来就能跑。重点是分析其基于AMDGPU的执行机制。

下面是一份简单的opencl的代码,基本上和C没有什么差别,除了需要提供device端的代码,没有也没有关系,简单的测试用例可以只在主机上跑。

#include <stdio.h>
#include <stdlib.h>
#include <alloca.h>
#include <CL/cl.h>

void displayPlatformInfo(cl_platform_id id,
                         cl_platform_info param_name,
                         const char* paramNameAsStr)
{
    cl_int error = 0;
    size_t paramSize = 0;
    error = clGetPlatformInfo( id, param_name, 0, NULL, &paramSize );
    char* moreInfo = (char*)alloca( sizeof(char) * paramSize);
    error = clGetPlatformInfo( id, param_name, paramSize, moreInfo, NULL );
    if (error != CL_SUCCESS ) {
        perror("Unable to find any OpenCL platform information");
        return;
    }
    printf("%s: %s\n", paramNameAsStr, moreInfo);
}

int main(void) {

   /* OpenCL 1.1 data structures */
   cl_platform_id* platforms;

   /* OpenCL 1.1 scalar data types */
   cl_uint numOfPlatforms;
   cl_int  error;

   /* 
      Get the number of platforms 
      Remember that for each vendor's SDK installed on the computer,
      the number of available platform also increased. 
    */
   error = clGetPlatformIDs(0, NULL, &numOfPlatforms);
   if(error != CL_SUCCESS) {			
      perror("Unable to find any OpenCL platforms");
      exit(1);
   }

   // Allocate memory for the number of installed platforms.
   // alloca(...) occupies some stack space but is automatically freed on return
   platforms = (cl_platform_id*) alloca(sizeof(cl_platform_id) * numOfPlatforms);
   printf("Number of OpenCL platforms found: %d\n", numOfPlatforms);

   error = clGetPlatformIDs(numOfPlatforms, platforms, NULL);
   if(error != CL_SUCCESS) {			
      perror("Unable to find any OpenCL platforms");
      exit(1);
   }
   // We invoke the API 'clPlatformInfo' twice for each parameter we're trying to extract
   // and we use the return value to create temporary data structures (on the stack) to store
   // the returned information on the second invocation.
   for(cl_uint i = 0; i < numOfPlatforms; ++i) {
        displayPlatformInfo( platforms[i], CL_PLATFORM_PROFILE, "CL_PLATFORM_PROFILE" );
        displayPlatformInfo( platforms[i], CL_PLATFORM_VERSION, "CL_PLATFORM_VERSION" );
        displayPlatformInfo( platforms[i], CL_PLATFORM_NAME,    "CL_PLATFORM_NAME" );
        displayPlatformInfo( platforms[i], CL_PLATFORM_VENDOR,  "CL_PLATFORM_VENDOR" );
        displayPlatformInfo( platforms[i], CL_PLATFORM_EXTENSIONS, "CL_PLATFORM_EXTENSIONS" );
   }

   return 0;
}

编译

ROCm环境安装了OpenCL开发所需要的编译器,OpenCL运行时环境,以及标准的Khronos Group头文件,使用如下命令编译:

/opt/rocm/llvm/bin/clang opencl.c -I/opt/rocm/opencl/include -L/opt/rocm/opencl/lib -lOpenCL
编译,运行测试没有问题

strace追踪系统调用,发现opencl的测试用例确实打开了/dev/kfd设备节点,并对GPU进行IOCTL操作:

strace -tt -T -f -e trace=file,close,openat,ioctl -o strace.log ./a.out

这个用例比较简单,调用的IOCTL 列表如下:

开发OpenCL Kernel测试用例

前面的例子只有主机侧的代码,没有GPU运行的代码,实际上没有调用AMDGPU的异构计算能力,参考网上的代码,写一个实现两个一维向量加和的kernel,投到AMDGPU上得到计算结果:

#include <stdio.h>
#include <stdlib.h>
#include <alloca.h>
#include <CL/cl.h>
#pragma warning( disable : 4996 )
int main() {
	cl_int error;
	cl_platform_id platforms;
 
	cl_device_id devices;
 
	cl_context context;
 
	FILE *program_handle;
	size_t program_size;
	char *program_buffer;
	cl_program program;
 
	size_t log_size;
	char *program_log;
 
	char kernel_name[] = "createBuffer";
	cl_kernel kernel;
 
	cl_command_queue queue;
	//获取平台
	error = clGetPlatformIDs(1, &platforms, NULL);
	if (error != 0) {
		printf("Get platform failed!");
		return -1;
	}
	//获取设备
	error = clGetDeviceIDs(platforms, CL_DEVICE_TYPE_GPU, 1, &devices, NULL);
	if (error != 0) {
		printf("Get device failed!");
		return -1;
	}
	//创建上下文
	context = clCreateContext(NULL,1,&devices,NULL,NULL,&error);
	if (error != 0) {
		printf("Creat context failed!");
		return -1;
	}
	//创建程序;注意要用"rb"
	program_handle = fopen("kernel.cl","rb");
	if (program_handle == NULL) {
		printf("The kernle can not be opened!");
		return -1;
	}
	fseek(program_handle,0,SEEK_END);
	program_size = ftell(program_handle);
	rewind(program_handle);
 
	program_buffer = (char *)malloc(program_size+1);
	program_buffer[program_size] = '\0';
	error=fread(program_buffer,sizeof(char),program_size,program_handle);
	if (error == 0) {
		printf("Read kernel failed!");
		return -1;
	}
	fclose(program_handle);
	program = clCreateProgramWithSource(context,1,(const char **)&program_buffer, 
	                                     &program_size,&error);
	if (error < 0) {
		printf("Couldn't create the program!");
		return -1;
	}
	//编译程序
	error = clBuildProgram(program,1,&devices,NULL,NULL,NULL);
	if (error < 0) {
		//确定日志文件的大小
		clGetProgramBuildInfo(program,devices,CL_PROGRAM_BUILD_LOG,0,NULL,&log_size);
		program_log = (char *)malloc(log_size+1);
		program_log[log_size] = '\0';
		//读取日志
		clGetProgramBuildInfo(program, devices, CL_PROGRAM_BUILD_LOG, 
		                       log_size+1, program_log, NULL);
		printf("%s\n",program_log);
		free(program_log);
		return -1;
	}
	free(program_buffer);
	//创建命令队列
	queue = clCreateCommandQueue(context, devices, CL_QUEUE_PROFILING_ENABLE, &error);
	if (error < 0) {
		printf("Coudn't create the command queue");
		return -1;
	}
	//创建内核
	kernel = clCreateKernel(program,kernel_name,&error);
	if (kernel==NULL) {
		printf("Couldn't create kernel!\n");
		return -1;
	}
	//初始化参数
	float result[100];
	float a_in[100];
	float b_in[100];
	for (int i = 0; i < 100; i++) {
		a_in[i] = i;
		b_in[i] = i*2.0;
	}
	//创建缓存对象
	cl_mem memObject1 = clCreateBuffer(context,CL_MEM_READ_ONLY|CL_MEM_COPY_HOST_PTR,sizeof(float)*100,a_in,&error);
	if (error < 0) {
		printf("Creat memObject1 failed!\n");
		return -1;
	}
	cl_mem memObject2 = clCreateBuffer(context, CL_MEM_READ_ONLY | CL_MEM_COPY_HOST_PTR, 
	                                    sizeof(float) * 100, b_in, &error);
	if (error < 0) {
		printf("Creat memObject2 failed!\n");
		return -1;
	}
	cl_mem memObject3 = clCreateBuffer(context, CL_MEM_WRITE_ONLY , 
	                                       sizeof(float) * 100, NULL, &error);
	if (error < 0) {
		printf("Creat memObject3 failed!\n");
		return -1;
	}
	//设置内核参数
	error = clSetKernelArg(kernel,0,sizeof(cl_mem),&memObject1);
	error|= clSetKernelArg(kernel, 1, sizeof(cl_mem), &memObject2);
	error |= clSetKernelArg(kernel, 2, sizeof(cl_mem), &memObject3);
	if (error != CL_SUCCESS) {
		printf("Error setting kernel arguments!\n");
		return -1;
	}
	//执行内核
	size_t globalWorkSize[1] = {100};
	size_t localWorkSize[1] = {1};
	error = clEnqueueNDRangeKernel(queue,kernel,1,NULL,globalWorkSize, 
	                                localWorkSize,0,NULL,NULL);
	if (error != CL_SUCCESS) {
		printf("Error queuing kernel for execution!\n");
		return -1;
	}
	//读取执行结果
	error = clEnqueueReadBuffer(queue,memObject3,CL_TRUE,0,100*sizeof(float), 
	                             result,0,NULL,NULL);
	if (error != CL_SUCCESS) {
		printf("Error reading result buffer!\n");
		return -1;
	}
	//显示结果
	for (int i = 0; i < 100; i++) {
		printf("%f ",result[i]);
	}
	printf("\n");
	//释放资源
	clReleaseDevice(devices);
	clReleaseContext(context);
	clReleaseCommandQueue(queue);
	clReleaseProgram(program);
	clReleaseKernel(kernel);
	clReleaseMemObject(memObject1);
	clReleaseMemObject(memObject2);
	clReleaseMemObject(memObject3);
	return 0;
}

设备端代码:

__kernel void createBuffer(__global const float *a_in,
	__global const float *b_in,
	__global float *result) {
int gid = get_global_id(0);
result[gid] = a_in[gid] + b_in[gid];
}

编译命令不变,kernel.cl会被主文件读入,然后被ROCm动态编译为GPU端指令,通过ROCm runtime加载道GPU端运行,得到计算结果,计算结果符合预期:

作为驱动开发者,实际上最关心的是KFD端的调用序列,通过追踪可以看到,此时由于加入了设备端计算的功能,KFD的IOCTL调用序列明显比前面长了好多,其中包括了COMMAND QUEUE创建的IOCTL也被调用到,因为设备端代码要通过COMMAND QUEUE传递给AMDGPU去执行。对应此用例,TRACE到的KFD主要调用流程如下:

root@love-A520MS:/sys/kernel/debug/tracing# cat trace
# tracer: function
#
# entries-in-buffer/entries-written: 0/0   #P:12
#
#                                _-----=> irqs-off
#                               / _----=> need-resched
#                              | / _---=> hardirq/softirq
#                              || / _--=> preempt-depth
#                              ||| / _-=> migrate-disable
#                              |||| /     delay
#           TASK-PID     CPU#  |||||  TIMESTAMP  FUNCTION
#              | |         |   |||||     |         |
root@love-A520MS:/sys/kernel/debug/tracing# cat trace
# tracer: function
#
# entries-in-buffer/entries-written: 36/36   #P:12
#
#                                _-----=> irqs-off
#                               / _----=> need-resched
#                              | / _---=> hardirq/softirq
#                              || / _--=> preempt-depth
#                              ||| / _-=> migrate-disable
#                              |||| /     delay
#           TASK-PID     CPU#  |||||  TIMESTAMP  FUNCTION
#              | |         |   |||||     |         |
           a.out-3866    [010] .....  2681.619393: kfd_open <-chrdev_open
           a.out-3866    [010] .....  2681.619397: <stack trace>
 => kfd_open
 => chrdev_open
 => do_dentry_open
 => vfs_open
 => path_openat
 => do_filp_open
 => do_sys_openat2
 => do_sys_open
 => __x64_sys_openat
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [010] .....  2681.619472: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
           a.out-3866    [010] .....  2681.619473: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_driver_open_kms
 => drm_file_alloc
 => drm_open
 => drm_stub_open
 => chrdev_open
 => do_dentry_open
 => vfs_open
 => path_openat
 => do_filp_open
 => do_sys_openat2
 => do_sys_open
 => __x64_sys_openat
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [010] .....  2681.619522: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
           a.out-3866    [010] .....  2681.619523: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_driver_open_kms
 => drm_file_alloc
 => drm_open
 => drm_stub_open
 => chrdev_open
 => do_dentry_open
 => vfs_open
 => path_openat
 => do_filp_open
 => do_sys_openat2
 => do_sys_open
 => __x64_sys_openat
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [010] .....  2681.619618: amdgpu_vm_set_pasid <-amdgpu_vm_fini
           a.out-3866    [010] .....  2681.619619: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_vm_fini
 => amdgpu_driver_postclose_kms
 => drm_file_free.part.0
 => drm_close_helper.isra.0
 => drm_release
 => __fput
 => ____fput
 => task_work_run
 => exit_to_user_mode_prepare
 => syscall_exit_to_user_mode
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [010] .....  2681.619632: amdgpu_vm_set_pasid <-amdgpu_amdkfd_gpuvm_acquire_process_vm
           a.out-3866    [010] .....  2681.619632: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_amdkfd_gpuvm_acquire_process_vm
 => kfd_process_device_init_vm
 => kfd_ioctl_acquire_vm
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [010] .....  2681.619634: amdgpu_vm_set_pasid <-amdgpu_amdkfd_gpuvm_acquire_process_vm
           a.out-3866    [010] .....  2681.619635: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_amdkfd_gpuvm_acquire_process_vm
 => kfd_process_device_init_vm
 => kfd_ioctl_acquire_vm
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [001] .....  2681.644166: amdgpu_vm_set_pasid <-amdgpu_driver_open_kms
           a.out-3866    [001] .....  2681.644170: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_driver_open_kms
 => drm_file_alloc
 => drm_open
 => drm_stub_open
 => chrdev_open
 => do_dentry_open
 => vfs_open
 => path_openat
 => do_filp_open
 => do_sys_openat2
 => do_sys_open
 => __x64_sys_openat
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [001] .....  2681.644827: amdgpu_vm_set_pasid <-amdgpu_vm_fini
           a.out-3866    [001] .....  2681.644829: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_vm_fini
 => amdgpu_driver_postclose_kms
 => drm_file_free.part.0
 => drm_close_helper.isra.0
 => drm_release
 => __fput
 => ____fput
 => task_work_run
 => exit_to_user_mode_prepare
 => syscall_exit_to_user_mode
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3869    [006] .....  2681.691350: pqm_create_queue <-kfd_ioctl_create_queue
           a.out-3869    [006] .....  2681.691355: <stack trace>
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3869    [006] .....  2681.691355: register_process <-pqm_create_queue
           a.out-3869    [006] .....  2681.691356: <stack trace>
 => register_process
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3869    [006] .....  2681.691356: update_qpd_v9 <-register_process
           a.out-3869    [006] .....  2681.691357: <stack trace>
 => update_qpd_v9
 => register_process
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3869    [006] .....  2681.692511: pqm_create_queue <-kfd_ioctl_create_queue
           a.out-3869    [006] .....  2681.692513: <stack trace>
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [001] .....  2681.860371: pqm_create_queue <-kfd_ioctl_create_queue
           a.out-3866    [001] .....  2681.860377: <stack trace>
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [001] .....  2681.861108: pqm_create_queue <-kfd_ioctl_create_queue
           a.out-3866    [001] .....  2681.861110: <stack trace>
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3869    [006] .....  2681.861627: pqm_create_queue <-kfd_ioctl_create_queue
           a.out-3869    [006] .....  2681.861630: <stack trace>
 => pqm_create_queue
 => kfd_ioctl_create_queue
 => kfd_ioctl
 => __x64_sys_ioctl
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
           a.out-3866    [001] .....  2681.887874: kfd_release <-__fput
           a.out-3866    [001] .....  2681.887882: <stack trace>
 => kfd_release
 => __fput
 => ____fput
 => task_work_run
 => do_exit
 => do_group_exit
 => __x64_sys_exit_group
 => do_syscall_64
 => entry_SYSCALL_64_after_hwframe
     kworker/1:0-3510    [001] .....  2681.888555: amdgpu_vm_set_pasid <-amdgpu_vm_release_compute
     kworker/1:0-3510    [001] .....  2681.888559: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_vm_release_compute
 => amdgpu_amdkfd_gpuvm_release_process_vm
 => kfd_process_destroy_pdds
 => kfd_process_wq_release
 => process_one_work
 => worker_thread
 => kthread
 => ret_from_fork
     kworker/1:0-3510    [001] .....  2681.893914: amdgpu_vm_set_pasid <-amdgpu_vm_fini
     kworker/1:0-3510    [001] .....  2681.893919: <stack trace>
 => amdgpu_vm_set_pasid
 => amdgpu_vm_fini
 => amdgpu_driver_postclose_kms
 => drm_file_free.part.0
 => drm_close_helper.isra.0
 => drm_release
 => __fput
 => delayed_fput
 => process_one_work
 => worker_thread
 => kthread
 => ret_from_fork
root@love-A520MS:/sys/kernel/debug/tracing# 

完整的KFD调用序列记录如下,方便以后分析:

5684  00:08:54.545211 ioctl(5, AMDKFD_IOC_GET_VERSION, 0x7ffe0edc1e00) = 0 <0.000005>
5684  00:08:54.549152 ioctl(5, AMDKFD_IOC_GET_PROCESS_APERTURES_NEW, 0x7ffe0edc1ab0) = 0 <0.000005>
5684  00:08:54.549169 ioctl(5, AMDKFD_IOC_ACQUIRE_VM, 0x7ffe0edc1ab0) = 0 <0.000033>
5684  00:08:54.549262 ioctl(5, AMDKFD_IOC_SET_MEMORY_POLICY, 0x7ffe0edc1ab0) = 0 <0.000004>
5684  00:08:54.549301 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1970) = 0 <0.000007>
5684  00:08:54.549333 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1990) = 0 <0.000091>
5684  00:08:54.581556 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffe0edc1a40) = 0 <0.000006>
5684  00:08:54.581583 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffe0edc1e30) = 0 <0.000004>
5684  00:08:54.581626 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1b90) = 0 <0.000012>
5684  00:08:54.581677 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1c60) = 0 <0.000239>
5684  00:08:54.581933 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1db0) = 0 <0.000014>
5684  00:08:54.582012 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1ad0) = 0 <0.000022>
5684  00:08:54.582043 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1b00) = 0 <0.000029>
5684  00:08:54.582084 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1ca0) = 0 <0.000004>
5684  00:08:54.582259 ioctl(5, AMDKFD_IOC_SET_SCRATCH_BACKING_VA, 0x7ffe0edc1d40) = 0 <0.000002>
5684  00:08:54.582322 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1750) = 0 <0.000010>
5684  00:08:54.582342 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1780) = 0 <0.000031>
5684  00:08:54.582388 ioctl(5, AMDKFD_IOC_SET_TRAP_HANDLER, 0x7ffe0edc1e10) = 0 <0.000006>
5687  00:08:54.582511 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5684  00:08:54.587645 ioctl(5, AMDKFD_IOC_GET_TILE_CONFIG, 0x7ffe0edc1310) = 0 <0.000005>
5684  00:08:54.587777 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19d0) = 0 <0.000153>
5684  00:08:54.587945 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000246>
5684  00:08:54.588269 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19d0) = 0 <0.000146>
5684  00:08:54.588429 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000035>
5684  00:08:54.588477 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1be0) = 0 <0.000007>
5689  00:08:54.650506 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef744e0) = 0 <0.000028>
5689  00:08:54.650547 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74510) = 0 <0.000222>
5689  00:08:54.650832 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74490) = 0 <0.000009>
5689  00:08:54.650851 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef744c0) = 0 <0.000035>
5689  00:08:54.650897 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74700) = 0 <0.000006>
5689  00:08:54.650964 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74240) = 0 <0.000008>
5689  00:08:54.650982 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000034>
5689  00:08:54.651053 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74200) = 0 <0.000008>
5689  00:08:54.651090 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000036>
5689  00:08:54.651186 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74240) = 0 <0.000376>
5689  00:08:54.651573 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef742b0) = 0 <0.000114>
5689  00:08:54.651697 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef74420) = 0 <0.000177>
5689  00:08:54.651914 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef742c0) = 0 <0.000008>
5689  00:08:54.651945 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74330) = 0 <0.000025>
5689  00:08:54.651981 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74710) = 0 <0.000007>
5689  00:08:54.652000 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74710) = 0 <0.000006>
5689  00:08:54.652067 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74510) = 0 <0.000010>
5689  00:08:54.652086 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74540) = 0 <0.000024>
5689  00:08:54.652175 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745f0) = 0 <0.000009>
5689  00:08:54.652196 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74620) = 0 <0.000028>
5687  00:08:54.652231 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000008>
5687  00:08:54.652251 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689  00:08:54.652295 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745a0) = 0 <0.000048>
5689  00:08:54.652353 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef745d0) = 0 <0.000029>
5689  00:08:54.652446 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74350) = 0 <0.000010>
5689  00:08:54.652467 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000024>
5689  00:08:54.652531 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74310) = 0 <0.000008>
5689  00:08:54.652565 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000030>
5689  00:08:54.652654 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74350) = 0 <0.000390>
5689  00:08:54.653057 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef743c0) = 0 <0.000119>
5689  00:08:54.653190 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef74530) = 0 <0.000068>
5689  00:08:54.653271 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74820) = 0 <0.000007>
5689  00:08:54.653290 ioctl(5, AMDKFD_IOC_SET_EVENT <unfinished ...>
5689  00:08:54.653366 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74620) = 0 <0.000010>
5689  00:08:54.653386 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74650) = 0 <0.000025>
5689  00:08:54.653480 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU <unfinished ...>
5687  00:08:54.653532 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000005>
5687  00:08:54.653551 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689  00:08:54.653590 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74a30) = 0 <0.000025>
5689  00:08:54.836246 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef73c80) = 0 <0.000022>
5689  00:08:54.836303 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef73cf0) = 0 <0.000049>
5689  00:08:54.836417 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef73da0) = 0 <0.000019>
5689  00:08:54.836447 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef73dd0) = 0 <0.000031>
5689  00:08:54.836509 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74690) = 0 <0.000007>
5689  00:08:54.836582 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74590) = 0 <0.000010>
5689  00:08:54.836603 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef745c0) = 0 <0.000029>
5689  00:08:54.836696 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000007>
5689  00:08:54.836714 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000023>
5689  00:08:54.836800 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000007>
5689  00:08:54.836818 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000027>
5689  00:08:54.837235 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74140) = 0 <0.000018>
5689  00:08:54.837266 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74170) = 0 <0.000085>
5689  00:08:54.837497 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74840) = 0 <0.000009>
5689  00:08:54.837519 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74840) = 0 <0.000025>
5689  00:08:54.837558 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000007>
5689  00:08:54.837577 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000005>
5689  00:08:54.837599 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000007>
5689  00:08:54.837618 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837632 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837647 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837662 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837676 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837691 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837705 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000008>
5689  00:08:54.837723 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837738 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837752 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837766 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000004>
5689  00:08:54.837835 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef748b0) = 0 <0.000011>
5689  00:08:54.837857 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef748e0) = 0 <0.000080>
5689  00:08:54.837951 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.837971 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000009>
5689  00:08:54.837999 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000009>
5689  00:08:54.838024 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838046 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838067 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838088 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838109 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838130 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838151 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838172 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838193 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838214 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838236 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838257 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838278 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838299 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5689  00:08:54.838321 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74b50) = 0 <0.000006>
5684  00:08:54.838720 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc14a0) = 0 <0.000020>
5684  00:08:54.838757 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc14d0) = 0 <0.000032>
5684  00:08:54.838963 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1840) = 0 <0.000014>
5684  00:08:54.838994 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1870) = 0 <0.000032>
5684  00:08:54.839099 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc17f0) = 0 <0.000044>
5684  00:08:54.839154 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1820) = 0 <0.000024>
5684  00:08:54.839247 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc15a0) = 0 <0.000008>
5684  00:08:54.839266 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000027>
5684  00:08:54.839331 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1560) = 0 <0.000007>
5684  00:08:54.839366 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000032>
5684  00:08:54.839457 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc15a0) = 0 <0.000281>
5684  00:08:54.839754 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1610) = 0 <0.000104>
5684  00:08:54.839873 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7ffe0edc1780) = 0 <0.000162>
5684  00:08:54.840049 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7ffe0edc1a70) = 0 <0.000006>
5684  00:08:54.840071 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7ffe0edc1a70) = 0 <0.000003>
5684  00:08:54.840148 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1870) = 0 <0.000010>
5684  00:08:54.840169 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc18a0) = 0 <0.000032>
5684  00:08:54.840267 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU <unfinished ...>
5687  00:08:54.840306 ioctl(5, AMDKFD_IOC_WAIT_EVENTS, 0x7fae7f7e8c20) = 0 <0.000007>
5687  00:08:54.840324 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5684  00:08:54.840351 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1c80) = 0 <0.000033>
5684  00:08:54.840433 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc1a90) = 0 <0.000007>
5684  00:08:54.840452 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1a90) = 0 <0.000024>
5684  00:08:54.840489 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000005>
5684  00:08:54.840506 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840520 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840534 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840548 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840562 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840576 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840589 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840603 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840617 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840630 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840644 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840658 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840672 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840686 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840700 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840714 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840728 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840741 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840755 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840769 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840782 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840796 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840810 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840824 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840837 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840854 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840869 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840883 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000009>
5684  00:08:54.840902 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000004>
5684  00:08:54.840916 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840930 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1da0) = 0 <0.000003>
5684  00:08:54.840998 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc19b0) = 0 <0.000130>
5684  00:08:54.841144 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc19e0) = 0 <0.000119>
5684  00:08:54.841363 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffe0edc16e0) = 0 <0.000008>
5684  00:08:54.841382 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffe0edc1750) = 0 <0.000023>
5684  00:08:54.841416 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7ffe0edc18c0) = 0 <0.000025>
5684  00:08:54.841452 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1b60) = 0 <0.000004>
5684  00:08:54.841466 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7ffe0edc1b60) = 0 <0.000004>
5689  00:08:54.841551 ioctl(5, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7fae7ef748a0) = 0 <0.000007>
5689  00:08:54.841637 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef745d0) = 0 <0.000150>
5689  00:08:54.841800 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74600) = 0 <0.000090>
5689  00:08:54.841996 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef74300) = 0 <0.000010>
5689  00:08:54.842018 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74370) = 0 <0.000024>
5689  00:08:54.842054 ioctl(5, AMDKFD_IOC_CREATE_QUEUE, 0x7fae7ef744e0) = 0 <0.000033>
5689  00:08:54.842099 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74780) = 0 <0.000005>
5689  00:08:54.842172 ioctl(5, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7fae7ef744e0) = 0 <0.000011>
5689  00:08:54.842194 ioctl(5, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7fae7ef74510) = 0 <0.000029>
5689  00:08:54.842235 ioctl(5, AMDKFD_IOC_CREATE_EVENT, 0x7fae7ef74780) = 0 <0.000004>
5689  00:08:54.842440 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c30) = 0 <0.000011>
5689  00:08:54.842468 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c70) = 0 <0.000011>
5689  00:08:54.842517 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bf0) = 0 <0.000006>
5689  00:08:54.842536 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c40) = 0 <0.000010>
5689  00:08:54.842603 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7ef74d10) = 0 <0.000006>
5687  00:08:54.842634 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7f7e8da0) = 0 <0.000007>
5689  00:08:54.842654 ioctl(5, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5687  00:08:54.842660 ioctl(5, AMDKFD_IOC_SET_EVENT, 0x7fae7f7e8df0) = 0 <0.000007>
5689  00:08:54.842752 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c30) = 0 <0.000007>
5689  00:08:54.842770 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c80) = 0 <0.000006>
5689  00:08:54.842841 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5687  00:08:54.842879 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689  00:08:54.842899 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5687  00:08:54.842906 ioctl(5, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5689  00:08:54.843095 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74c50) = 0 <0.000006>
5689  00:08:54.843114 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74ca0) = 0 <0.000007>
5689  00:08:54.843151 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74ba0) = 0 <0.000006>
5689  00:08:54.843167 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74bf0) = 0 <0.000007>
5689  00:08:54.843220 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bc0) = 0 <0.000006>
5689  00:08:54.843239 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c10) = 0 <0.000006>
5689  00:08:54.843279 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7fae7ef74bc0) = 0 <0.000006>
5689  00:08:54.843295 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7fae7ef74c10) = 0 <0.000007>
5684  00:08:54.843339 ioctl(5, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffe0edc1f60) = 0 <0.000007>
5684  00:08:54.843355 ioctl(5, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffe0edc1fb0) = 0 <0.000008>
runtime arch

OpenMP测试:

进入目录/opt/rocm-5.1.0/llvm/examples/openmp/veccopy,执行如下编译:

/opt/rocm-5.1.0/llvm/bin/clang -O3 -target x86_64-pc-linux-gnu -fopenmp -fopenmp-targets=amdgcn-amd-amdhsa -Xopenmp-target=amdgcn-amd-amdhsa -march=gfx908   veccopy.c -o veccopy

rocm_agent_enumerator用于发现支持AMD HSA的agent设备,测试环境发现了两个agent,分别是CPU和GPU。我们测试使用的是gfx908:

编译提示我们用错了offload arch, 所以可能无法将计算offloading 到device.不过没关系,不影响测试:

测试发现,openmp的计算实际上也是offload到GPU上运行的:

完整的TRACE LOG,日后分析:

5355  22:34:07.032008 execve("./veccopy", ["./veccopy"], 0x7ffcd9d23a78 /* 33 vars */) = 0 <0.000279>
5355  22:34:07.032525 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (没有那个文件或目录) <0.000016>
5355  22:34:07.032710 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000016>
5355  22:34:07.032772 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000024>
5355  22:34:07.032832 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000013>
5355  22:34:07.032876 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.032917 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.032958 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355  22:34:07.032997 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/tls/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.033037 stat("/opt/rocm-5.1.0/llvm/bin/../lib/tls", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355  22:34:07.033076 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.033117 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.033156 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000013>
5355  22:34:07.033197 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355  22:34:07.033236 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/x86_64/libomp.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.033276 stat("/opt/rocm-5.1.0/llvm/bin/../lib/x86_64", 0x7ffd164f6e80) = -1 ENOENT (没有那个文件或目录) <0.000011>
5355  22:34:07.033316 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomp.so", O_RDONLY|O_CLOEXEC) = 3 <0.000014>
5355  22:34:07.033584 close(3)          = 0 <0.000012>
5355  22:34:07.033631 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.so", O_RDONLY|O_CLOEXEC) = 3 <0.000015>
5355  22:34:07.033862 close(3)          = 0 <0.000011>
5355  22:34:07.033905 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libpthread.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000014>
5355  22:34:07.033946 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355  22:34:07.033984 close(3)          = 0 <0.000004>
5355  22:34:07.033999 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.034100 close(3)          = 0 <0.000003>
5355  22:34:07.034114 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.034132 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.034264 close(3)          = 0 <0.000003>
5355  22:34:07.034280 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355  22:34:07.034355 close(3)          = 0 <0.000004>
5355  22:34:07.034370 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.034445 close(3)          = 0 <0.000003>
5355  22:34:07.034471 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libclang-cpp.so.14git", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.034547 close(3)          = 0 <0.000003>
5355  22:34:07.034566 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.034586 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.034602 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034616 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034631 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034645 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034660 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034674 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034688 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/tls", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034702 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034716 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034730 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034745 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034759 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034774 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034788 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034802 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../lib", {st_mode=S_IFDIR|0755, st_size=16384, ...}) = 0 <0.000004>
5355  22:34:07.034818 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.034835 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034849 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034864 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034879 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034893 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034907 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034921 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/tls", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034935 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034952 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034967 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034981 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.034995 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035010 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/x86_64", 0x7ffd164f6d80) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035024 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libm.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.035038 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355  22:34:07.035055 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libm.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355  22:34:07.035136 close(3)          = 0 <0.000003>
5355  22:34:07.035152 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.035167 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035182 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libz.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035197 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libz.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.035286 close(3)          = 0 <0.000003>
5355  22:34:07.035299 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035314 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035329 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035344 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libtinfo.so.5", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.035428 close(3)          = 0 <0.000003>
5355  22:34:07.035447 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.035466 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.035482 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.035498 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libstdc++.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.035600 close(3)          = 0 <0.000003>
5355  22:34:07.035617 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.035632 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.035647 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.035663 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.035740 close(3)          = 0 <0.000003>
5355  22:34:07.042002 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000010>
5355  22:34:07.042076 close(3)          = 0 <0.000004>
5355  22:34:07.042102 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.042122 stat("/lib/x86_64-linux-gnu/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042140 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042156 stat("/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042171 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042187 stat("/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042202 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042218 stat("/lib/x86_64-linux-gnu/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042233 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042249 stat("/lib/x86_64-linux-gnu/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042264 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042281 stat("/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042296 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042312 stat("/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042327 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042343 stat("/lib/x86_64-linux-gnu", {st_mode=S_IFDIR|0755, st_size=69632, ...}) = 0 <0.000004>
5355  22:34:07.042360 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042376 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042391 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042407 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042422 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042438 stat("/usr/lib/x86_64-linux-gnu/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042453 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042469 stat("/usr/lib/x86_64-linux-gnu/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042484 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042500 stat("/usr/lib/x86_64-linux-gnu/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042515 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042531 stat("/usr/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042555 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042573 stat("/usr/lib/x86_64-linux-gnu/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042588 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042604 stat("/usr/lib/x86_64-linux-gnu", {st_mode=S_IFDIR|0755, st_size=69632, ...}) = 0 <0.000004>
5355  22:34:07.042621 openat(AT_FDCWD, "/lib/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042637 stat("/lib/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042652 openat(AT_FDCWD, "/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042667 stat("/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042682 openat(AT_FDCWD, "/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042698 stat("/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042713 openat(AT_FDCWD, "/lib/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042729 stat("/lib/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042744 openat(AT_FDCWD, "/lib/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042760 stat("/lib/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042774 openat(AT_FDCWD, "/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.042791 stat("/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042806 openat(AT_FDCWD, "/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042821 stat("/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042836 openat(AT_FDCWD, "/lib/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042851 stat("/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355  22:34:07.042868 openat(AT_FDCWD, "/usr/lib/tls/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042884 stat("/usr/lib/tls/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042899 openat(AT_FDCWD, "/usr/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042914 stat("/usr/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042929 openat(AT_FDCWD, "/usr/lib/tls/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042944 stat("/usr/lib/tls/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042959 openat(AT_FDCWD, "/usr/lib/tls/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042974 stat("/usr/lib/tls", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.042989 openat(AT_FDCWD, "/usr/lib/x86_64/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043004 stat("/usr/lib/x86_64/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043019 openat(AT_FDCWD, "/usr/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043037 stat("/usr/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043053 openat(AT_FDCWD, "/usr/lib/x86_64/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043068 stat("/usr/lib/x86_64", 0x7ffd164f72a0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043083 openat(AT_FDCWD, "/usr/lib/libarcher.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043099 stat("/usr/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 <0.000004>
5355  22:34:07.043133 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.043168 close(3)          = 0 <0.000003>
5355  22:34:07.043184 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.043200 openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043216 openat(AT_FDCWD, "/lib/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043231 openat(AT_FDCWD, "/usr/lib/libmemkind.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.043326 statfs("/dev/shm/", {f_type=TMPFS_MAGIC, f_bsize=4096, f_blocks=1966975, f_bfree=1883383, f_bavail=1883383, f_files=1966975, f_ffree=1965794, f_fsid={val=[0, 0]}, f_namelen=255, f_frsize=4096, f_flags=ST_VALID|ST_NOSUID|ST_NODEV}) = 0 <0.000007>
5355  22:34:07.043364 openat(AT_FDCWD, "/dev/shm/__KMP_REGISTERED_LIB_5355_0", O_RDWR|O_CREAT|O_EXCL|O_NOFOLLOW|O_CLOEXEC, 0666) = 3 <0.000026>
5355  22:34:07.043456 close(3)          = 0 <0.000005>
5355  22:34:07.043482 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000009>
5355  22:34:07.043564 close(3)          = 0 <0.000004>
5355  22:34:07.043655 openat(AT_FDCWD, "/usr/share/locale/zh_CN.UTF-8/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.043674 openat(AT_FDCWD, "/usr/share/locale/zh_CN.UTF-8/LC_MESSAGES/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.043692 openat(AT_FDCWD, "/usr/share/locale/zh/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.043708 openat(AT_FDCWD, "/usr/share/locale/zh/LC_MESSAGES/libomp.cat", O_RDONLY) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.044163 stat("/sys/firmware/devicetree/base/ibm,firmware-versions/open-power", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000019>
5355  22:34:07.044215 stat("/sys/firmware/devicetree/base/cpus/ibm,powerpc-cpu-features", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000012>
5355  22:34:07.044256 stat("/sys/firmware/acpi", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355  22:34:07.044300 stat("/sys/module/acpi", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355  22:34:07.044350 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.rtl.x86_64.so", O_RDONLY|O_CLOEXEC) = 3 <0.000015>
5355  22:34:07.044578 close(3)          = 0 <0.000010>
5355  22:34:07.044620 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000014>
5355  22:34:07.044705 close(3)          = 0 <0.000009>
5355  22:34:07.044746 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libelf.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000013>
5355  22:34:07.044940 close(3)          = 0 <0.000010>
5355  22:34:07.045224 stat("/dev/nvidia0", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.045241 stat("/sys/module/mdio_thunder/initstate", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.045258 stat("fixme.so", 0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045273 stat("/dev/kfd", {st_mode=S_IFCHR|0660, st_rdev=makedev(0xea, 0), ...}) = 0 <0.000005>
5355  22:34:07.045292 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libomptarget.rtl.amdgpu.so", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.045383 close(3)          = 0 <0.000004>
5355  22:34:07.045403 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.045421 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.045439 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libhsa-runtime64.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000006>
5355  22:34:07.045515 close(3)          = 0 <0.000003>
5355  22:34:07.045535 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.045551 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045567 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045582 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045597 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045612 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045627 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045641 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045656 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045671 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045686 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045700 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045715 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045730 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045745 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045760 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045774 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045789 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045804 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045819 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045837 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045852 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045867 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045881 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045896 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045910 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045925 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045940 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045955 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045969 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045984 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.045999 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046014 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../../lib64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046028 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046043 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046058 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046073 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046087 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046102 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046117 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046132 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/tls", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046146 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046161 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046179 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046195 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046210 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046225 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/x86_64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046239 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64/libdrm.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046254 stat("/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/../lib64", 0x7ffd164f68b0) = -1 ENOENT (没有那个文件或目录) <0.000004>
5355  22:34:07.046268 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000004>
5355  22:34:07.046300 close(3)          = 0 <0.000003>
5355  22:34:07.046316 openat(AT_FDCWD, "/opt/amdgpu/lib/x86_64-linux-gnu/libdrm.so.2", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.046394 close(3)          = 0 <0.000003>
5355  22:34:07.046409 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libdrm_amdgpu.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.046426 openat(AT_FDCWD, "/opt/amdgpu/lib/x86_64-linux-gnu/libdrm_amdgpu.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.046498 close(3)          = 0 <0.000003>
5355  22:34:07.046513 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libnuma.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000005>
5355  22:34:07.046530 openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libnuma.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000005>
5355  22:34:07.046612 close(3)          = 0 <0.000003>
5355  22:34:07.046927 openat(AT_FDCWD, "/proc/self/status", O_RDONLY) = 3 <0.000013>
5355  22:34:07.046995 close(3)          = 0 <0.000005>
5355  22:34:07.047011 openat(AT_FDCWD, "/sys/devices/system/node", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000006>
5355  22:34:07.047051 openat(AT_FDCWD, "/sys/devices/system/node/node0/meminfo", O_RDONLY) = 4 <0.000007>
5355  22:34:07.047106 close(4)          = 0 <0.000004>
5355  22:34:07.047129 close(3)          = 0 <0.000004>
5355  22:34:07.047151 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 3 <0.000005>
5355  22:34:07.047193 close(3)          = 0 <0.000003>
5355  22:34:07.047206 openat(AT_FDCWD, "/proc/self/status", O_RDONLY) = 3 <0.000007>
5355  22:34:07.047267 close(3)          = 0 <0.000004>
5355  22:34:07.057387 openat(AT_FDCWD, "/dev/kfd", O_RDWR|O_CLOEXEC) = 3 <0.001855>
5355  22:34:07.059272 ioctl(3, AMDKFD_IOC_GET_VERSION, 0x7ffd164f7190) = 0 <0.000008>
5355  22:34:07.059301 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/system_properties", O_RDONLY) = 4 <0.000014>
5355  22:34:07.059417 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000015>
5355  22:34:07.059544 close(5)          = 0 <0.000006>
5355  22:34:07.059571 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 5 <0.000011>
5355  22:34:07.059631 close(5)          = 0 <0.000007>
5355  22:34:07.059655 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 5 <0.000009>
5355  22:34:07.059704 close(5)          = 0 <0.000006>
5355  22:34:07.059726 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 5 <0.000009>
5355  22:34:07.059800 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 6 <0.000026>
5355  22:34:07.059847 close(5)          = 0 <0.000006>
5355  22:34:07.059870 close(4)          = 0 <0.000006>
5355  22:34:07.059893 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 4 <0.000010>
5355  22:34:07.059953 close(4)          = 0 <0.000006>
5355  22:34:07.059975 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/properties", O_RDONLY) = 4 <0.000006>
5355  22:34:07.060028 close(4)          = 0 <0.000004>
5355  22:34:07.060042 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 4 <0.000009>
5355  22:34:07.060085 close(4)          = 0 <0.000005>
5355  22:34:07.060100 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 4 <0.000005>
5355  22:34:07.060157 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 5 <0.000013>
5355  22:34:07.060199 stat("/sys/dev/char/226:128/device/drm", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355  22:34:07.060227 ioctl(5, DRM_IOCTL_VERSION, 0x1122ce0) = 0 <0.000004>
5355  22:34:07.060242 ioctl(5, DRM_IOCTL_VERSION, 0x1122ce0) = 0 <0.000004>
5355  22:34:07.060264 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a50) = 0 <0.000004>
5355  22:34:07.060279 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a20) = 0 <0.000030>
5355  22:34:07.060319 ioctl(7, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f6a20) = 0 <0.000038>
5355  22:34:07.060369 openat(AT_FDCWD, "/opt/amdgpu/share/libdrm/amdgpu.ids", O_RDONLY) = 8 <0.000006>
5355  22:34:07.060445 close(8)          = 0 <0.000004>
5355  22:34:07.060459 close(7)          = 0 <0.000009>
5355  22:34:07.060502 close(5)          = 0 <0.000015>
5355  22:34:07.060527 close(4)          = 0 <0.000004>
5355  22:34:07.060541 ioctl(3, AMDKFD_IOC_GET_PROCESS_APERTURES_NEW, 0x7ffd164f6e40) = 0 <0.000004>
5355  22:34:07.060555 ioctl(3, AMDKFD_IOC_ACQUIRE_VM, 0x7ffd164f6e40) = 0 <0.000033>
5355  22:34:07.060645 ioctl(3, AMDKFD_IOC_SET_MEMORY_POLICY, 0x7ffd164f6e40) = 0 <0.000004>
5355  22:34:07.060683 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d00) = 0 <0.000007>
5355  22:34:07.060717 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d20) = 0 <0.000224>
5355  22:34:07.060955 openat(AT_FDCWD, "/sys/bus/event_source/devices/amd_iommu_0/events", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = -1 ENOENT (没有那个文件或目录) <0.000010>
5355  22:34:07.060979 openat(AT_FDCWD, "/sys/bus/event_source/devices/amd_iommu/events", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.061002 openat(AT_FDCWD, "/dev/shm/sem.hsakmt_semaphore", O_RDWR|O_NOFOLLOW) = 4 <0.000006>
5355  22:34:07.061040 close(4)          = 0 <0.000004>
5355  22:34:07.061054 openat(AT_FDCWD, "/dev/shm/hsakmt_shared_mem", O_RDWR|O_CREAT|O_NOFOLLOW|O_CLOEXEC, 0666) = 4 <0.000005>
5355  22:34:07.061100 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x82, 0x28), 0x7ffd164f7130) = 0 <0.000004>
5355  22:34:07.061123 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x82, 0x28), 0x7ffd164f71a0) = 0 <0.000005>
5355  22:34:07.061141 openat(AT_FDCWD, "/sys/devices/system/cpu/online", O_RDONLY|O_CLOEXEC) = 5 <0.000006>
5355  22:34:07.061169 close(5)          = 0 <0.000004>
5355  22:34:07.061183 openat(AT_FDCWD, "/proc/cpuinfo", O_RDONLY) = 5 <0.018582>
5355  22:34:07.080934 close(5)          = 0 <0.000015>
5355  22:34:07.081007 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/generation_id", O_RDONLY) = 5 <0.000037>
5355  22:34:07.081143 close(5)          = 0 <0.000014>
5355  22:34:07.081182 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/system_properties", O_RDONLY) = 5 <0.000017>
5355  22:34:07.081298 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000015>
5355  22:34:07.081415 close(7)          = 0 <0.000011>
5355  22:34:07.081454 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 7 <0.000018>
5355  22:34:07.081544 close(7)          = 0 <0.000011>
5355  22:34:07.081579 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 7 <0.000017>
5355  22:34:07.081665 close(7)          = 0 <0.000011>
5355  22:34:07.081714 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 7 <0.000016>
5355  22:34:07.081846 close(7)          = 0 <0.000011>
5355  22:34:07.081880 close(5)          = 0 <0.000011>
5355  22:34:07.081916 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 5 <0.000015>
5355  22:34:07.081997 close(5)          = 0 <0.000010>
5355  22:34:07.082032 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/properties", O_RDONLY) = 5 <0.000015>
5355  22:34:07.082163 close(5)          = 0 <0.000011>
5355  22:34:07.082199 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/mem_banks/0/properties", O_RDONLY) = 5 <0.000017>
5355  22:34:07.082307 close(5)          = 0 <0.000011>
5355  22:34:07.082344 openat(AT_FDCWD, "/sys/devices/system/node/node0", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000015>
5355  22:34:07.082506 close(5)          = 0 <0.000010>
5355  22:34:07.082539 openat(AT_FDCWD, "/sys/devices/system/node/node0", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000013>
5355  22:34:07.082641 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000018>
5355  22:34:07.082749 close(7)          = 0 <0.000010>
5355  22:34:07.082786 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000019>
5355  22:34:07.082874 close(7)          = 0 <0.000012>
5355  22:34:07.082910 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.082996 close(7)          = 0 <0.000010>
5355  22:34:07.083030 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.083115 close(7)          = 0 <0.000010>
5355  22:34:07.083149 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu11/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.083233 close(7)          = 0 <0.000011>
5355  22:34:07.083267 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000017>
5355  22:34:07.083374 close(7)          = 0 <0.000015>
5355  22:34:07.083427 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.083517 close(7)          = 0 <0.000011>
5355  22:34:07.083552 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.083636 close(7)          = 0 <0.000011>
5355  22:34:07.083670 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.083775 close(7)          = 0 <0.000021>
5355  22:34:07.083824 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu9/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.083908 close(7)          = 0 <0.000011>
5355  22:34:07.083944 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000016>
5355  22:34:07.084048 close(7)          = 0 <0.000011>
5355  22:34:07.084085 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.084171 close(7)          = 0 <0.000010>
5355  22:34:07.084206 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.084290 close(7)          = 0 <0.000011>
5355  22:34:07.084325 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.084408 close(7)          = 0 <0.000010>
5355  22:34:07.084442 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu7/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.084526 close(7)          = 0 <0.000011>
5355  22:34:07.084561 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000016>
5355  22:34:07.084673 close(7)          = 0 <0.000011>
5355  22:34:07.084712 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.084796 close(7)          = 0 <0.000011>
5355  22:34:07.084831 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/level", O_RDONLY) = 7 <0.000018>
5355  22:34:07.084917 close(7)          = 0 <0.000011>
5355  22:34:07.084953 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/type", O_RDONLY) = 7 <0.000016>
5355  22:34:07.085035 close(7)          = 0 <0.000011>
5355  22:34:07.085070 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.085154 close(7)          = 0 <0.000011>
5355  22:34:07.085189 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000018>
5355  22:34:07.085648 close(7)          = 0 <0.000035>
5355  22:34:07.085723 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000031>
5355  22:34:07.085824 close(7)          = 0 <0.000011>
5355  22:34:07.085860 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000018>
5355  22:34:07.085946 close(7)          = 0 <0.000011>
5355  22:34:07.085981 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086068 close(7)          = 0 <0.000010>
5355  22:34:07.086104 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086190 close(7)          = 0 <0.000010>
5355  22:34:07.086223 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/level", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086309 close(7)          = 0 <0.000011>
5355  22:34:07.086343 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/type", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086428 close(7)          = 0 <0.000010>
5355  22:34:07.086462 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.086547 close(7)          = 0 <0.000010>
5355  22:34:07.086580 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.086663 close(7)          = 0 <0.000010>
5355  22:34:07.086698 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086782 close(7)          = 0 <0.000010>
5355  22:34:07.086816 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000017>
5355  22:34:07.086899 close(7)          = 0 <0.000010>
5355  22:34:07.086933 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355  22:34:07.087017 close(7)          = 0 <0.000010>
5355  22:34:07.087052 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.087136 close(7)          = 0 <0.000010>
5355  22:34:07.087169 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/level", O_RDONLY) = 7 <0.000016>
5355  22:34:07.087253 close(7)          = 0 <0.000010>
5355  22:34:07.087286 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/type", O_RDONLY) = 7 <0.000017>
5355  22:34:07.087371 close(7)          = 0 <0.000026>
5355  22:34:07.087436 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/size", O_RDONLY) = 7 <0.000025>
5355  22:34:07.087551 close(7)          = 0 <0.000010>
5355  22:34:07.087585 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000017>
5355  22:34:07.087668 close(7)          = 0 <0.000011>
5355  22:34:07.087702 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355  22:34:07.087784 close(7)          = 0 <0.000011>
5355  22:34:07.087827 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355  22:34:07.087913 close(7)          = 0 <0.000010>
5355  22:34:07.087947 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355  22:34:07.088031 close(7)          = 0 <0.000011>
5355  22:34:07.088066 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu5/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.088149 close(7)          = 0 <0.000010>
5355  22:34:07.088185 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000017>
5355  22:34:07.088299 close(7)          = 0 <0.000011>
5355  22:34:07.088339 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.088427 close(7)          = 0 <0.000011>
5355  22:34:07.088463 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/level", O_RDONLY) = 7 <0.000017>
5355  22:34:07.088546 close(7)          = 0 <0.000010>
5355  22:34:07.088580 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/type", O_RDONLY) = 7 <0.000017>
5355  22:34:07.088664 close(7)          = 0 <0.000011>
5355  22:34:07.088699 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/size", O_RDONLY) = 7 <0.000018>
5355  22:34:07.088784 close(7)          = 0 <0.000011>
5355  22:34:07.088819 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.088901 close(7)          = 0 <0.000010>
5355  22:34:07.088936 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089019 close(7)          = 0 <0.000010>
5355  22:34:07.089053 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089134 close(7)          = 0 <0.000010>
5355  22:34:07.089168 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089252 close(7)          = 0 <0.000010>
5355  22:34:07.089286 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000018>
5355  22:34:07.089386 close(7)          = 0 <0.000015>
5355  22:34:07.089427 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/level", O_RDONLY) = 7 <0.000017>
5355  22:34:07.089511 close(7)          = 0 <0.000010>
5355  22:34:07.089545 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/type", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089628 close(7)          = 0 <0.000011>
5355  22:34:07.089662 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089748 close(7)          = 0 <0.000011>
5355  22:34:07.089782 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000017>
5355  22:34:07.089865 close(7)          = 0 <0.000010>
5355  22:34:07.089899 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000016>
5355  22:34:07.089983 close(7)          = 0 <0.000010>
5355  22:34:07.090017 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000017>
5355  22:34:07.090100 close(7)          = 0 <0.000010>
5355  22:34:07.090134 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000016>
5355  22:34:07.090218 close(7)          = 0 <0.000010>
5355  22:34:07.090252 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000017>
5355  22:34:07.090336 close(7)          = 0 <0.000010>
5355  22:34:07.090369 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/level", O_RDONLY) = 7 <0.000016>
5355  22:34:07.090451 close(7)          = 0 <0.000018>
5355  22:34:07.090498 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/type", O_RDONLY) = 7 <0.000016>
5355  22:34:07.090585 close(7)          = 0 <0.000011>
5355  22:34:07.090619 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/size", O_RDONLY) = 7 <0.000017>
5355  22:34:07.090703 close(7)          = 0 <0.000010>
5355  22:34:07.090737 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000016>
5355  22:34:07.090819 close(7)          = 0 <0.000011>
5355  22:34:07.090854 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000018>
5355  22:34:07.090938 close(7)          = 0 <0.000010>
5355  22:34:07.090972 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000016>
5355  22:34:07.091057 close(7)          = 0 <0.000010>
5355  22:34:07.091089 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000007>
5355  22:34:07.091127 close(7)          = 0 <0.000004>
5355  22:34:07.091140 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu3/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091173 close(7)          = 0 <0.000004>
5355  22:34:07.091186 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355  22:34:07.091227 close(7)          = 0 <0.000004>
5355  22:34:07.091241 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.091275 close(7)          = 0 <0.000004>
5355  22:34:07.091289 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/level", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091321 close(7)          = 0 <0.000004>
5355  22:34:07.091334 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/type", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091366 close(7)          = 0 <0.000003>
5355  22:34:07.091381 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/size", O_RDONLY) = 7 <0.000007>
5355  22:34:07.091425 close(7)          = 0 <0.000004>
5355  22:34:07.091438 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091471 close(7)          = 0 <0.000003>
5355  22:34:07.091483 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091515 close(7)          = 0 <0.000004>
5355  22:34:07.091528 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091560 close(7)          = 0 <0.000003>
5355  22:34:07.091572 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000007>
5355  22:34:07.091605 close(7)          = 0 <0.000003>
5355  22:34:07.091618 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091650 close(7)          = 0 <0.000004>
5355  22:34:07.091663 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/level", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091694 close(7)          = 0 <0.000003>
5355  22:34:07.091706 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/type", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091738 close(7)          = 0 <0.000003>
5355  22:34:07.091751 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091783 close(7)          = 0 <0.000003>
5355  22:34:07.091795 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091827 close(7)          = 0 <0.000003>
5355  22:34:07.091840 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091871 close(7)          = 0 <0.000004>
5355  22:34:07.091886 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091918 close(7)          = 0 <0.000004>
5355  22:34:07.091931 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000006>
5355  22:34:07.091963 close(7)          = 0 <0.000004>
5355  22:34:07.091976 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092008 close(7)          = 0 <0.000004>
5355  22:34:07.092022 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/level", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092053 close(7)          = 0 <0.000003>
5355  22:34:07.092065 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/type", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092098 close(7)          = 0 <0.000004>
5355  22:34:07.092110 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/size", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092143 close(7)          = 0 <0.000004>
5355  22:34:07.092155 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092187 close(7)          = 0 <0.000004>
5355  22:34:07.092200 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092231 close(7)          = 0 <0.000003>
5355  22:34:07.092244 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092276 close(7)          = 0 <0.000003>
5355  22:34:07.092288 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092320 close(7)          = 0 <0.000003>
5355  22:34:07.092333 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu1/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092366 close(7)          = 0 <0.000003>
5355  22:34:07.092378 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355  22:34:07.092420 close(7)          = 0 <0.000003>
5355  22:34:07.092434 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092467 close(7)          = 0 <0.000004>
5355  22:34:07.092479 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092513 close(7)          = 0 <0.000004>
5355  22:34:07.092526 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092562 close(7)          = 0 <0.000004>
5355  22:34:07.092576 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu10/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092608 close(7)          = 0 <0.000004>
5355  22:34:07.092621 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000007>
5355  22:34:07.092663 close(7)          = 0 <0.000003>
5355  22:34:07.092676 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092709 close(7)          = 0 <0.000004>
5355  22:34:07.092721 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092754 close(7)          = 0 <0.000004>
5355  22:34:07.092766 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092798 close(7)          = 0 <0.000003>
5355  22:34:07.092811 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu8/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092845 close(7)          = 0 <0.000004>
5355  22:34:07.092858 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355  22:34:07.092901 close(7)          = 0 <0.000003>
5355  22:34:07.092914 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000007>
5355  22:34:07.092947 close(7)          = 0 <0.000003>
5355  22:34:07.092959 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.092989 close(7)          = 0 <0.000003>
5355  22:34:07.093002 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.093032 close(7)          = 0 <0.000003>
5355  22:34:07.093044 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu6/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093073 close(7)          = 0 <0.000003>
5355  22:34:07.093085 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355  22:34:07.093123 close(7)          = 0 <0.000003>
5355  22:34:07.093135 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.093165 close(7)          = 0 <0.000003>
5355  22:34:07.093177 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093206 close(7)          = 0 <0.000003>
5355  22:34:07.093217 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093246 close(7)          = 0 <0.000003>
5355  22:34:07.093258 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093287 close(7)          = 0 <0.000003>
5355  22:34:07.093299 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093327 close(7)          = 0 <0.000003>
5355  22:34:07.093339 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093367 close(7)          = 0 <0.000003>
5355  22:34:07.093379 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.093409 close(7)          = 0 <0.000003>
5355  22:34:07.093420 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093449 close(7)          = 0 <0.000003>
5355  22:34:07.093461 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093490 close(7)          = 0 <0.000003>
5355  22:34:07.093502 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093531 close(7)          = 0 <0.000003>
5355  22:34:07.093542 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093571 close(7)          = 0 <0.000003>
5355  22:34:07.093583 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093612 close(7)          = 0 <0.000003>
5355  22:34:07.093623 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093652 close(7)          = 0 <0.000003>
5355  22:34:07.093664 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093693 close(7)          = 0 <0.000003>
5355  22:34:07.093705 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093735 close(7)          = 0 <0.000003>
5355  22:34:07.093747 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093775 close(7)          = 0 <0.000003>
5355  22:34:07.093787 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.093822 close(7)          = 0 <0.000003>
5355  22:34:07.093833 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093862 close(7)          = 0 <0.000004>
5355  22:34:07.093875 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093904 close(7)          = 0 <0.000003>
5355  22:34:07.093916 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093945 close(7)          = 0 <0.000003>
5355  22:34:07.093956 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.093985 close(7)          = 0 <0.000003>
5355  22:34:07.093997 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094026 close(7)          = 0 <0.000003>
5355  22:34:07.094037 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094066 close(7)          = 0 <0.000003>
5355  22:34:07.094078 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094107 close(7)          = 0 <0.000003>
5355  22:34:07.094119 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu4/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094148 close(7)          = 0 <0.000003>
5355  22:34:07.094160 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355  22:34:07.094198 close(7)          = 0 <0.000003>
5355  22:34:07.094209 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094239 close(7)          = 0 <0.000003>
5355  22:34:07.094251 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094279 close(7)          = 0 <0.000003>
5355  22:34:07.094291 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094320 close(7)          = 0 <0.000003>
5355  22:34:07.094332 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094361 close(7)          = 0 <0.000003>
5355  22:34:07.094372 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094401 close(7)          = 0 <0.000003>
5355  22:34:07.094413 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094442 close(7)          = 0 <0.000003>
5355  22:34:07.094454 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094482 close(7)          = 0 <0.000003>
5355  22:34:07.094494 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094522 close(7)          = 0 <0.000003>
5355  22:34:07.094534 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094563 close(7)          = 0 <0.000003>
5355  22:34:07.094575 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094604 close(7)          = 0 <0.000003>
5355  22:34:07.094616 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094644 close(7)          = 0 <0.000003>
5355  22:34:07.094656 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094685 close(7)          = 0 <0.000004>
5355  22:34:07.094698 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094728 close(7)          = 0 <0.000003>
5355  22:34:07.094741 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094774 close(7)          = 0 <0.000003>
5355  22:34:07.094786 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094815 close(7)          = 0 <0.000003>
5355  22:34:07.094826 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094856 close(7)          = 0 <0.000003>
5355  22:34:07.094867 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.094897 close(7)          = 0 <0.000003>
5355  22:34:07.094909 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094937 close(7)          = 0 <0.000003>
5355  22:34:07.094949 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.094978 close(7)          = 0 <0.000003>
5355  22:34:07.094990 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095020 close(7)          = 0 <0.000003>
5355  22:34:07.095032 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095060 close(7)          = 0 <0.000003>
5355  22:34:07.095072 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095101 close(7)          = 0 <0.000003>
5355  22:34:07.095112 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095141 close(7)          = 0 <0.000003>
5355  22:34:07.095152 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095181 close(7)          = 0 <0.000003>
5355  22:34:07.095193 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu2/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095222 close(7)          = 0 <0.000003>
5355  22:34:07.095235 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 7 <0.000006>
5355  22:34:07.095273 close(7)          = 0 <0.000003>
5355  22:34:07.095285 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095315 close(7)          = 0 <0.000003>
5355  22:34:07.095327 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/level", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095357 close(7)          = 0 <0.000003>
5355  22:34:07.095369 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/type", O_RDONLY) = 7 <0.000010>
5355  22:34:07.095406 close(7)          = 0 <0.000004>
5355  22:34:07.095426 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/size", O_RDONLY) = 7 <0.000014>
5355  22:34:07.095465 close(7)          = 0 <0.000004>
5355  22:34:07.095478 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095508 close(7)          = 0 <0.000003>
5355  22:34:07.095520 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095550 close(7)          = 0 <0.000003>
5355  22:34:07.095562 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095592 close(7)          = 0 <0.000003>
5355  22:34:07.095605 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index0/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095646 close(7)          = 0 <0.000003>
5355  22:34:07.095658 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095687 close(7)          = 0 <0.000003>
5355  22:34:07.095702 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/level", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095732 close(7)          = 0 <0.000003>
5355  22:34:07.095744 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095773 close(7)          = 0 <0.000003>
5355  22:34:07.095785 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095815 close(7)          = 0 <0.000004>
5355  22:34:07.095828 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/coherency_line_size", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095858 close(7)          = 0 <0.000004>
5355  22:34:07.095870 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095900 close(7)          = 0 <0.000004>
5355  22:34:07.095912 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/physical_line_partition", O_RDONLY) = 7 <0.000006>
5355  22:34:07.095942 close(7)          = 0 <0.000003>
5355  22:34:07.095954 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index1/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.095983 close(7)          = 0 <0.000003>
5355  22:34:07.095995 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/shared_cpu_list", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096024 close(7)          = 0 <0.000003>
5355  22:34:07.096036 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096064 close(7)          = 0 <0.000003>
5355  22:34:07.096076 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096104 close(7)          = 0 <0.000003>
5355  22:34:07.096116 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096145 close(7)          = 0 <0.000003>
5355  22:34:07.096157 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096186 close(7)          = 0 <0.000003>
5355  22:34:07.096198 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/ways_of_associativity", O_RDONLY) = 7 <0.000006>
5355  22:34:07.096228 close(7)          = 0 <0.000003>
5355  22:34:07.096240 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096268 close(7)          = 0 <0.000003>
5355  22:34:07.096280 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index2/shared_cpu_map", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096309 close(7)          = 0 <0.000003>
5355  22:34:07.096321 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/shared_cpu_list", O_RDONLY) = 7 <0.000006>
5355  22:34:07.096350 close(7)          = 0 <0.000003>
5355  22:34:07.096362 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/level", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096391 close(7)          = 0 <0.000003>
5355  22:34:07.096403 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/type", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096432 close(7)          = 0 <0.000003>
5355  22:34:07.096443 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096472 close(7)          = 0 <0.000003>
5355  22:34:07.096484 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/coherency_line_size", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096513 close(7)          = 0 <0.000003>
5355  22:34:07.096525 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/ways_of_associativity", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096553 close(7)          = 0 <0.000003>
5355  22:34:07.096565 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/physical_line_partition", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096594 close(7)          = 0 <0.000003>
5355  22:34:07.096608 openat(AT_FDCWD, "/sys/devices/system/node/node0/cpu0/cache/index3/shared_cpu_map", O_RDONLY) = 7 <0.000010>
5355  22:34:07.096645 close(7)          = 0 <0.000003>
5355  22:34:07.096664 close(5)          = 0 <0.000003>
5355  22:34:07.096681 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/io_links/0/properties", O_RDONLY) = 5 <0.000008>
5355  22:34:07.096735 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096767 close(7)          = 0 <0.000003>
5355  22:34:07.096779 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 7 <0.000005>
5355  22:34:07.096821 close(7)          = 0 <0.000003>
5355  22:34:07.096834 close(5)          = 0 <0.000003>
5355  22:34:07.096846 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/gpu_id", O_RDONLY) = 5 <0.000005>
5355  22:34:07.096875 close(5)          = 0 <0.000003>
5355  22:34:07.096887 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/properties", O_RDONLY) = 5 <0.000005>
5355  22:34:07.096936 openat(AT_FDCWD, "/dev/dri/renderD128", O_RDWR|O_CLOEXEC) = 7 <0.000029>
5355  22:34:07.096989 stat("/sys/dev/char/226:128/device/drm", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 <0.000012>
5355  22:34:07.097017 ioctl(7, DRM_IOCTL_VERSION, 0x11233f0) = 0 <0.000006>
5355  22:34:07.097034 ioctl(7, DRM_IOCTL_VERSION, 0x11233f0) = 0 <0.000003>
5355  22:34:07.097055 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69e0) = 0 <0.000004>
5355  22:34:07.097069 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69b0) = 0 <0.000343>
5355  22:34:07.097422 ioctl(8, DRM_IOCTL_AMDGPU_INFO or DRM_IOCTL_SIS_FB_FREE, 0x7ffd164f69b0) = 0 <0.000010>
5355  22:34:07.097444 openat(AT_FDCWD, "/opt/amdgpu/share/libdrm/amdgpu.ids", O_RDONLY) = 9 <0.000008>
5355  22:34:07.097527 close(9)          = 0 <0.000003>
5355  22:34:07.097541 close(8)          = 0 <0.000004>
5355  22:34:07.097568 close(7)          = 0 <0.000016>
5355  22:34:07.097592 close(5)          = 0 <0.000003>
5355  22:34:07.097605 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/mem_banks/0/properties", O_RDONLY) = 5 <0.000009>
5355  22:34:07.097653 close(5)          = 0 <0.000004>
5355  22:34:07.097666 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/0/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.097735 close(5)          = 0 <0.000005>
5355  22:34:07.097751 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/1/properties", O_RDONLY) = 5 <0.000007>
5355  22:34:07.097823 close(5)          = 0 <0.000004>
5355  22:34:07.097835 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/2/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.097903 close(5)          = 0 <0.000006>
5355  22:34:07.097920 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/3/properties", O_RDONLY) = 5 <0.000007>
5355  22:34:07.097991 close(5)          = 0 <0.000003>
5355  22:34:07.098003 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/4/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098070 close(5)          = 0 <0.000005>
5355  22:34:07.098086 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/5/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098154 close(5)          = 0 <0.000005>
5355  22:34:07.098170 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/6/properties", O_RDONLY) = 5 <0.000007>
5355  22:34:07.098241 close(5)          = 0 <0.000003>
5355  22:34:07.098254 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/7/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098321 close(5)          = 0 <0.000005>
5355  22:34:07.098338 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/8/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098406 close(5)          = 0 <0.000003>
5355  22:34:07.098419 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/9/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098488 close(5)          = 0 <0.000005>
5355  22:34:07.098504 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/10/properties", O_RDONLY) = 5 <0.000007>
5355  22:34:07.098576 close(5)          = 0 <0.000003>
5355  22:34:07.098588 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/11/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098656 close(5)          = 0 <0.000004>
5355  22:34:07.098668 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/12/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098736 close(5)          = 0 <0.000005>
5355  22:34:07.098752 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/caches/13/properties", O_RDONLY) = 5 <0.000007>
5355  22:34:07.098822 close(5)          = 0 <0.000003>
5355  22:34:07.098835 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/1/io_links/0/properties", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098875 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/nodes/0/gpu_id", O_RDONLY) = 7 <0.000005>
5355  22:34:07.098903 close(7)          = 0 <0.000003>
5355  22:34:07.098917 close(5)          = 0 <0.000003>
5355  22:34:07.098928 openat(AT_FDCWD, "/sys/devices/virtual/kfd/kfd/topology/generation_id", O_RDONLY) = 5 <0.000006>
5355  22:34:07.098959 close(5)          = 0 <0.000003>
5355  22:34:07.098986 ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x4b, 0x21, 0x4), 0x7ffd164f6f24) = 0 <0.000004>
5355  22:34:07.099000 ioctl(3, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffd164f6dd0) = 0 <0.000006>
5355  22:34:07.099024 ioctl(3, AMDKFD_IOC_GET_CLOCK_COUNTERS, 0x7ffd164f71c0) = 0 <0.000004>
5355  22:34:07.099070 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6f20) = 0 <0.000012>
5355  22:34:07.099119 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6ff0) = 0 <0.000212>
5355  22:34:07.099343 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f7140) = 0 <0.000013>
5355  22:34:07.099424 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6e60) = 0 <0.000023>
5355  22:34:07.099458 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6e90) = 0 <0.000029>
5355  22:34:07.099499 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f7030) = 0 <0.000004>
5355  22:34:07.099513 openat(AT_FDCWD, "/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000006>
5355  22:34:07.099556 close(5)          = 0 <0.000003>
5355  22:34:07.099668 ioctl(3, AMDKFD_IOC_SET_SCRATCH_BACKING_VA, 0x7ffd164f70d0) = 0 <0.000003>
5355  22:34:07.099735 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ae0) = 0 <0.000015>
5355  22:34:07.099762 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b10) = 0 <0.000056>
5355  22:34:07.099829 ioctl(3, AMDKFD_IOC_SET_TRAP_HANDLER, 0x7ffd164f71a0) = 0 <0.000004>
5355  22:34:07.099909 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c50) = 0 <0.000008>
5355  22:34:07.099926 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6c80) = 0 <0.000033>
5358  22:34:07.099980 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.100017 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c00) = 0 <0.000007>
5355  22:34:07.100033 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6c30) = 0 <0.000028>
5355  22:34:07.100071 ioctl(3, AMDKFD_IOC_CREATE_EVENT, 0x7ffd164f6e70) = 0 <0.000005>
5355  22:34:07.100130 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f69b0) = 0 <0.000010>
5355  22:34:07.100148 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000024>
5355  22:34:07.100212 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6970) = 0 <0.000006>
5355  22:34:07.100243 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000022>
5355  22:34:07.100317 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f69b0) = 0 <0.000294>
5355  22:34:07.100621 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6a20) = 0 <0.000092>
5355  22:34:07.100724 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6b90) = 0 <0.000531>
5355  22:34:07.101297 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a30) = 0 <0.000006>
5355  22:34:07.101324 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6aa0) = 0 <0.000025>
5355  22:34:07.101363 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6e80) = 0 <0.000005>
5358  22:34:07.101374 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.001391>
5355  22:34:07.101379 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6e80) = 0 <0.000002>
5355  22:34:07.101445 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6c80) = 0 <0.000008>
5355  22:34:07.101463 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6cb0) = 0 <0.000028>
5355  22:34:07.101546 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000008>
5355  22:34:07.101563 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000032>
5358  22:34:07.101610 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000004>
5358  22:34:07.101626 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.101655 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000042>
5355  22:34:07.101706 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355  22:34:07.101792 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355  22:34:07.101809 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000027>
5355  22:34:07.101868 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000006>
5355  22:34:07.101898 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355  22:34:07.101974 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000309>
5355  22:34:07.102294 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000114>
5355  22:34:07.102419 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000064>
5355  22:34:07.102495 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358  22:34:07.102507 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000878>
5355  22:34:07.102512 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355  22:34:07.102581 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355  22:34:07.102599 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355  22:34:07.102679 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355  22:34:07.102694 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358  22:34:07.102744 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000006>
5358  22:34:07.102760 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.102774 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000041>
5355  22:34:07.102826 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355  22:34:07.102910 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355  22:34:07.102926 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000029>
5355  22:34:07.102988 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000006>
5355  22:34:07.103018 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000022>
5355  22:34:07.103092 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000327>
5355  22:34:07.103429 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000115>
5355  22:34:07.103556 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000064>
5355  22:34:07.103632 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358  22:34:07.103645 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000881>
5355  22:34:07.103649 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355  22:34:07.103720 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355  22:34:07.103738 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355  22:34:07.103816 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355  22:34:07.103832 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358  22:34:07.103884 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000006>
5358  22:34:07.103901 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.103912 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000041>
5355  22:34:07.103967 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355  22:34:07.104052 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000008>
5355  22:34:07.104069 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355  22:34:07.104125 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000005>
5355  22:34:07.104154 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000022>
5355  22:34:07.104228 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000321>
5355  22:34:07.104560 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000092>
5355  22:34:07.104664 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000066>
5355  22:34:07.104741 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000006>
5358  22:34:07.104754 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000850>
5355  22:34:07.104758 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000002>
5355  22:34:07.104825 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000008>
5355  22:34:07.104842 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000027>
5355  22:34:07.104925 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d60) = 0 <0.000007>
5355  22:34:07.104940 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d90) = 0 <0.000023>
5358  22:34:07.104989 ioctl(3, AMDKFD_IOC_WAIT_EVENTS, 0x7f0a22a66ba0) = 0 <0.000005>
5358  22:34:07.105005 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.105019 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d10) = 0 <0.000040>
5355  22:34:07.105070 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6d40) = 0 <0.000024>
5355  22:34:07.105196 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000012>
5355  22:34:07.105235 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000023>
5355  22:34:07.105298 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6a80) = 0 <0.000007>
5355  22:34:07.105333 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000031>
5355  22:34:07.105425 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6ac0) = 0 <0.000357>
5355  22:34:07.105803 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6b30) = 0 <0.000108>
5355  22:34:07.105938 ioctl(3, AMDKFD_IOC_CREATE_QUEUE, 0x7ffd164f6ca0) = 0 <0.000067>
5355  22:34:07.106022 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000008>
5358  22:34:07.106039 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.001030>
5355  22:34:07.106045 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f6f90) = 0 <0.000003>
5355  22:34:07.106129 ioctl(3, AMDKFD_IOC_ALLOC_MEMORY_OF_GPU, 0x7ffd164f6d90) = 0 <0.000009>
5355  22:34:07.106149 ioctl(3, AMDKFD_IOC_MAP_MEMORY_TO_GPU, 0x7ffd164f6dc0) = 0 <0.000023>
5355  22:34:07.106278 stat("fixme.so",  <unfinished ...>
5358  22:34:07.106288 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.106294 <... stat resumed>0x7ffd164f7a68) = -1 ENOENT (没有那个文件或目录) <0.000007>
5358  22:34:07.106302 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000009>
5358  22:34:07.106309 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.106321 openat(AT_FDCWD, "/sys/bus/pci/devices", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000010>
5355  22:34:07.106392 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:03:00.0/uevent", O_RDONLY) = 7 <0.000010>
5355  22:34:07.106455 close(7)          = 0 <0.000005>
5355  22:34:07.106476 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.106517 close(7)          = 0 <0.000004>
5355  22:34:07.106532 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.3/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.106570 close(7)          = 0 <0.000004>
5355  22:34:07.106585 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.3/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.106621 close(7)          = 0 <0.000004>
5355  22:34:07.106635 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.1/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.106672 close(7)          = 0 <0.000004>
5355  22:34:07.106692 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.1/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.106730 close(7)          = 0 <0.000004>
5355  22:34:07.106744 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:01.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.106781 close(7)          = 0 <0.000005>
5355  22:34:07.106797 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.2/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.106838 close(7)          = 0 <0.000004>
5355  22:34:07.106853 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.3/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.106890 close(7)          = 0 <0.000004>
5355  22:34:07.106904 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.106940 close(7)          = 0 <0.000004>
5355  22:34:07.106955 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.1/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.106991 close(7)          = 0 <0.000004>
5355  22:34:07.107005 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.6/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.107041 close(7)          = 0 <0.000004>
5355  22:34:07.107056 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.6/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107092 close(7)          = 0 <0.000004>
5355  22:34:07.107107 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.107143 close(7)          = 0 <0.000005>
5355  22:34:07.107159 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.1/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107200 close(7)          = 0 <0.000004>
5355  22:34:07.107214 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.4/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107257 close(7)          = 0 <0.000004>
5355  22:34:07.107272 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.4/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.107309 close(7)          = 0 <0.000004>
5355  22:34:07.107324 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:02:02.0/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107361 close(7)          = 0 <0.000004>
5355  22:34:07.107375 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.2/uevent", O_RDONLY) = 7 <0.000010>
5355  22:34:07.107428 close(7)          = 0 <0.000004>
5355  22:34:07.107443 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.2/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107485 close(7)          = 0 <0.000004>
5355  22:34:07.107499 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107540 close(7)          = 0 <0.000004>
5355  22:34:07.107554 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107596 close(7)          = 0 <0.000004>
5355  22:34:07.107611 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.1/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107651 close(7)          = 0 <0.000004>
5355  22:34:07.107666 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.2/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107707 close(7)          = 0 <0.000004>
5355  22:34:07.107722 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:04:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107762 close(7)          = 0 <0.000004>
5355  22:34:07.107777 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.0/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107816 close(7)          = 0 <0.000004>
5355  22:34:07.107831 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.7/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.107871 close(7)          = 0 <0.000004>
5355  22:34:07.107886 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.0/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107926 close(7)          = 0 <0.000004>
5355  22:34:07.107940 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.5/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.107981 close(7)          = 0 <0.000004>
5355  22:34:07.108004 close(5)          = 0 <0.000005>
5355  22:34:07.108019 openat(AT_FDCWD, "/sys/bus/pci/devices", O_RDONLY|O_NONBLOCK|O_CLOEXEC|O_DIRECTORY) = 5 <0.000006>
5355  22:34:07.108059 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:03:00.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.108102 close(7)          = 0 <0.000004>
5355  22:34:07.108118 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108152 close(7)          = 0 <0.000004>
5355  22:34:07.108166 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.3/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108201 close(7)          = 0 <0.000004>
5355  22:34:07.108216 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.3/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108250 close(7)          = 0 <0.000004>
5355  22:34:07.108264 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.1/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108298 close(7)          = 0 <0.000004>
5355  22:34:07.108313 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.1/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108347 close(7)          = 0 <0.000004>
5355  22:34:07.108361 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:01.0/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108395 close(7)          = 0 <0.000004>
5355  22:34:07.108409 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.2/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108443 close(7)          = 0 <0.000004>
5355  22:34:07.108457 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.3/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108491 close(7)          = 0 <0.000004>
5355  22:34:07.108506 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108541 close(7)          = 0 <0.000004>
5355  22:34:07.108555 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.1/uevent", O_RDONLY) = 7 <0.000009>
5355  22:34:07.108598 close(7)          = 0 <0.000004>
5355  22:34:07.108613 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.6/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108648 close(7)          = 0 <0.000004>
5355  22:34:07.108663 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.6/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108697 close(7)          = 0 <0.000004>
5355  22:34:07.108711 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108746 close(7)          = 0 <0.000004>
5355  22:34:07.108760 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:08.1/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.108794 close(7)          = 0 <0.000005>
5355  22:34:07.108810 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.4/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.108851 close(7)          = 0 <0.000004>
5355  22:34:07.108866 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.4/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108900 close(7)          = 0 <0.000004>
5355  22:34:07.108914 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:02:02.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.108949 close(7)          = 0 <0.000004>
5355  22:34:07.108964 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.2/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109010 close(7)          = 0 <0.000004>
5355  22:34:07.109025 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.2/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109059 close(7)          = 0 <0.000004>
5355  22:34:07.109074 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:05:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109108 close(7)          = 0 <0.000005>
5355  22:34:07.109123 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.0/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.109164 close(7)          = 0 <0.000004>
5355  22:34:07.109179 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:01:00.1/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109213 close(7)          = 0 <0.000004>
5355  22:34:07.109227 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.2/uevent", O_RDONLY) = 7 <0.000005>
5355  22:34:07.109261 close(7)          = 0 <0.000004>
5355  22:34:07.109275 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:04:00.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109309 close(7)          = 0 <0.000004>
5355  22:34:07.109324 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:02.0/uevent", O_RDONLY) = 7 <0.000006>
5355  22:34:07.109372 close(7)          = 0 <0.000004>
5355  22:34:07.109388 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.7/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.109450 close(7)          = 0 <0.000006>
5355  22:34:07.109475 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:14.0/uevent", O_RDONLY) = 7 <0.000008>
5355  22:34:07.109537 close(7)          = 0 <0.000006>
5355  22:34:07.109562 openat(AT_FDCWD, "/sys/bus/pci/devices/0000:00:18.5/uevent", O_RDONLY) = 7 <0.000007>
5355  22:34:07.109619 close(7)          = 0 <0.000004>
5355  22:34:07.109665 close(5)          = 0 <0.000004>
5355  22:34:07.109693 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000010>
5355  22:34:07.109719 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (没有那个文件或目录) <0.000006>
5355  22:34:07.109740 openat(AT_FDCWD, "/opt/rocm-5.1.0/llvm/bin/../lib/../../lib/libhsa-runtime64.so", O_RDONLY|O_CLOEXEC) = 5 <0.000009>
5355  22:34:07.109781 close(5)          = 0 <0.000004>
5355  22:34:07.109815 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000007>
5355  22:34:07.109852 close(5)          = 0 <0.000007>
5355  22:34:07.109872 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000005>
5355  22:34:07.109896 close(5)          = 0 <0.000003>
5355  22:34:07.109909 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000005>
5355  22:34:07.109932 close(5)          = 0 <0.000009>
5355  22:34:07.109955 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.109982 close(5)          = 0 <0.000005>
5355  22:34:07.109998 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000007>
5355  22:34:07.110022 close(5)          = 0 <0.000003>
5355  22:34:07.110034 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110055 close(5)          = 0 <0.000003>
5355  22:34:07.110067 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110087 close(5)          = 0 <0.000003>
5355  22:34:07.110099 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110118 close(5)          = 0 <0.000003>
5355  22:34:07.110129 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110149 close(5)          = 0 <0.000003>
5355  22:34:07.110160 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000009>
5355  22:34:07.110193 close(5)          = 0 <0.000004>
5355  22:34:07.110206 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110226 close(5)          = 0 <0.000003>
5355  22:34:07.110238 openat(AT_FDCWD, "/dev/random", O_WRONLY) = 5 <0.000004>
5355  22:34:07.110258 close(5)          = 0 <0.000003>
5355  22:34:07.111651 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000011>
5358  22:34:07.111683 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.005370>
5358  22:34:07.111710 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000020>
5355  22:34:07.111752 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358  22:34:07.111761 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355  22:34:07.111992 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000236>
5358  22:34:07.112005 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.112013 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358  22:34:07.112030 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000021>
5355  22:34:07.112038 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000022>
5358  22:34:07.112051 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.112060 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000015>
5355  22:34:07.112149 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000016>
5355  22:34:07.112188 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000016>
5355  22:34:07.112401 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000011>
5355  22:34:07.112431 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355  22:34:07.112513 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000009>
5355  22:34:07.112541 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000009>
5355  22:34:07.112639 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000016>
5355  22:34:07.112674 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000015>
5355  22:34:07.112759 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355  22:34:07.112794 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000012>
5355  22:34:07.112878 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000011>
5358  22:34:07.112902 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000847>
5358  22:34:07.112928 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000017>
5355  22:34:07.112960 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358  22:34:07.112979 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355  22:34:07.113106 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000142>
5355  22:34:07.113120 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000009>
5355  22:34:07.113149 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000012>
5358  22:34:07.113225 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.113234 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358  22:34:07.113252 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000021>
5355  22:34:07.113260 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000022>
5358  22:34:07.113276 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.113283 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000014>
5355  22:34:07.113470 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000014>
5355  22:34:07.113502 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355  22:34:07.113586 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000010>
5355  22:34:07.113618 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000012>
5355  22:34:07.113711 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000009>
5355  22:34:07.113741 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000011>
5355  22:34:07.113815 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355  22:34:07.113840 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000015>
5355  22:34:07.113913 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000016>
5358  22:34:07.113947 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000667>
5358  22:34:07.113975 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000019>
5355  22:34:07.114014 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358  22:34:07.114024 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d70) = 0 <0.000018>
5355  22:34:07.114100 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000083>
5355  22:34:07.114115 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000012>
5355  22:34:07.114140 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000014>
5355  22:34:07.114222 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000018>
5355  22:34:07.114258 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5358  22:34:07.114271 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.114285 <... ioctl resumed>, 0x7ffd164f7a00) = 0 <0.000022>
5358  22:34:07.114306 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000031>
5358  22:34:07.114329 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.114504 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000009>
5355  22:34:07.114533 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000011>
5355  22:34:07.114607 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000010>
5355  22:34:07.114632 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000013>
5355  22:34:07.114727 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000017>
5355  22:34:07.114760 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000009>
5355  22:34:07.114843 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000015>
5355  22:34:07.114872 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000013>
5355  22:34:07.114953 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7ffd164f7a90) = 0 <0.000014>
5358  22:34:07.114989 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000656>
5358  22:34:07.115015 ioctl(3, AMDKFD_IOC_SET_EVENT, 0x7f0a22a66d20) = 0 <0.000019>
5358  22:34:07.115056 ioctl(3, AMDKFD_IOC_SET_EVENT <unfinished ...>
5355  22:34:07.115062 ioctl(3, AMDKFD_IOC_DESTROY_QUEUE <unfinished ...>
5358  22:34:07.115088 <... ioctl resumed>, 0x7f0a22a66d70) = 0 <0.000027>
5355  22:34:07.115157 <... ioctl resumed>, 0x7ffd164f7a90) = 0 <0.000090>
5355  22:34:07.115171 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79b0) = 0 <0.000012>
5355  22:34:07.115206 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a00) = 0 <0.000013>
5355  22:34:07.115302 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU <unfinished ...>
5358  22:34:07.115316 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.115326 <... ioctl resumed>, 0x7ffd164f79b0) = 0 <0.000019>
5358  22:34:07.115343 <... ioctl resumed>, 0x7f0a22a66ba0) = 0 <0.000024>
5355  22:34:07.115351 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU <unfinished ...>
5358  22:34:07.115370 ioctl(3, AMDKFD_IOC_WAIT_EVENTS <unfinished ...>
5355  22:34:07.115376 <... ioctl resumed>, 0x7ffd164f7a00) = 0 <0.000022>
5355  22:34:07.115584 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f79d0) = 0 <0.000014>
5355  22:34:07.115622 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7a20) = 0 <0.000016>
5355  22:34:07.115705 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7920) = 0 <0.000015>
5355  22:34:07.115734 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7970) = 0 <0.000013>
5355  22:34:07.115830 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000014>
5355  22:34:07.115862 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000013>
5355  22:34:07.115944 ioctl(3, AMDKFD_IOC_UNMAP_MEMORY_FROM_GPU, 0x7ffd164f7940) = 0 <0.000011>
5355  22:34:07.115977 ioctl(3, AMDKFD_IOC_FREE_MEMORY_OF_GPU, 0x7ffd164f7990) = 0 <0.000011>
5355  22:34:07.116137 openat(AT_FDCWD, "/dev/shm/__KMP_REGISTERED_LIB_5355_0", O_RDONLY|O_NOFOLLOW|O_CLOEXEC) = 5 <0.000010>
5355  22:34:07.116231 close(5)          = 0 <0.000012>
5355  22:34:07.116259 unlink("/dev/shm/__KMP_REGISTERED_LIB_5355_0") = 0 <0.000019>
5369  22:34:07.116369 +++ exited with 0 +++
5368  22:34:07.116374 +++ exited with 0 +++
5367  22:34:07.116376 +++ exited with 0 +++
5365  22:34:07.116380 +++ exited with 0 +++
5366  22:34:07.116393 +++ exited with 0 +++
5363  22:34:07.116399 +++ exited with 0 +++
5364  22:34:07.116401 +++ exited with 0 +++
5360  22:34:07.116405 +++ exited with 0 +++
5362  22:34:07.116411 +++ exited with 0 +++
5361  22:34:07.116414 +++ exited with 0 +++
5359  22:34:07.116416 +++ exited with 0 +++
5358  22:34:07.116722 <... ioctl resumed> <unfinished ...>) = ?
5358  22:34:07.116762 +++ exited with 0 +++
5355  22:34:07.133444 +++ exited with 0 +++
参考资料

百度安全验证

AMD的ROCM平台是什么? - 知乎

https://cgmb-rocm-docs.readthedocs.io/_/downloads/en/latest/pdf/

OpenCL编程详细解析与实例 - 知乎

第1章 简介异构计算 - OpenCL 2.0 异构计算 - 开发文档 - 文江博客

HIP-ROCM架构概述 - 知乎

ROCm兼容cuda方案和验证 - 知乎

ROCm API libraries — ROCm Documentation

源码编译安装ROCm以运行tensorflow-rocm(适用于Ubuntu 23.04) - 小蓝博客

AMD 推出 HIP SDK:拓展 ROCm 方案,为 CUDA 应用程序提供支持_腾讯新闻

https://dev.to/shawonashraf/setting-up-your-amd-gpu-for-tensorflow-in-ubuntu-20-04-31f5

GPU memory — ROCm Documentation

Index of /amdgpu-install/

https://www.cnblogs.com/lllzhuang/articles/16083003.html

结束

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处:/a/415065.html

如若内容造成侵权/违法违规/事实不符,请联系我们进行投诉反馈qq邮箱809451989@qq.com,一经查实,立即删除!

相关文章

177基于matlab的基于S函数的变步长自适应滤波算法

基于matlab的基于S函数的变步长自适应滤波算法&#xff0c;比传统的算法收敛速度更快。传统的LMS算法中&#xff0c;权值向量实时地被更新。这些更新可能会由于噪声的影响而变得不稳定。SVSLMS算法是一种改进的LMS算法&#xff0c;它采用了矢量处理的概念&#xff0c;利用信号和…

分布式锁的应用与疑惑

文章目录 一、为什么需要用分布式锁二、Redis实现分布式锁三、Zookeeper实现分布式锁 一、为什么需要用分布式锁 集群下&#xff0c;普通的锁&#xff0c;无法解决问题 集群下&#xff0c;保证安全需要使用分布式锁 二、Redis实现分布式锁 Redisson内部封装的RedLock实现分…

yolov9,使用自定义的数据训练推理

[源码 &#x1f40b;]( GitHub - WongKinYiu/yolov9: Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information) [论文 &#x1f4d8;](arxiv.org/pdf/2402.13616.pdf) 论文摘要&#xff1a;本文介绍了一种新的目标检测…

Web服务器群集:OpenEuler 部署 LAMP(LNMP) 基础服务

目录 一、实验 1.环境 2. 网络配置 3. MobaXterm远程连接 4. apache 2.4.58 源码编译安装 5. php 8.3.1源码编译安装 6.配置httpd 连接 php-fpm 6. nginx 1.24.0源码编译安装 7. mysql 8.0.36安装 二、问题 1.MobaXterm设置右键复制粘贴 2.OpenEuler如何查看CPU的核…

网络防御保护3

一、双击热备 1&#xff0c;根据网段划分配置IP地址和安全区域 2&#xff0c;配置双机热备场景 主备场景配置 抢占延时仅对主设备生效。 hello报文周期时间--- 默认为1S&#xff0c;可以修改&#xff0c;但是&#xff0c;主备设备需要同时修改为相同值。 同步配置 双机热备的…

【网站项目】424学报稿件管理系统

&#x1f64a;作者简介&#xff1a;拥有多年开发工作经验&#xff0c;分享技术代码帮助学生学习&#xff0c;独立完成自己的项目或者毕业设计。 代码可以私聊博主获取。&#x1f339;赠送计算机毕业设计600个选题excel文件&#xff0c;帮助大学选题。赠送开题报告模板&#xff…

一个注解实现频率控制

1.概述 抹茶项目是一个即时的IM通信项目&#xff0c;并且有着万人大群。但凡有几个人刷屏&#xff0c;那消息爆炸的场景&#xff0c;都不敢想象。如果我们需要对项目特定的接口进行频率控制&#xff0c;不仅是业务上的功能&#xff0c;同样也保护了项目的监控运行。而频控又是…

幻兽帕鲁(1.5.0)可视化管理工具(0.5.7 docker版)安装教程

文章目录 局域网帕鲁服务器部署教程帕鲁服务可视化工具安装配置服务器地址&#xff08;可跳过&#xff09;使用工具管理面板 1.5.0服务端RCON错误1.5.0服务端无法启动RCON端口 解决方法第一步&#xff1a;PalWorldSettings.ini配置第二步&#xff1a;修改PalServer.sh配置 局域…

数据结构--二叉排序树(Binary Search Tree,简称BST)

这里写自定义目录标题 二叉排序树二叉排序树与排序数组没有排序数组&#xff0c;链式存储链表的对比二叉排序树概念对于搜索操作&#xff0c;对于插入操作&#xff0c;对于删除操作&#xff0c; 分析删除节点代码运行结果 二叉排序树 二叉排序树与排序数组没有排序数组&#x…

python自动化管理和zabbix监控网络设备(防火墙和python自动化配置部分)

目录 前言 一、ssh配置 1.FW1 2.core-sw1 3.core-sw2 二、python自动化配置防火墙 三、验证DNAT 四、验证DNAT 前言 视频演示请访问b站主页 白帽小丑的个人空间-白帽小丑个人主页-哔哩哔哩视频 一、ssh配置 给需要自动化管理的设备配置ssh服务端用户名和密码 1.FW1 …

Linux NFC 子系统剖析

1.总览 linux源码中NFC在net/nfc下&#xff0c;文件结构如下图&#xff1a; hci&#xff1a;Host Controller Interface 主要是针对NFC的主机-控制器接口协议 nci&#xff1a;NFC Controller Interface 主要是NFC的控制器接口协议&#xff0c;用于NFCC(NFC Controller)和DH(…

进程的控制

文章目录 进程退出进程等待进程程序替换 正文开始前给大家推荐个网站&#xff0c;前些天发现了一个巨牛的 人工智能学习网站&#xff0c; 通俗易懂&#xff0c;风趣幽默&#xff0c;忍不住分享一下给大家。 点击跳转到网站。 进程退出 进程的退出一共有三种场景。 程序跑完…

nacos开启鉴权+springboot配置用户名密码

nacos默认没有开启鉴权&#xff0c;springboot无需用户名密码即可连接nacos。从2.2.2版本开始&#xff0c;默认控制台也无需登录直接可进行操作。 因此本文记录一下如何开启鉴权&#xff0c;基于nacos2.3.0版本。 编辑nacos服务端的application.properties&#xff1a; # 开…

硬件工程师入门基础知识(二)片式电阻、片式网络电阻标识和焊接使用注意事项

片式电阻、片式网络电阻标识和使用注意事项 1.概述2.阻值标识2.1 标识原则2.2片式类电阻、片式电阻网络标识方法2.3电阻网络标识方法 3.电阻产品包装3.1片式电阻、片式电阻网络的包装3.2电阻网络的包装 4.使用注意事项4.1 片式电阻推荐焊盘尺寸4.2片式电阻网络推荐焊盘尺寸 5.焊…

STM32 +合宙1.54“ 电子墨水屏(e-paper)驱动显示示例

STM32 合宙1.54“ 电子墨水屏&#xff08;e-paper&#xff09;驱动显示示例 &#x1f4cd;相关篇《Arduino框架下ESP32/ESP8266合宙1.54“ 电子墨水屏&#xff08;e-paper&#xff09;驱动显示示例》&#x1f516;程序是从GooDisplay品牌和微雪电子下同型号规格墨水屏的示例程序…

Vue项目 快速上手(如何新建Vue项目,启动Vue项目,Vue的生命周期,Vue的常用指令)

目录 一.什么Vue框架 二.如何新建一个Vue项目 1.使用命令行新建Vue项目 2.使用图形化界面新建Vue项目 三.Vue项目的启动 启动Vue项目 1.通过VScode提供的图形化界面启动Vue项目 2.通过命令行的方式启动Vue项目 四.Vue项目的基础使用 常用指令 v-bind 和 v-model v…

【Unity每日一记】角色控制器Character Contorller

&#x1f468;‍&#x1f4bb;个人主页&#xff1a;元宇宙-秩沅 &#x1f468;‍&#x1f4bb; hallo 欢迎 点赞&#x1f44d; 收藏⭐ 留言&#x1f4dd; 加关注✅! &#x1f468;‍&#x1f4bb; 本文由 秩沅 原创 &#x1f468;‍&#x1f4bb; 收录于专栏&#xff1a;Uni…

c# .net8 香橙派orangepi + hc-04蓝牙 实例

这些使用c# .net8开发,硬件 香橙派 orangepi 3lts和 hc-04蓝牙 使用场景:可以通过这个功能,手机连接orangepi进行wifi等参数配置 硬件: 1、带USB口的linux开发板orangepi 2、USB 转TTL 中转接蓝牙(HC-04) 某宝上买的蓝牙官方网有调试工具:HC-T串口助手 https://www…

leetcode 3.反转链表;

1.题目&#xff1a; 给你单链表的头节点 head &#xff0c;请你反转链表&#xff0c;并返回反转后的链表。 2.用例&#xff1a; 3.题目解析&#xff1a; &#xff08;1&#xff09;函数头&#xff1a; 要求返回结点&#xff0c;就 ListNode* reverseList(ListNode* head)&…

【数据开发】大数据岗位,通用必备技术栈(数据分析、数据工程、数据科学)

【数据开发】大数据岗位&#xff0c;通用必备技术栈&#xff08;数据分析、数据工程、数据科学&#xff09; 文章目录 1、岗位与技术要求1.1 常见岗位介绍1.2 行业发展方向1.3 附部分JD 2、数据开发技术栈2.1 数据处理流程2.2 学习路线与框架 3、数据分析技术栈3.1 基础知识3.2…