11 Replies Latest reply on Sep 13, 2017 9:05 AM by ugis.ozolins@mcdean.com

    mxGPU with s7150  failed on Supermicro H8QG6-F

    vyezh

      Anybody may help, please?

       

      my setup is

      firepro s7150

      vmware esxi 6.0u2

      Supermicro H8QG6-F

      AMD IOMMU , SRIOV, ARI forwardign are enabled.

      i couldnot find BIOS options like Above 4G Decoding or MMIO High size

       

       

       

      GPU fails to run in mxGPU mode

       

      [root@drvh1:/vmfs/volumes/5565d8cd-981ed897-09bf-001b21d59a3c/amdmx] sh mxgpu-install.sh -c

      Detected 1 SR-IOV GPU

      0000:07:00.0 VGA compatible controller Display controller: AMD Tonga S7150 [vmgfx0]

      Start configuration....

      Enter the configuration mode([A]uto/[H]ybrid/[M]anual,default:A)H

      Configuring the GPU 1 ...

      0000:07:00.0 Display controller: AMD Tonga S7150 [vmgfx0]

      Please enter number of VFs:(default:4):

      adapter1_conf=7,0,0,4,1920,5000,1

      Setting up SR-IOV settings...

      Done

      pciHole.start = 2048

      pciHole.end = 4096

      Eligible VMs:

      TTN-DevP-04

      TTN-DevP-05

      TTN-4MP-02

      TTN-4MP-01

      PCI Hole settings already exist on all eligible VMs.

      The configuration needs a reboot to take effect

       

       

      To automatically assign VFs, please run "sh mxgpu-install.sh -a" after system reboot

      [root@drvh1:/vmfs/volumes/5565d8cd-981ed897-09bf-001b21d59a3c/amdmx]

       

      After restart  gpu is detected as the one pci-e card available fro passthrough

       

       

      [root@drvh1:~] cat /var/log/vmkernel.log | grep amdgpuv

      VMB: 211:    name: /amdgpuv.v00

      2017-02-19T00:30:46.589Z cpu0:32768)VisorFSTar: 1836: amdgpuv.v00 for 0x68430 bytes

      2017-02-19T00:30:50.089Z cpu53:33502)Loading module amdgpuv ...

      2017-02-19T00:30:50.101Z cpu53:33502)Elf: 1865: module amdgpuv has license VMware

      2017-02-19T00:30:50.108Z cpu53:33502)Device: 191: Registered driver 'amdgpuv' from 21

      2017-02-19T00:30:50.108Z cpu53:33502)amdgpuv_log: amdgpuv_device_list_init:41: [amdgpuv]: amdgpuv device list initialized successfully

      2017-02-19T00:30:50.108Z cpu53:33502)amdgpuv_log: init_module:436: [amdgpuv]: amdgpuv module loaded successfully

      2017-02-19T00:30:50.108Z cpu53:33502)amdgpuv_log: init_module:438: [amdgpuv]: AMD SRIOV GPU-V Device Driver 0.9.1 BUILD: May 15 2016

      2017-02-19T00:30:50.108Z cpu53:33502)Mod: 4943: Initialization of amdgpuv succeeded with module ID 21.

      2017-02-19T00:30:50.108Z cpu53:33502)amdgpuv loaded successfully.

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410026e80000

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410027000000

      2017-02-19T00:30:50.120Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:30:50.124Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x438086c00000

      2017-02-19T00:30:50.124Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:30:50.124Z cpu25:33501)IntrCookie: 1915: cookie 0xf moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:30:50.124Z cpu25:33501)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:30:50.124Z cpu25:33501)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:30:50.124Z cpu25:33501)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:30:50.260Z cpu25:33501)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:30:50.260Z cpu25:33501)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:30:50.260Z cpu25:33501)amdgpuv_log: ATOM_PostVBIOS:189: [amdgpuv]: VBIOS post: init ASIC

      2017-02-19T00:30:50.584Z cpu25:33501)amdgpuv_log: ATOM_PostVBIOS:187: [amdgpuv]: VBIOS post: load FW

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:30:53.319Z cpu25:33501)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:30:53.319Z cpu25:33501)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:30:53.821Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:30:53.821Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:30:53.821Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:30:53.871Z cpu25:33501)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410029180000

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410029400000

      2017-02-19T00:30:57.574Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:30:57.578Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x438096e00000

      2017-02-19T00:30:57.578Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:30:57.578Z cpu21:33512)IntrCookie: 1915: cookie 0x22 moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:30:57.578Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:30:57.578Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:30:57.578Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:375: [amdgpuv]: VBIOS post: ASIC has been initialized

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:384: [amdgpuv]: VBIOS post: Firmware has been loaded

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:30:57.833Z cpu21:33512)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:30:57.836Z cpu21:33512)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:30:57.836Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:30:57.837Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:30:57.837Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:30:57.837Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:30:57.881Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410029400000

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410029800000

      2017-02-19T00:31:03.843Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:31:03.846Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x4380a7000000

      2017-02-19T00:31:03.846Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:31:03.846Z cpu21:33512)IntrCookie: 1915: cookie 0x3d moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:31:03.846Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:31:03.846Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:31:03.846Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:375: [amdgpuv]: VBIOS post: ASIC has been initialized

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:384: [amdgpuv]: VBIOS post: Firmware has been loaded

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:31:04.022Z cpu21:33512)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:31:04.022Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:31:04.511Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:04.511Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:31:04.511Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:04.551Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410029400000

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410029800000

      2017-02-19T00:31:04.554Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:31:04.557Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x4380b7200000

      2017-02-19T00:31:04.557Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:31:04.557Z cpu21:33512)IntrCookie: 1915: cookie 0x3e moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:31:04.557Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:31:04.557Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:31:04.557Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:375: [amdgpuv]: VBIOS post: ASIC has been initialized

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:384: [amdgpuv]: VBIOS post: Firmware has been loaded

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:31:04.733Z cpu21:33512)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:31:04.733Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:31:05.201Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:05.201Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:31:05.201Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:05.251Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410029400000

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410029800000

      2017-02-19T00:31:05.254Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:31:05.257Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x4380c7400000

      2017-02-19T00:31:05.257Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:31:05.257Z cpu21:33512)IntrCookie: 1915: cookie 0x3f moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:31:05.257Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:31:05.257Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:31:05.257Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:375: [amdgpuv]: VBIOS post: ASIC has been initialized

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:384: [amdgpuv]: VBIOS post: Firmware has been loaded

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:31:05.433Z cpu21:33512)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:31:05.433Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:31:05.891Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:05.891Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:31:05.891Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:05.951Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:661: [amdgpuv]: amdgpuv_attachDevice: attachDevice...

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:668: [amdgpuv]: attacheDevice of amdgpuv driver invoked, moduleID = 21, heapID = 0x43066fcd5000

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:679: [amdgpuv]: vmkDev = 0x41ac430442654e1c

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:685: [amdgpuv]: get pf pci device handle successfully

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_pci_match_device:64: [amdgpuv]: found the supported asic, deviceID = 0x6929

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:181: [amdgpuv]: map mmio reg successfully, pDev->pIOReg = 0x410029400000

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:182: [amdgpuv]: pDev->regAperSize = 0x40000

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:194: [amdgpuv]: map doorbell successfully, pDev->pDoorbell = 0x410029800000

      2017-02-19T00:31:20.399Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:195: [amdgpuv]: pDev->doorbellAperSize = 0x200000

      2017-02-19T00:31:20.402Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:206: [amdgpuv]: map FB successfully, pDev->pFramebuffer = 0x4380d7600000

      2017-02-19T00:31:20.402Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:207: [amdgpuv]: pDev->fbAperSize = 0x10000000

      2017-02-19T00:31:20.402Z cpu21:33512)IntrCookie: 1915: cookie 0x41 moduleID 21 <amdgpuv> exclusive, flags 0x1d

      2017-02-19T00:31:20.403Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Init:63: [amdgpuv]: kcl ih ctx initialized successfully

      2017-02-19T00:31:20.403Z cpu21:33512)amdgpuv_log: amdgpuv_attachDevice:719: [amdgpuv]: register interrupt successfully

      2017-02-19T00:31:20.403Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:309: [amdgpuv]: VBIOS starts:  0x55, 0xaa

      2017-02-19T00:31:20.578Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:333: [amdgpuv]: BIOS Version Major 0xf Minor 0x31

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_read_VBIOS:343: [amdgpuv]: Valid video BIOS image, size = 0x10000, check sum is 0x553a00

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:375: [amdgpuv]: VBIOS post: ASIC has been initialized

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:384: [amdgpuv]: VBIOS post: Firmware has been loaded

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_post_VBIOS:387: [amdgpuv]: Post VBIOS successfully!

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x100

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: KCL_PCI_Find_Ext_Capability:324: [amdgpuv]: found the Capability 0xb @pos 0x400

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:64: [amdgpuv]: gpuiov->pos = 0x400

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:80: [amdgpuv]: Total FB size @pos = 0x424 is 8190 MB

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_pci_gpuiov_init:82: [amdgpuv]: initialize gpu iov capability successfully

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: get_fb_partition:120: [amdgpuv]: maximal framebuffer size: 8176 MB

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: get_fb_partition:124: [amdgpuv]: minimal pf framebuffer size: 256 MB

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: get_fb_partition:129: [amdgpuv]: pf framebuffer size: 256 MB

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: get_fb_partition:133: [amdgpuv]: total available framebuffer size for VFs: 7904 MB

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: get_vf_mem_ap_size:152: [amdgpuv]: the STRAP_BIF_VF_MEM_AP_SIZE limits the VF FB to 128 MB

      2017-02-19T00:31:20.579Z cpu21:33512)WARNING: amdgpuv_log: amdgpuv_enableVFs:128: [amdgpuv]:Failure fail to enable VFs

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: KCL_Ih_Ctx_Deinit:80: [amdgpuv]: destroy the kcl_ih_ctx spinlock

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:134: [amdgpuv]: reg_idx=5, doorbell_idx=2

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:146: [amdgpuv]: unmap mmio register successfully

      2017-02-19T00:31:20.579Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:158: [amdgpuv]: unmap doorbell successfully

      2017-02-19T00:31:20.631Z cpu21:33512)amdgpuv_log: amdgpuv_manage_pci_resource:169: [amdgpuv]: unmap doorbell successfully