cancel
Showing results for 
Search instead for 
Did you mean: 

PC Drivers & Software

swjtu_mxb
Journeyman III

Problem when Deploying model on DPU(Ryzen 5 7640HS)

1、I'm sure the NPU driver and environment configuration is well because the GitHub tutorial example runs well.

swjtu_mxb_0-1712908979307.png

2、Quantization and deploy on CPU completely

I use the default quantize configuration for u-net model and deployed the u net quantized model on CPU completely, the result is correct.

swjtu_mxb_1-1712909433914.png

swjtu_mxb_2-1712909562923.png

3、Deploy on the DPU

3.1 The session configuration is as following, and it seems nothing wrong with it.

swjtu_mxb_3-1712909761126.png

 

3.2 The U-net model I use has some operators that is not supported by NPU.

swjtu_mxb_4-1712909846099.png

3.3 When I run the model on DPU, the operators that DPU doesn't support is assigned to CPU and the compiler warns that I should specify the shape and the data type of the output tensor of this operation by 

And the DPU warns DPU timeout: (Exception type: run: command error), Timeout layer name: [subgraph_/down1//maxpool_conv.0/MaxPool_output_0_DequantizeLinear_Output_vaip_71], Command failed to complete successfully (ERT_CMD_STATE_ERROR).

I guess that the operators DPU doesn't support is not defined in XIR and I should manually specify the shape and the data type. 

swjtu_mxb_5-1712910378612.png

4 Problems

So, is the operator DPU doesn't support cause the timeout?

Where should I write the command set data type to indicate the compiler.

 

Thanks for your help.

 

 

 

0 Likes
0 Replies