There are many characteristics of gpu utilization such as persent of spu's used, persent of memory bandwith used
How to define can I start another task now on the same dev, or that will be better to do it later, how to estimate what tasks would be better to start in the same time ? If I know what kernels will be used, and know their alu/tex ratio/