Reference counters counts not only your references, but also created internally by OpenCL implementation. References can be used to catch memory leaks or debugging. The OpenCL specification says that references cannot be used in general purposes in an applications.