Hi,

In my current kernel I use floating point values, but I think I got precision problems...

by example, I use an 'epsilon' defined as

#define EPSILON 1e-4 and play with values like 500.f etc....

I'm not sure how I can improve this ? Do you have any council ? ideas ?

hi viewon01,

I would myself be interested to find some new ideas here. Anyhow some thought which I would like to share are:

Try using some iterations of numerical methods( like Newton raphson to improve accuracy)

Try to avoid division operation, it has the least precision among other operations.

You can also think of resorting to double if possible in your case.