Check to see if this is happening while gaming, or if it's only happening when the computer is mostly idle. It could be Windows down-clocking the GPU when it's not needed to support activity.
As Albert Einstein said, "I could have done so much more with a Big Al's Computer!".