Well first your Mini-Fridge PC wouldn't be able to maintain any type of cool temperature since the computer components will be expelling hot air inside the Mini-fridge. Also if you have the exhaust air going outside the Mini-Fridge the same thing occurs in that all the cold air inside the Fridge will also be expelled. Defeating the purpose of a Refrigerator.
So yes it is a bad idea, in my opinion.