Thanks!
I have tried to connect the PSU directly to the wall outlet without the case. I even checked the voltage on both ends of the power cords, and everything seemed normal.
Just to clarify/details;
The buzz sound comes from the motherboard as soon as I turn on the PSU, but barely audible...