A little late, but I don't want anyone to spend as much time as I did trying to fix this, as I could not find an answer by searching these forums.
I had the same exact problem on my hackintosh - dual boot with Yosemite and Windows 8.1, with a slightly different buzzing sound in each OS - but not on my old PC laptop.
I was using a USB interface with audio output through a pair of KRK Rokits. I have no additional graphics card. PSU is in great shape. My case is metal and not cheap.
RF interference was definitely an issue - it was slightly better when I unplugged the wireless keyboard and bluetooth receivers. I tried putting them through an (unpowered) USB hub with no improvement. Put the USB hub through a 16 foot USB extension cord with the receivers on the other side of the room. Maybe some improvement, but not enough.
My next option was to buy ferrite chokers to hopefully block the RF, and then buy more parts in the hopes that they would help, or replace the ones I already had.
HOWEVER, I FOUND A SOLUTION BEFORE SPENDING ANY MORE MONEY
: DISCONNECT THE GROUND FROM THE AUDIO POWER SOURCE.
Here is the best link to where I learned this. The answer is NOT in the original post. However, multiple people in the comments went through hell trying to fix the same issue and eventually had success with this method. If you don't want to pull out the ground for good, buy a power adapter that lets you use just the other two prongs.
http://www.viper007bond.com/2010/02/23/high-pitched-noise-over-speakers-when-moving-mouse/
I hope this helps someone.
EDIT: I've learned this may be dangerous so consult an electrician before listening to me.