I finally decided to replace the PSU of my 2 desktops with Cool Master Silent Pro M500 PSU.
The name says it, ultra silent. And also the efficiency is printed as > 85%. This is probably the only PSU with such a high efficiency. So I do not have to worry about turning on the PCs over night. However, they are pricey. SGD 159 a piece.