The noise would only bother you if you knew there was a problem there, or didn't know what it was.

The fact that its normal when running a light flywheel, you tend not to worry about it after a while