It's been a bad 24 hours for the precious metal, which shed $100 per ounce thanks to the Fed's outlook.