Now that you've scotchbrited it, maybe try some Eagle One wadding polish? I have used it with success to minimize color differences on anodized aluminum, might help in your case too. Had a black Luxman cassette deck with some weird spotting on the face that wasn't dirt or water spots, wadding polish made it presentable again.