You might find your brackets are zinc plated, you need to remove this with dilute hydrochoric acid, also known as killed spirits. Sold in builders merchants as cement cleaner. A 15 minute dunk in this will remove the zinc plating, then it WILL go rusty.
Of course, if it's not zinc plated this...