Try a product called ZAP. It worked for me.

Barry Minchey wrote:

Removed a fire extinguisher bracket and will not install new one in
the same place. Nasty rust stain. Are there good solvents for this or
should I use a polishing compound?

Thanks!