When metal rusts, you'll find loose iron oxide flakes on the surface. The first thing you need to do is remove these, and it's usually fairly easy. Start by brushing off the flakes with a wire brush.

If you don’t want to use chemicals and you also want to remove the paint along with the rust, use a power tool like a grinder ...