If it is a one pipe or two pipe system, you need to find the pipe that the radiator is fed from. If it's a 2 pipe system, you should cap the pipe as close to the main feed pipes as possible, even if you are removing it permanently.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.