It's a bedroom if the bed is in it. For resale purposes, with a spare room downstairs, it would likely be described as a 3-bed house with an extra reception room/study, rather than a 4-bed house, and the value adjusted accordingly.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.