You can put foam insulation boards on the walls where you rent to insulate them from the cold outside. If you want to remove them whenever you want, tack them to your walls at four corners.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.