You should remove the air conditioner from the window. During the winter months, heat can escape through the accordion extension panels on the A/C, while cold air can enter your home the same way.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.