If the red button is all the way in, there is no power to the GFCI or the outlets connected to it, so push the black test button. The red button should come out. The GFCI is likely to be faulty if it doesn't happen.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.