Once you can open the faucet with the handle, you'll know it's frozen. If there is ice inside the pipe and faucet, you'll first get a small trickle of water coming out, but the water coming through should break the ice loose and you'll get a normal stream of water coming out of the faucet.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.