You don't have to turn off the water. This will help keep it from regenerating. The bypass valve will allow water into the house, but it won't go through the softener.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.