You don't need to worry about health. It's most likely that yours is rated for potable water by the National Sanitation Foundation. PVC is not approved for use in houses for water. There are many websites that state that it is safe.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.