You most likely already have a workable water filter built in if you have a refrigerator with a built-in water dispenser. You don't get cold water. The filters in the fridge generate ice cubes from the water.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.