If you want to discard the old filter, pull it out. The arrow indicates the proper air flow direction on the new filter. The arrow has to face toward the furnace and away from the return duct. Is that correct? The furnace should always be pointed toward the arrow on the filter.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.