A voltage drop can be caused by bad contact points. Remove the test light, set the multimeter to DC and touch the leads on the switch pins. The battery voltage should match the reading.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.