Can a water heater burst?

POP! The same goes for water heaters. If the pressure builds up in the tank, it will eventually filter out and explode. Also, if the TP valve will disable the leak (which eventually goes), then the pressure continues to build up in the tank, which will lead to an explosion or explosion.