You can use the 100 Amp panel off a 60 Amp breaker if you decide that it is adequate, but I would suggest that you size your wires to fit 100 Amp. Most of the work will be done on your feeders.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.