The reason why balloons take off:

After the take-off the balloon rises until it reaches a certain height. Think about what a balloon pilot has to do to make the balloon rise even higher or let it sink?
Take a little time to think about it:

To rise even higher, the balloon pilot has to...

...drop some ballast

...heat the air in the balloon envelope

...do nothing at all because the balloon will rise by itself