Starving yourself leads to your body burning muscle as fuel, leading to a reduction in your metabolism.

Once you start eating normally again, your body goes into damage control and holds onto as much of that food as it can i.e. fat. Because of your depleted metabolism, you put the weight back on, and its harder to lose than before