Ton,
Balance is key and its not really fat per se you should be bothering about. Sugar is the key thing to avoid. That is what will make you put weight on and also will make you crave the stuff when you’ve been working hard. Its hidden in all sorts of places so arm yourself with some knowledge!
Without getting too heavy, keep your plate 25% protein, 50% good carbs (ie not potatoes!), 25% greens……avoid dairy, coffee, breads (even wholegrain – bread aint great and neither is teh gluten!). Eat clean as if your toxic load is too high that can prevent you from shedding weight too, Drink plenty of water, substitue that coffee in the morning for a warm water and lemon. Steer clear of that post ride cake too, that will go staright around the middle!
You’ll feel better and combined with regular exercise you’ll see a steady drop.