The ally Defy is a fantastic bike. I owned one and like you, bit the bug a little. Ended up upgrading it for a very nice carbon bike…
To be honest, the Defy is such a good frame on its own that in retrospect, a good set of wheels would have transformed the ride more than the swap to a new frame. My Defy was about 9.5kg, my new bike is 8kg, but only about 250g of that is in the frame, the rest is in the wheels, group set and components.
Unless you’re really pushing out BIG wattage, I don’t think you would notice going from your (exceptionally good) ally Defy to a carbon one. I think new wheels and/or more miles in the saddle will make much more difference overall!
Don’t let me stop you upgrading though if you want to, the Carbon Defy is an exceptional bike also! Just that when some people bang on about carbon like its some wonder material and nothing else will do, generally they’ve never ridden a good ally, steel or Ti bike.