I noticed more of a difference when I went to the gym more, i.e. if I’m 10% stronger then the bike felt 10% lighter, and a month at the gym cost considerably less than 3lb of weight loss off the bike!
I noticed the weight loss more going singlespeed, the loss of 3lb of gear associated gubbins made the bike feel marginaly quicker, but the loss of it at the rear axle made the most difference, the bike feels much more lively as the rear wheel skips accross stuff easier.
I think there’s more to it than saying; 220lb rider + 30lb bike, 1lb loss form bike is only 0.4% so 0.4% quicker, its a lb of very dead weight, whereas the 220lb of rider can be put to good use.
Maybe concentrate on loosing weight at the end of the Rugby season, just in time for the summers riding, then going all out to out on muscle in August/September?