chilled76, if you have the time and put the effort in, there is no reason you couldn’t be at or very close too, where you want be by the end of the year.
I went from just winning (a long time ago) the Scottish 3/4 development RR series, to mixing with and beating elites on the road the next season.
I went from around 68/69kg (10% body fat) to 64/65kg @ 5’8″
I was doing around 15-25hrs on the bike with 2-3 gym sessions a week.
One thing I would recommend is, use a heavy mtb (buy a fat bike, thats what I use now) with fat draggy/flat tires for your commute and possibly some training sessions on the road, just that extra bit of resistance really helps build the strength.
Remember, its about quality, not quantity when it comes to workouts.