cat1/cat2?? whats that?
seriously i just ride hard all the time, used to race mtb 15year ago.
you are genetically gifted. if you stopped "riding hard all the time" and trained properly with rest periods you could do what one of my clubmates did after returning to cycling after 15 years, he went from 4th cat (beginner) to elite in a year and a half of racing, and became a national champion TT'er for his age and road race champion for his age. embarrassed a few full time elites on the way.
you haven't reached your potential on a bike, to do so wouldn't mean a drastic change in your lifestyle/riding just smarter training.
failing that just continue enjoying upsetting the roadies