Your far from alone, I’m 33 and have Lost all the confidence I had wheni was much younger. The prospect of drop offs and jumps scares me off of trying anything I don’t know inside out.
I’m fine on trails, will drop down steep hill sides etc, but show me tree routes, rocks and drop offs and I bottle it almost every time.
If anyone knows cannock chase the is a small drop called Wearwolf falls or some thing like that , last time I went I finally had a go at it, my mate recorded it on his bike cam from the bottom. Replaying the footage it’s a doddle, a tiny little slope with a could of rocks. But from the top it looked so difficult. I was over the moon when I did it, but still not sure I’ll do it again