It's always a tricky one biking, walking, windsurfing, kayaking whatever.
Firstly you just need to accept that what you doing has a little extra risk factor, then hopefully live with it. As CG says above usually you are the going to be in charge of your own rescue which might involve a bit of gritting of teeth (though hopefully not 'touching the void'/'127 hours' levels of gritting of teeth!).
Then a little modifying of behaviour. As a young adult I got myself in all sorts of bother with a solo winter ice climbing/ walking day. I grew up quickly that day!
I think I'm prepared to push it a bit more when I know the likelihood of someone coming by is bigger at trail centres and the like than deep in the highlands where it might be days before someone bothers to travel the same route. The usual sensible precautions too - leave your route with friends/family, put your route & details on your dashboard if going there by car.
Curiously I think I'm probably more likely to hurt myself where riding with friends as they are more gnar than me so I'm more likely to try stuff I wouldn't otherwise (peer pressure as a 40 odd year old!) and push it to keep up when I'd otherwise back off.