I’ve been through this too, having broken my fair share f frames over the years, and more parts than I care to count, eventually you have the epiphany moment when you realize that the reason you bought it was to ride it, and by being all scaredy cat about it you’re not enjoying it.
At that point you either start buying cheaper or at least more sensibly priced bits or you carry on, but stop worrying. As long as you’re not stretching yourself to buy stuff you can’t afford then it’s a non-problem.
I am more grumpy when I break expensive kit, but I don’t let it influence my riding.
I am a bit more careful about buying mid range kit rather than top end where it’s likely to be regularly on the receiving end of bumps with the harder parts of nature (ie: mechs, rotors, rims etc).