If you think you would be more comfortable wearing them, then do it.
I wear 661 D30 evo thingies. they are expensive, but well worth the money. I was out for 5 hours today, in the sun, and forgot i was wearing them till i fell off.
They Are well worth the money in my opinion, for xc use.
oh, and as for not being ‘hardcore ebouhg, Ive hurt myself seriously on the road, doing an xc race, etc. And yet, after years of dh’ing, and allways wearing full body armour, ive only had minor cuts, and serious bruises.