Would depend on the riding for me. A daunder with a bike – fine, ragging it around a trail – no.
Sounds like the OP’s found some 35mm bars now anyway but fatty gets hammered and whilst not an enduro/downhill bike it is rigid so probably gets similar if not higher loads.
I did think about it for a while, and concluded that as there isn’t a consistent design of stem clamp that it really shouldn’t make a difference how the bar is eventually clamped. I was more worried about the stem as it’s never normally clamping onto nothing in the center as the shim is made up of 4x parts which have a lip on the outer edge to locate them at the outer edges on the stem.