I do spin out on the roads but not often off road.
IME it's actually pretty difficult to spin out
32x11 offroad on the flat*, but what you do
miss out on is, when travelling pretty quickly, just putting in a couple of, stood up, low cadence pedal revs for a bit more speed in between rocky sections or corners (takes a while to spin up to >80rpm or whatever)
36 is the biggest I run at the moment not sure I need/want the extra speed of a 38, another reason is not having a 1:1 gear on the big ring means shifting to the smaller chainring a lot more often IME.
but everyone's different.
*100rpm is 23mph, 120=27 pretty quick for flat xc, for none racers anyway.