Cynic-al, the Horst links in the chain stay are (sometimes?) below the line of the axles which if you set your mech up with the recommended amount of b limit adjustment means that the frame / link is either in the way or very close to being in the way of the mech when it’s in the smallest cogs. Which means that pulling the mech back to take the wheel out doesn’t leave you much room at all.
Like I said the only ways around are running loads of b limit adjustment, which I wouldn’t recommend on a SRAM mechs as their b limit design is bloody awful, or to use a Saint mech as you can apparently adjust them to run slightly further back than normal. I personally went for a slx mech with the b limit adjusted all the way out and it’s been fine.