The BB mount would replace the equivalent amount of spacers on the drive side, not used in addition.
Without knowing your exact setup, if you have converted a triple crankset to single, the lugs the granny ring mounts on to can sometimes interfere with the bb mount in which case you may need an additional bb spacer to create clearance/file down granny ring mounts.
Maybe I am misunderstanding your trouble though.
Edit: nevermind, re- reading your OP I guess it’s swing arm clearance related. Different chain device? I use an inner+outer bash ring sandwich with clutch mech and it’s yet to jump. But I’m not doing DH type riding.