Think this might be recovering old ground, but…
As others have said, an M8000/M9000 11 speed XTR cassette is the same width as a 10 speed cassette and may need spacing if the freehub is designed to also accept the wider 11-speed road cassettes too. Daft question, and I’m sorry for asking, but is the freehub spacer correctly fitted on the inside of the cassette and not next to the lock ring? (sorry, but I had to ask!)
I’d fall back to basics and remove the cable and chain, and relax the low screw fully. Then see if you can physically push (with your hand) the mech past the large sprocket at the back. You might have to pull the tensioner down to get the top jockey wheel to clear the sprockets, but it should be able to move past the inside (largest sprocket) with ease and this will give an indication of whether the mech can mechanically reach.
Next would be to get a hanger alignment tool onto it to make sure the hanger is spot-on. They’re nearly always mis-aligned, even on brand new frames and bikes.
If the mech can’t reach but the hanger is aligned, it’s worth double-checking that your frame actually has the correct hanger on it. It might be nothing more complicated than the frame being fitted with the wrong hanger at the factory. You don’t mention what the frame is, but this would be my first port of call if the mech movement check fails and the hanger is aligned.
Sorry, lot of repeated stuff here, but there’s only so many things it could be. If you were closer to me here, I’d happily offer an evening with my finely crafted precision tools to give you another head to bash against it 🙂