How tall are you?
I’m 5ft 10.5 (the half is important! 😉 ) and run a 17.5″ frame, with a 90mm stem. I tried a 70mm stem on it, but oddly enough I found it really slowed the steering down on mine for some reason! Contrary to what you would expect. Maybe it pushed my weight further back, and I ended up “steering” the bike rather than just leaning it into corners perhaps.
Anyway… What length have you got on there now? I’d suggest maybe try 10mm shorter first, without going too drastic. Lopping any more off is quite drastic, and would suggest you’re on too big a frame probably.