^I always leave the levers on the bars when dropping the fork out. It’s fine as long as you take the front brake calliper of the fork lower first. Just let it hang over the front of the head tube.
My favourite annoying job is setting up brake pads on old fashioned cantis. You need five hands.