Personally, I’d have told then to get f*cked and carried on my merry way. They’re the group of users I find more ignorant than any others to be honest. If the bloody thing’s not able to be ridden without getting spooked, then they’re the ones that need to sort sh*t out, not you. A polite "bike behind you, passing on your left etc" should be all that’s necessary. If they ask you to wait, then that’s fair enough, but to think they’ve got some god given right to have everyone treat them with kid gloves is out of order IMO
And relax. I have my flame proof suit at the ready :-)