Had a similar thing today. Little used footpath that ends in a gravel road in front of several houses. Woman reversing her car down the road went absolutely mental. “****** private road ***** no cycling ***** blah blah blah.” Now, technically, I’m sure she’s well within her rights to tell us we’re not allowed there but I’m just baffled by the attitude of people who’d rather have a row than a) just see sense or b) ask us politely not to use the path again. I simply asked her what harm we were doing and then calmly pointed out that she wasn’t doing her blood pressure any good by working herself up over it.
Bottom line: if someone can show me that I’m doing harm (and that includes environmental, financial, inconvenience, invading privacy, etc) by riding somewhere then I’ll take notice. If not, I’ll ride pretty much where I like thanks very much.