Sometimes in this situation, if the road is otherwise clear, the driver will pull out just before/as you’re passing the junction but give you enough space. I can’t decide whether this is a bad thing or not.
If they didn’t pull out, they’d likely pull out behind you then almost immediately overtake, so if there’s nothing coming the other way, what’s the point in waiting rather than pulling out onto the RHS of the road – i.e. immediately going into an overtaking manoeuvre. Sometimes this annoys me sometimes it doesn’t.
The twonk yesterday who, in broad daylight, in a 20 zone, with me in the middle of the road with my right arm fully out to indicate I was turning right, overtook me on my right. No ambivalence there.