Some people are just looking for stuff to offend them.
When the phrases babe, hen, love, mate, fella, me duck, guvnor, sweetheart, darling etc are used by a cabbie/bus driver/person behind a counter in a shop/whomever, it’s generally an indication that they are not a po-faced, miserable git.
Anyone who finds those terms offensive when used in that manner, generally, is.