Beware the Streisand Effect.
Having said that, if another manager were directly making insinuations like that about a member of my team, without citing any actual examples of improper behaviour, I’d be wanting a quiet word, sans biscuits.
Reminds me of an instance in a previous workplace. Guy (married) and a girl (boyfriend) rumoured to be having an affair. They clearly had some degree of attachment (no idea how far it went, as it was none of my business), but, Christ, the sheer nastiness directed towards the girl from the other women in office – extending to her car and other property being vandalised – was staggering. Oddly, no such ire directed at him.