What timespan are you planning? One of the more direct routes passes through The Green Desert. There are a few bothies there. Head for Moel Prysgau, Nant Syddion or perhaps? Nant Rhys bothy to help focus your route if you are going for a multi-day ride. The middle of Wales tends to be wet and tussucky off the main trails.
FWIW, if you can find the tracks left by the ‘mental horsey women’ I’d rely on them. They will be local, so will know the best way to go. Having said that, in 30 years of riding here I hven’t once met any nutters, either on a horse or off one.