Surely your wife can look after the baby for one day on her own whilst you go out riding, then you do the same for her another weekend?
We do it all the time, eg I usually go to Le Mans for a week with mates – Mrs George does the kids, another time Mrs George goes away with some of her mates for a break eg Las Vegas, New York, Spain etc and I look after the kids.
Means we can go during School term and its much cheaper.
Then come school holidays and other weekends do family stuff together.
Cheers
PS If you’re going to bed (to sleep) an hour or two after your daughter, either shes going to bed too late or your going to bed too early IMO. :D