Depends on the situation
We have a great social group that goes out once a week with a massive range of abilities and the ride is geared to supporting the slower riders. So we like to see them within the pack and not dropped off the back or led into stuff blindly. We have sweepers to make sure everything is OK. Everyone takes their share of time at the back and the front and everyone always has a good time whatever their ‘natural’ speed.
If out on a ride to just have a blast on the descents, it can be a little aggravating when a rider climbs well, doesn’t ever stop at the top and descends terribly. It’s give and take on a social blast and it always seems a bit selfish to not even think about whether others would want to go faster down a descent, especially when you know the majority of the pack are far quicker downhill. There are hardly any of those folks about though, most people are more ‘nah you go, I’m not in a rush’
I pretty much always like to sit somewhere within the pack or at the back if I’m riding with the fast guys round here, and would definitely rather go a bit slower behind someone than be holding up good riders and getting in their way.