I think you are right. I, for one, am not "race fit" having done bugger all riding for the last couple of months but I am also very happy to tag along at the group's speed until I get dropped and then find my own way home (the joys of gps). However, I am also happy to join a slower group.
I would be keen on learning some local trails though as I am newish to the area.