the whole concrete ball at the end come out the ground too?
That’s exactly what happened
Four posts out of the ground complete with lumps of concrete round them.
So I think there are three ways of fixing it.
1. Remove fence post from the fence panels. Buy longer ones, dig a deeper hole. Concrete the new posts in.
2. Remove concrete from the base of existing posts (no idea ho much of a ball ache this will be) Attach to repair spur and re-concrete the existing holes.
3. Cut the fence posts off and dig new holes for new fence posts (but if I’m doing this I might as well just go with option 1 (digging holes is hard work!)