One of the most dangerous and time consuming aspects of roadworks is the setting up of traffic management. Yes there will be times when there is no one working in the carriageway but, as has been said, cones flying around at 70mph isn’t fun. For major works, motorways and dual carriageways will have to be closed to set up.
So yeah, that’s why you’re doing 50mph.