I would say a resounding YES.
I assume you’re talking about jackdaws as crows don’t nest in eaves.
If they settle you will have a very disturbed summer. There could be as many as four young who will become extremely noisy during feeding. Plus you will have the clatter of the parents returning to the nest every few minutes with food. They could also have a second clutch later in the year so we’re talking months of screeching, scratching and shi… droppings.
They normally start from 04:30.
If you can intervene before the nest is built then I strongly advise you do.
Checkout the Wildlife and Countryside Act 1981 for legal info.
I speak from experience…