If its crumbly, its because its damp and can’t breathe
This would be my answer too, a good example is the end of my building, roof was off and the walls were in a bad way, white salt staining and black fungus stains, dark and light bits where the moisture had got in and it was crumbling in places, repointed with lime mortar and you could see it dry out in days, it’s a couple of years now and the walls are completely uniform and as good as the day they were built, they get wet on the outside and dry naturally, all working as it should and did since 1882.
Planning dept forced me to tank 5′ up the walls of one part with a mix of SBR and tanking slurry, those walls are now retaining damp, started within days, I now have to dig a french drain on the outside to compensate and try to fix the damage done, the tanking slurry stops the moisture evaporating naturally and it builds up behind it as a wet patch, this goes soft and crumbles over time then the coating and rotted bit behind it falls off in a big flat layer.
Some walls were white washed with lime at some point in the past, those are fine.
I have another bit outside in a corner protected from rain, this was eroded away, big pile of dust below, although dry and well ventilated on the crumbly side this was drawing damp from the other side, a farmer had piled up earth on the other side of the wall and the sandstone was absorbing it, it crumbled on the ventilated side, hence why walls go crumbly on the often dry inside.