Short answer
I wouldn’t go and would put pressure on my travel company to change the holiday. You’ve got to put the safety of the family first.
I’d give it until Monday to make your mind up, at least the extent of the damage will be known by then.
Long answer
It could have been a fore-shock, something bigger might be coming? If it was the main event, there might be aftershocks?
Ignoring that, the infrastructure will be somewhat damaged and it will take a few days for them to be able to assess the extent of the damage to the whole island. It’s a small island, if there is extensive damage they cannot magic up the materials and work force to fix everything in the next few days, or weeks.
Older buildings tend to get damaged in these events as they were not built to meet the latest building code standards. The fact that churches survive for hundreds of years is just that they are originally of more robust construction, there are rarely any old cheaper houses left as they perish over time.
More modern buildings should be built to code but it is unlikely given how most builders cut corners. If you have a hotel booked it is highly likely to be built to a higher seismic code standard.
Another thing to consider is that in the recent Italian earthquakes, high damage has occurred in areas where the geological maps indicated that the bedrock is very hard thus attenuates the energy. However the vernacular construction method used over many years is to build in areas of loose soils without deep foundations to the bedrock. This meant in the recent events like Amatrice, the damage was a lot more widespread than the models predicted. It means that buildings that should be safe aren’t as safe as they thought. This “theme” has been observed in all the recent Appennine quakes. This is common in Europe and could be an issue in Greece.
Having spouted all that, their economy is screwed and they do need the tourist €s. They’ve had such a bad run recently with austerity, refugee crisis and unemployment. This is exacerbated on the eastern islands. If you do go, they’d really appreciate it.
I’d give it until Monday to make your mind up, at least the extent of the damage will be known by then.