To be fair,
The OP is right in some respect. The way that composites break is from the back face.
ie, if you took a plate and smacked it with a hammer, you would see all the damage on the side opposite to the hammer strike. The damage would be almost unnoticeable from the stricken side, unless the gel coat (the superficial vanity layer) cracked.
However the amount of energy (size of the impact) to cause this type of laminate failure is possibly (depends on layup etc) going to be far more than that required to produce a superficial dent in the aluminium. The difference is, metal structures deform prior to failure, composites don’t. They just break.
Because they are in layers, unless all the layers break giving you an obvious crack then the failed layers may go completely unnoticed until final failure.
I hope that makes sense, I tried to keep it concise!