It was small fragments of wood and dust that blew into my eye.. Wasn’t using a power tool at the time.
In many factories, safety spectacles must be worn at all times in the workshop, not just by those operating tools (who might be required to wear goggles instead for added protection), or when tools are running. It sounds like the environment in your workshop may warrant a similar approach.
Sometimes the offending article is in the eye protection before put it on.
Eye protection and respiratory protection that are dusty and dirty, usually because they are hung up in a dusty and dirty environment, usually indicate that they are not being used. They should be kept clean, be stored in a clean place, and be on the moment you step into the workshop.