For a given braking force on the ground, the overall torque on the fork leg generated by the braking system will be the same whatever the rotor size. But that torque will be generated by a different balance of forces on the two brake mounts and the axle/dropout interface. Smaller rotors place more force at the axle/dropout, larger rotors will exert more of the leverage via the two caliper mounting points, with less force at the dropout.
In the real world, I can definitely brake harder, more often, with larger rotors. So that is going to place more stress on the fork bushings per ride (if I am in a gung-ho mood). The concern of the manufacturers may be about acceptable wear life not safety.