this should help explain it..
http://blog.artscyclery.com/science-behind-the-magic/science-behind-the-magic-drivetrain-compatibility/
the bit most people don’t seem to get is the rear mech ratio..
which is different between 6-7-8-9 speed shimano mountain and 10 speed shimano mountain..
(though the ratio is the same with 9 speed mountain and 10 speed road which is why mtb mechs are often used on 10 speed touring / road bikes)
with 6-7-8-9 speed, 1mm of cable pull moves the top jockey wheel across between cogs the same amount..
but with 10 speed they changed the leverage of the mech.. so 1mm of cable pull moves the mech a different amount to 6-7-8-9
the shifter doesn’t effect the above ratio.
explained better in the article though..