If you are running a double chainring set up, the chain should run over the higher part of the roller to take up excess chain slack when in the small chairing, and the chain should drop to the grooved or lower part of the roller when in the middle ring. If you are in the small ring and the chain is in the grooved section, then your stinger is located too far inboard. When in the smallest chainring, check to see if you are in the smaller sprockets at the rear, as this can cause the chain to grate on the shifting ramps and pick up pins, because the chain is running at an angle over them. A little play in the roller is normal, and shouldn’t cause any problems.
I had this bother using blackspire chainrings.