There are some who think the mid valving is harsh on the charger 2.1. Shockcraft even offer an upgrade called “unharsh my ride”. It could also be that which the OP is feeling.
Checking bushings is pretty easy. Next time you’ve got the lowers off, remove the damper, air spring, garter springs from the seals and the foam rings. Try each leg one at a time to see if the CSU will drop smoothly under its own weight. If they both do, try them both at the same time with the wheel in place to check alignment.
If they don’t drop on their own, there’s an issue.
The kit to resize the bushings isn’t cheap but I’ve set myself up with 34 and 35mm kits. Maybe I should offer some sort of service but I’m not sure what it would be worth to people.