Has anybody every replaced pivot ball bearings with roller bearings?

I'm thinking of trying this as the bearings should transmit the forces a lot less stressfully, however, roller bearings don't like any side load.
So does my Orange 5 pivot take much side load and should I stick with ball bearings?

