How to remove a burr from hub bearing seat

I’m working on changing the cartridge bearings in my rear hub. While tapping out one of the old bearings, the punch slipped and slightly damaged the bearing seat, creating a slightly raised area. I’m not sure how to go about trying to smooth this out. A file maybe? Or should I just not worry about it? Basically I’m worried it will make the new bearing go in crooked.

Silverline deburring tool

Sharp blade can remove raised dings in aluminium.

The bore or the seat? If its the bore in an alloy hub I use a disposable snap off knife and shave off the protrusion

Round the lip of the bore for the bearing? If so, oversize drill bit.

craft knife and / or a bit of sandpaper