Is the calliper aligned properly over the disc (ie is it only rubbing one side?)
If rubbing both sides then yep gently lever the pads/pistons back into the calliper, if they are under too much pressure and pop out immeadiately you can release some brake fluid….
If you do let out some of the brake fluid, make sure you only open the calliper nipple at the same time as pressing the pads back or it may suck in some air. If the lever feels ‘spongy’ you may have let in air and could do with a bleed.
And dont get it on yer pads!