Hole up in Dumfries, get a loop or two in at Ae, then you can get an early run at Kirry on saturday (or two, you'll like it), and then either Mabie or Dalbeattie on the way ACROSS to Peebles Hydro (cheap rooms for bikers) so you can do GT and/or inners on the sunday and drive home late.
I've done the very same on several occasions and there was fun for all the riders in our gang from pure DHers to XC whippets.
This is more than doable if you live anywhere north of Brum, IMHO.
I live in Loughborough and made it home in good time (IE not half past stupid).
Alternatively, just stay in Dumf. and do Ae lots…
Ae has some great XC, and some better (scary) DH. Kirroughtree is IMHO the best long XC trail centre there is, and GT has the most variety (XC, bike park, easy trails and plenty of air), while Inners has serious DH and an XC trail with a lot of climbing and a MENTAL final section.