Yes, I’ve been a couple of times and will probably go again this year.
Rode down to Fes on the motorbike last year, solo. Amazing place! The market (oldest continuing covered market in World or something) is a fab place to waste away at least a day. Easy to get lost but it doesn’t matter – just enjoy!
Outside of the main tourist hotspots, everywhere is cheap. You can stay in some beautiful places for silly money.
From Agadir, you might easily be able to get out to Taroudant – been there once before and intend to return on the motorbike this year. Should be easy from Agadir.
Rachel
edit – I meant, Taroudant not Tafraoute (though been there, too)