Have a look on the Wiggle website.
DHB stuff is pretty good and they’ve got several jerseys for under £50.
DHB Long sleeve core jersey – £26.39
DHB Core S jersey – £32.99
Northwave Force jersey – £35.99
Altura Night Vision jersey – £44.99
I was going to suggest the Endura MT500 long sleeve, but it’s £60 so a bit over your budget.
It’s also possibly a bit too toasty to be wearing with something over the top.
Have you looked on the On One website as well? They often have good deals on jerseys.
EDIT – gloves. I use Sealskinz gloves in really cold weather, but they get quite sweaty & you lose quite a lot of feel, as they are so thick.
I think Endura do some nice winter gloves – Endura Strike or Dexter look pretty good. A friend of mine has the Strike I think & rates them highly.
I have got some old Gill gloves that are a bit thicker than normal gloves & keep the chill out down to a few deg. C.