Ciao Amore doesn’t look like much but is amazing, they do a lobster dish seasonally which is about the best I’ve ever had (and I love lobster…), Augustus does slightly up yourself cuisine but very well, there is a newish Indian called Guddi and Gikki which does the best Indian food I’ve ever had (but a very small menu), if you want something a bit different The Tropical Hut does traditional Filipino food including a cutlery free banquet served on banana leaves. On station road Anise serves Mediterranean food and the waiter is very fun – food is good too. Also forgot to mention Willow Tree (French), haven’t been for a while though.
Taunton has great food options for a medium sized town imho, and those are all independent businesses, there are obviously various soulless chains too…