The size of the pot will make a difference.
I’ve got a three foot ash in quite a small pot. It must be about 10 years old now and seems quite healthy, but the pot restricts it growth.
I’ve got olive and cherry in larger tubs (half barrels) and they seem OK.
I reckon Yew might be your best bet for an evergreen, although it is very slow growing. I had one in a tub and it did very well, until it got killed by ants.
Keep any eye out for these, they seem to like making nests in pots and move all the soil away from the roots!