Assuming you get on OK with contacts (not everyone does) I don’t think there’s an argument really. I can’t be bothered to wear mine daily, but I hardly ride without them and when I do, I wish I wasn’t.
You’ll probably still want to wear some sort of eyewear, since getting crap in your eyes with contacts can be fairly unpleasant (as can having one shift at speed, gulp) but then that’s no hardship, most people seem to wear glasses for descending anyway.
Oh, loads of people say they don’t like contacts or couldn’t get them in, tbh I think a lot of people just give up before really giving it a try- I hated them the first couple of times but it was 100% worth persevering. It’s a strange and unnatural thing to do, so don’t be surprised if it feels that way at first.