This is one of those questions where almost no one is qualified to answer the question for you, even those of us that have kids.
So I will help you reach an answer by asking you a question in return (and this is not meant as emotional blackmail or a judgement, just a reality check for you):
You're away having a great time when you get a call from your inlaws/parents saying that something really terrible has happened and while your daughter is OK, she is in hospital and really needs you. But you're not there and then you find you can't get back until the end of the week.
If you're OK with how you might feel in that situation, and your inlaws are also OK with it (and in practical terms, that's a big ask for them, especially if they're older) then go and have fun.
OK that's probably a bit harsh and like I said not meant as emotional blackmail (I don't think you'd be a bad person if you went, just very human), but it's a test of how you really feel about leaving her.
I'm not going away for a week. I'm only at work every day but thats made me feel guilty about leaving my 5 month old daughter.