We went in April 2018 and stayed in Lower Manhattan for a quieter location, right on Battery Park and it was quiet.
Everything was as we expected. The only things that really impressed me were the glacial bedrock in Central Park, Ground Zero, an Italian restaurant chain called Eataly and the Rockefeller building.
I certainly would not risk going there next year.
Oh and Immigration was scary because I had Sudan stamps in my passport, so couldn’t get visa waiver and failed the fingerprint test, spending 20 minutes in a rather tense area of the airport.