What did you ride before?
To mee it sounds as if your position on the bike is quite stretched out and you are lifting your head up, thus working the neck muscles.
Could try a shorter raised stem, move the saddle forward, or just see how it goes as your ride more and your neck gets stronger.