If it’s a smallish, well contained clump it can be got rid of fairly easily, you just have to do it right. We had a big old clump in the corner of our garden at our old place, growing under a wall and everything. I got rid of it in one year with no recurrence in the four years afterwards.
What you do is: wait until September (just after it has flowered, if I recall correctly) when it starts taking nutrients into its roots in preparation for winter. Then you hit it hard with the strongest glyphosate (Roundup) weedkiller you can get your hands on, every few days for two or three weeks. I used a couple of litres of the stuff in the end. Cover the leaves in it so the plant is dripping (Anything nearby is going to die, so shift anything you’re particularly attached to). The plant sucks down all the lovely juicy poison, and dies over winter. Then in spring you cut down the dead stalks and burn ’em – job done.
Do not: strim, flail or otherwise cut and spread the stuff, it can grow back from a fleck of stem less than a couple of mm long. This is how it spreads. All the Japanese Knotweed in the UK is a clone of a single plant, spread by people chopping it down and dumping it.