The box does wear over time - especially if you do a lot of stop-and-go and turning.

How many miles do you have now?

The problem with adjusting it too much as it wears is, most of the wear is at the center of the steering box movement. When you tighten it up to stop wandering, when you do have to turn the wheel to the end, it will bind up at the ends. Which is bad.