wouldn't worry about it man.
there is enough slop in the hitch tolerances that you have about 1/4" of play on all sides
I left mine in my F-150 for 3yrs without any issue. if you are really bothered, I suggest a liberal coating of heavy axle grease. it will repel water, and should stay where you put it