You have to remember that roadways are crowned so your tires wear differently. So if you rotate them from one side to the other you will notice a pull because the tread is worn differently than the other side. You should just cross the front tires and see if the pull goes away, if it does then it is your tires.
Mark