I was having a similar issue with the passenger side mirror not always going back to where it was set. I ended up bringing it in and had Ford replace the mirror motor and it's been fine since. Tech said the "motor pack" is a common issue.
If yours is still under warranty it's worth a shot.
Matt