Something my old man taught me, and still holds true today:
Does it move? NO Is it supposed to move? YES - WD40
Does it move? YES Is it supposed to move? NO - Duct Tape
Seriously, I used some WD40 on my driver's mirror and it's now quiet and smooth. Give it a shot.