Ron,
My father in law does that, it gets in the way (visibility) while driving. When he pulls into the lot he hangs the tag on the mirror. I've seen others (locally) that do the same thing and yes, when the finally get out of the car, you can see that they're handicapped.

I do agree that there are also a lot that look like they don't need one and are just borrowing one.