I don't think you will have to worry about damaging anything. The most you'll have a problem with is not engaging 4x4 all the way.

I'm not specificly telling you to turn them towards the front. If you turn the passanger side clockwise, which is towards the front, you'd want to turn the drivers side clockwise which is towards the back.

Make sure you turn them in the same direction.