Sure, it should be easy to find at any auto parts or hardware store...it's quite common and otherwise useful around the house.

In addition to the window weatherstripping, a bit on the door weatherstripping can help if your doors tend to stick shut when icy. For the door weatherstrip, I'll just spray some on a rag and do a wipe around the perimeter.

Another great use is to spray your snow shovel and the chute of your snowblower with it--that sticky wet snow won't stick as badly.

George