Perfectly normal, especially if it's that cold.

I got mine new and was initially worried about it, but then it donned on me that it wasn't a gas engine and probably needed time to warm up.

Plug it in at night and use 2 bottles of Prolong oil additive in your motor oil (Autozone) and it'll make a difference with the cold starts and cold weather performance. Worked well for mine...