When we had gas bottles like these there was a hinged galvanized lid/cover over the tops of the bottles and regulator, this was to help stop things freezing.
I think the flow of the gas within the pipes helps causing them to freeze, we ended up lagging the pipe as well and that seemed to cure it.