In the event the inside part of a double pane window is cold, it a great indication of air leaking.
Perhaps your windows were not completely broken, but they are cracked or chipped. Have you noticed a considerable intensification for the noise level in rooms that have windows?