Most hardware stores sell caulk, weatherstripping or other sealants that can be placed along the edges of windows to keep the cold air from coming in. Installing plastic wrap or heavy duty curtains ...