This phrase relates to the use of observation balloons in the first World War. The sight of such a balloon going up nearly always resulted in a barrage of shells following soon after. The expression was re-inforced during WWII when the hoisting of barrage balloons was part of the preparations for an air raid.