All 20 infantry are on the board.
4 get killed in battle.
Can I now buy these infantry in subsequent rounds?
or are killed units gone for the remainder of the game?
Page 8 of the classic rules states: All units that are hit are then removed (i.e. returned to the supply available for purchase).