If you don’t want to collapse two entire columns, just select the cells you want to collapse (rather than selecting the column letters).