Penalty is applied only to the neighboring columns of the picked/activated column, not all the preactive columns. Neighborhood for each column is defined beforehand. If a column has 8 neighbors, penalty is only applied to all of these, regardless of whether they are preactive or not.
The idea is that highest overlapping columns sequentially get activated one by one and each time one is activated, it has an inhibitory effect on its local neighbors.