... so 2 work items violate the limit and cause the column to be highlighted

Setting Constraints

You can set limits (constraints) for columns on this board by editing the board's configuration (select Board > Configure)