I think its because the geometry does not intersect as much. In other words instead of having your pillar go through the floor and ceiling a little, and letting A4 clip off the invisible part, thus increasing build as it calculates what can be cut off, and what not. So if you let the pillar Meet exactly at the floor anc ceiling, it will compile faster.
Hope this helped.