Fortunately, if you pull blocks from your own tower you can close the final gap. Just be careful not to pull anything too important...