Once you completely clear the settlement of infestation, the Zerg won't be back.

Once that's clear, everyone will say yes.

And don't you dare fill the space in with any other extra routine or chore once you clear it.