close ranks

to join with a group to support and protect yourselves against someone outside your group who is criticizing or attacking you

if soldiers close ranks, they stand nearer together in order to defend themselves better against an attack