let down your guard

to relax and trust people, even though this means that you might let yourself be upset or do the wrong thing. If someone does not do this, you can say that their guard is up

to stop being careful, for example in a game or when you are being attacked