One thing that can hold joy back is a person's concentration on avoiding failure rather than their looking forward to doing something well.

We were fighting something that you can't hold back.

When you hold something back, your spouse tries to guess what it is.