The short answer is that in the absence of clear context about what they are evaluating, most people don't know how to objectively evaluate visual design, so they rely instead on subjective intuition.

There is no manual for how to best do this, and intuition can only get you so far in the absence of experience and mentoring.