Unless this is the effect you want, you'll either have to modify your composition, shoot it later in the day, or plan to return on an overcast day when both sides will be photographable.