The elders, the deacons, the motherly dames, and the young and fair maidens, of Mr. Dimmesdale's flock, were alike importunate that he should make trial of the physician's frankly offered skill.

Boxing is a trial of strength and skill. Whether he's tall or not is not important.