Feel free to start with different population sizes.

Catastrophes such as fire, flood, drought or epidemic may reduce population sizes to a small fraction of their average level.

As the American population has grown more diverse, sizes have become even less reliable.