Another reason not to invite the SMUs and Houstons of the world is that the conference would potentially mess up the scheduling of the most important rivalry the conference currently has, The Red River Shoot Out.
FORBES: Big 12 Expansion: Adding Old SWC Teams Would Harm Future Viability