Swisher County's estimated 2025 population is 6,947 with a growth rate of -0.06% in the past year according to the most recent United States census data. Swisher County is the 185th largest county in Texas. The 2010 population was 7,919 and has seen a growth of -12.27% since that time.