Clayton is a city located in Rabun County, Georgia. Clayton has a 2026 population of 2,090. It is also the county seat of Rabun County. Clayton is currently growing at a rate of 1.36% annually and its population has increased by 5.03% since the most recent census, which recorded a population of 1,990 in 2020.