Carlton is a city located in Madison County, Georgia. Carlton has a 2026 population of 308. Carlton is currently growing at a rate of 8.07% annually and its population has increased by 18.92% since the most recent census, which recorded a population of 259 in 2020.