In the sort of dialect Charlie Daniels had, “went down to” means “went south to”, meaning that Hell is north of Georgia. It’s in Michigan, in fact — and based on my experiences there, it might just be Michigan.