Conner Family in Georgia

I'm searching for information on a James Conner born abt. 1803 and lived in old Milton County Georgia for quite a few years. He may be Cherokee Indian or part Cherokee. My grandmother Anna Eva Conner Downs always told us she was part Cherokee. We have not found a connection yet, but think it may lie with James Conner as we have come to a hault with info on him. The area where he lived had lots of Indians at the time he would have been young and some still when he was raising his family. Would appreciate any help anyone can pass on. Thanks, S.Downs Hayes