DannaArnett on Family Tree Circles

My 3rd g.grandfather was James Arnet, b.in Duplin Co., NC abt 1790. The family story (verified to my dad by Alec Arnett-historian from U of NC, was that he was carried by his mother & a neighbor from NC as they left for AR, because he was too small to ride in the covered wagon. Cold weather set in when they reached Muhlenberg Co., KY & they stayed there. The only other Arnet found in Muhlenberg Co. during that period was Elizabeth Arnet Garris, wife of Sikes Garris. They had children a little younger than him. The first record of him in Muhlenberg Co., was in 1815 when he married Elizabeth Wilkins, also b. in Duplin Co.,NC (as was Elizabeth Arnet Garris). I feel there must be a connection between James & Elizabeth (older sister, aunt?) It is thought that her father was Philemon Arnet & her brother, Perrygreene. I have found a Deborah Arnet on the census in Duplin Co in 1810, along w/3 sons bet.18-26, & an apparent son, John & family, next door. In 1820, there is a William w/a family. No later record on Deborah, John or William. Possibly James was 1 of the 18-26 yr olds, but that wouldn't fit w/the story of him being carried to KY, unless, for some reason, his parents went back to NC, & he returned to find Elizabeth after his mother passed away. Maybe he father died in KY & she went back? Anyone have anything on any of these people that might give us a hint?