The Torrance house and store still stand today as reminders of this family's wealth and prominence. Hugh Torrance married a widow with eight children, and James Torrance (1784-1847) was the only child of that union. The family came to Mecklenburg County from Rowan County in 1788. Soon young James was sent to live with an uncle.

At age 21, James Torrance opened a store in North Mecklenburg. By 1824, he was running both a flour mill and a lumber mill as well. By 1830, Torrance owned a reported 3,000-5,000 acres of land and more than 100 slaves. He became extremely successful, selling cotton as far away as Charleston, South Carolina, and buying and selling land.

Torrance built the family plantation house, Cedar Grove, in 1831 for his third wife, Margaret Allison. His first wife was Nancy Davidson, his second was Mary Latta, daughter of fellow North Mecklenburg planter James Latta. Within a 25-year period during his three marriages, from 1811 to 1836, James Galbraith Torrance fathered 13 children.