According to Joy Stafford, James and his wife died young and their children were taken to the Princess Alice Orphanage in Birmingham. One of the children, possibly called Thomas, was a baker who also married and had at least one child. I don't know the prior source of this information.

However, based on information received from Paul Griffiths, James married Maria Haywood, they both lived to a good age and they had five children. James was a Bricklayer.  Since this latter information seems consistent with other data the family memory  of the family memory looks wrong, though it could possibly relate to some other part of the family.