He was born at Windham Manor in Norfolk the son of Francis Southwell an auditor of the exchequer and Dorothy ne Tendring. Richard's father died in and he inherited the estate. Less than two years later he was also to inherit the estate of his uncle Robert Southwall who had served as chief butler to Henry VII. In he became the ward