William Jarman Ballard, the son of James Bell Ballard, was born 30 May 1803, married Elizabeth Tapp.  Referred to as “Dr. William J. Ballard” in History and Genealogies.

According to an unverified online source, William Jarman Ballard and Elizabeth Tapp were married 11 November 1824 in Jessamine County, Kentucky.

William J. Ballard appears in the 1830 US Federal Census as head of a household of four free white persons and two slaves (Head of household is between 20 and 29; his wife, the same; one male under age 5; one female under age 5; one male slave, under 10; one female slave, age 10 to 23).  1830 US Federal Census, Jessamine, Kentucky, Series M19, Roll 38, Page 189.

The 1840 Census gives the head of household between 30 and 39, his wife, the same, one male under 5, one male between 5 and 9, one between 10 and 14; females, 1 under 5, one between 5 and 9; one between 10 and 14.  Male slaves, 3 males under 10; one male between 36 and 54; one female between 10 and 23, one female between 24 and 35 (eight free, 6 slaves).  1840 US Federal Census, Nicholasville, Jessmaine, Kentucky, Roll 116, Page 219, Image 443.

In 1850 he and his family resided in Jessamine County, Kentucky (District 2).  The census that year names Wm. J. Ballard, 47, a Physician, born in Virginia; Eliz Ballard, 47, born in Virginia; and their children, all born in Kentucky: Lucy J. Ballard, 20; Wm. A. Ballard, 18 (Male); E. F. Ballard, 16 (Female); M. E. Ballard, 14 (F.); L. E. Ballard, 9 (F.); Jos. E. Ballard, 7 (M.)  A likely servant named Matha E. McAfee, 18 was in the household, as was Henry Rowland, 46 (Merchant) and Arminda Rowland, 38.  1850 US Federal Census, District 2, Jessamine, Kentucky, Roll: M432_208, Page 47B, Image: 98.

By 1860, William, his wife and several of his children had removed to Bloomington, McLean County, Illinois, where the census records W.J. Ballard, 57, a Physician, born in Ky (probably recorded in error); Elizabeth Ballard, 57; Miranda Ballard, 22; John P. Ballard, 21; Love L. Ballard, 19.  The household also includes a Philip Butler, age 25.  1860 US Federal Census, Bloomington, WArd 3, McLean, Illinois; Roll: M653_204; Page 733; Image 735.

In 1870 William and his wife were living in the household of their daughter Love, when the census records Hannett Senseny, 32, Clerk for Coal Co. (born in Va.); Love Senseny, 28 (born in Kentucky); Fanny Senseny, 4; Lewis Senseny, 1 (both born in Ill.).  The household includes Maggie Murphy, 15, Domestic Servant.  Wm. J. Ballard and Elizabeth Ballard are listed as age 64, born in Virginia.  1870 US Federal Census, Bloomington, McLean, Illinois, Roll: M593_258, Page 237A, Image 42303.

William Jarman Ballard (born 30 May 1803, died 26 June 1878) and Elizabeth Tapp Ballard (born 17 June 1803, died 7 April 1885) are both interred in Evergreen Memorial Cemetery, Bloomington, Illinois (Findagrave.com).

An unverified secondary source found online (derived from a now lost genealogy of the descendants of Richard Tapp) lists the following children:

JAMES LEWIS, born 25 May 1826, died 31 August 1907, married Catherine Ann Hogan.

Mildred, born 24 March 1828, died 21 July 1829.

Lucy Jane, born 14 February 1830, died 11 February 1915, married William P. Duvall.

William Alfred, born 19 February 1832, married Louisa Worland.

Emily Frances, born 28 November 1833, died 3 July 1907, married Anderson Brown

Miranda Elizabeth, born 2 May 1836, married (1) _________ Rutledge; married (2) Hiram Roundtree, died 7 April 1885 [another source lists a single husband, Hiram Roundtree Rutledge, born 16 April 1831 in Hillsboro, Montgomery County, Illinois, died 12 October 1900 in Springfield, Sangamon County, Illinois, and married Miranda Elizabeth Ballard 19 November 1861 in Bloomington].

John Preston, born 16 July 1838, died “The Civil War.”

Love Louisa, born 18 January 1841, married Hammett M. Senseney; 9. Joseph Edgar Ballard, born 12 February 1843, died 28 April 1860.