Records for Joel are scant. When his mother died about 1845, Joseph Lloyd was appointed guardian of his estate.208 Joel does appear in the 1850 census.203 (The 1840 census214 does show an unidentified male in the household of Joseph Lloyd of the right age to be Joel, but the census records before 1850 list only the name of the head of each household.)

Handed-down family history makes no mention of him.