Brother Williams was born on 25 February 1829, in Talbot, Georgia, United States. He married Jane E Gates on 15 October 1856. He lived in Crawford, Russell, Alabama, United States in 1860. He died on 6 August 1882, in Opelika, Lee, Alabama, United States, at the age of 53, and was buried in Rosemere Cemetery, Opelika, Lee, Alabama, United States.