The Yanceyville First Baptist Church was organized in 1834 by Stephen Pleasant who had been excluded from Ebenezer Baptist Church and the Country Line Baptist Association when the association agreed not to have anything to do with missionary endeavors. The church was first called Countryline, then Countryline-Yanceyville, and finally Yanceyville Baptist Church. The original membership of the church was probably from Countryline Baptist Church which had dismissed 58 members in 1834. This church is still in existence as a Primitive Baptist Church. The church was named for the town where it is located. An article appearing in the Greensboro (N.C.) Daily News on January 29, 1950, entitled "Final service will be today in Yanceyville's old Baptist church; to give way to modern new building" was written by Tom Henderson. It holds an association with the Beulah Baptist Association.