Shiloh Baptist Church was organized in Columbus, Ohio, on August 8, 1869.  It started when 44 members withdrew from the Second Baptist Church.  Shiloh Baptist Church began its existence in a room over a grocery store on the northeast corner of Forth and Gay Streets.  This small band of believers worshiped there for two years.

In 1871, the property on the south side of East Long Street between High and Third Streets, was purchased from a Bethel Methodist Episcopal Church, where subsequent services were held.

On August 1, 1884, Shiloh Baptist Church moved its place of worship to the Christie Chapel site on Cleveland Avenue.

On April 23, 1922, ground was broken for a new church, on Mt. Vernon and Hamilton Avenues.  The cornerstone was laid on July 8, 1923, after the basement was completed.  In August of 1923, the first church service was held in the basement.  In 1924, Shiloh Baptist Church contracted with a Black firm (i.e., O. A. Day Construction) located in Indiana to complete the building.  Shiloh Baptist Church was the first of its kind to be erected by a Black congregation in Ohio.