The Lower East Side was not a wealthy neighborhood in the late 19th century, and it was common for Jewish congregations to pray in converted spaces rather than pay to build something to their specifications. Built as a church in 1860, this building became home to the Orthodox German-Jewish congregation Shaaray Hashomayim (“Gates of the Heavens”) in 1864. It was common for congregations like this to frequently move locations, finding nicer (or cheaper, depending on their needs) accommodations in other buildings. So Gates of the Heavens left this building in 1889 and it reverted to use as a church again. It became a synagogue once again in 1902 - this time as home to the unrelated congregation with a similar name, Shaaray Shomayim (also meaning Gates of Heaven). They remained in the building for over 100 years.

Its design was described as “eclectic Byzantine” and it was the largest in the area, holding 1800 worshipers. Sound reverberated spectacularly in this space and it became known as the “Cantor’s Carnegie Hall”, hosting such famous Chazzans as Yossele Rosenblatt, Moshe Koussevitzky, Zavel Kwartin, Moishe Oysher, Jan Pearce and Richard Tucker. Red Buttons sang in the choir and Edward G. Robinson had his Bar Mitzvah there.

Like most synagogues in the area, congregation numbers slowly dwindled through the 20th century until just a handful of congregants remained by the 2000s. The congregation persevered only through the efforts of Rabbi Yaakov Spiegel, who led the synagogue from 1981-2001; in June 2003, that swath of Rivington was named “Rabbi Yaakov Spiegel Way” in his honor. But by December 2005, the building had sustained too much damage to be safe and services were moved to a nearby home. In January 2006, the synagogue’s roof collapsed, and the building was demolished two months later.