Career
In 1865–1866, having been given a health sabbatical by his church, he traveled to San Francisco via the Straits of Magellan on the ironclad monitor USS Monadnock with Commodore John Rodgers (a parishioner of his), with international goodwill stops along the way. Officially, he was designated Commodore's Secretary, but was considered "acting chaplain", giving services on board and even conducting a shipboard wedding for a German American they encountered in Montevideo, an incident Bush recounted in dispatches he wrote for The Overland Monthly. Coincidentally, the fleet observed the punitive shelling of a defenseless Valparaíso, Chile by the Spanish Navy during the Chincha Islands War, after mediation efforts by Rodgers failed.
In 1867–1872, Bush was called to Grace Church (later Cathedral) in San Francisco, but troubled by family obligations, only stayed five years. His short stay along with that of photographic roll film inventor Hannibal Goodwin was to be satirized by Mark Twain in his weekly column in The Californian.
In 1872, Bush took a call from Church of the Ascension at West Brighton, Staten Island. In 1884, during a dispute over a church raffle (a gold watch was auctioned, which he considered gambling), he stepped down.
In 1883, Bush published a collection of sermons called More Words About the Bible, a response to his colleague Heber Newton's book Right and Wrong Uses of the Bible. In 1885, his book Evidence of Faith was reviewed by The Literary World as "clear, simple, and unpretending", and summarized as an argument against supernatural explanations for God. According to the same journal, both works fit into the broad church movement. The Boston Advertiser called the latter work "the best statement of untrammeled spiritual thought" among recent books.
Bush retired to Concord, Massachusetts, and in 1888 left the Episcopal Church altogether and became a Unitarian. The stress of this separation caused him health problems for the remainder of his life. He moved to Ithaca, New York where he died suddenly while raking leaves in 1889.