Here Christopher Billop established "the Manor of Bentley," which later became Tottenville, on the basis of a grant of land made to him by King James II in 1676. He built the house toward the end of the century. His great-grandson, a Tory, entertained General Howe and his staff here during the Revolution. This was the occasion of the "conference" held in the house in 1776, when Howe received Benjamin Franklin and John Adams, delegates from the Continental Congress, to see if peace could be arranged. The conference proved abortive and the delegates left under guard but unharmed.