John and Timothy Philbin decided in 2018 to scrap a plan for housing on Kings Highway in Fairfield for a mixed use project.