Once a thriving hotbed of finance, it's now a low-cost home to eight families