Now is not the time to abandon Key Worker Housing group