“We worry that a petrol bomb will come in through the window,” one man staying at a disused council property said.