“As a nation, we are far too tolerant of letting people do what they want with their properties,” said one housing expert.