Author and political historian Arhtur Milnes explains the history of the PM's residence and why we need to fix it.