The slowdown in residential construction is emerging as a major risk to the economy. But out of work builders will not necessarily be building roads, railways and bridges because they do not have the skills.