Bruce Lehrmann's barrister has told the Federal Court it can't rely on the evidence of Brittany Higgins, as he made his closing arguments in the defamation case brought by the former Liberal staffer.