Lebanese-Muslim communities say they have been unfairly called out by Federal Immigration Minister Peter Dutton.