More than 20% say they are not going back because of the pandemic.