Efra Committee chair Neil Parish warned produce could be ‘left to rot in fields’ if the food sector’s labour requirements weren’t met