A Defra spokeswoman told The Grocer the government was “giving consideration” to what replacement labour arrangements might be necessary after Brexit