Closed borders could spell trouble at our ports, with fresh food left to rot and buyers going elsewhere