Sales at home baking and spices supplier Fiddes Payne plunged last year due to weakness in its core UK market.