The society said the “sluggish” economy and unfavourable retail landscape would be “a significant ongoing challenge”