Maritime farmers are worried of the future of a grain elevator in Halifax which could see closure.