Brexit and ageing members spell trouble for town's twin links