Is losing the City of London really a price worth paying for Brexit?