The problem is that much of the British establishment “still lives in the mental world of EU membership.”