As Baroness Thatcher’s former private secretary, he is closely linked to something dear to the Tory right and the Toryish wing of UKIP.