My answer, so nobody could accuse me of avoiding my own question, would be circa 5-10%.
Research carried out for the Joseph Rowntree Charitable Trust has suggested that up to 25% of people have thought about voting for the far-right party.
They may prove a little more reliable that you in fact the vote is around 1% of the adult population.