Simon Harris has admitted that he is having a "pretty rotten time" after a series of threats were made against him and his family.