Ah. He's been operating on a flawed premise. Mildly irritating, but a fact is a fact. Given what Hermit's nature should be, that he'd wanted to leave the game is perhaps unsurprising. What is interesting is that two of his opponents neither wanted him gone nor his interference.

What would the effects be on the game if you had succeeded in leaving?

There must be a reason behind the actions of the others.