Rufus said that he needed to go to Verbobonc at certain point (I think when his level is level 8). I returned to Hommlet and he's still in his tower so I tried to recruit him again. He said the same thing and left my party again when I went out of his tower. Is it possible to get him back permanently? Do I have to wait till Verbobonc is accessible (post Z)?