When at an inn hiring new party members, and someone you want to join doesn't accept, you can leave town and come back. Eventually the person will join your party.