The team leader is there for a reason, to lead the team, that person can kick people out of the team, transfer leadership to someone else, and make it so people cannot join the team uninvited.

If all that fails you can manually quit the team yourself. I guess I don't understand the problem here.