No, you keep their level, they just wont work while you're not in a group, that's it.