You keep your group skills, but they will not be given back to you until you join another group.