You're going to lose the power you won with the group skills. But you'll get it back when you join another group :)