To answer your question quickly, no it won't remove Raikage's passive. It will only affect passives that have a time limit on them, similar to Han or Shisui. For example, if Lightning main has an ability that buffs 3 lightning ninjas by 40% but it only lasts 5 rounds, this makes it a clearable effect. On the other hand, Lightning's Anbu Tactics buffs all ninjas on the field with 25% damage/leech, however this buff has no round limit therefore making it not clearable. So Raikage's passive has no time limit therefore it isn't clearable