A simple way to remove him in rescue Jinchuriki is by asking the owner of that hidan team to remove him on their ranked main team (with their main) one day before the event starts (wednesday) and they can put it back on saturday.

If they won't consider it, then the only way is like what Dym stated. You c*so use mysteries that stops him from reviving like Mabui's.