Well, you can abandon them, just ask for more.

But make sure you get a complete-able set before doing your survival and ninja test for the day. Because if you end up not being able to do quests related to that, your options vastly decrease and it will take a lot more work to get a workable one.