This happened because you took your ninjas off. When you remove your in battle ninjas, their gear is unequipped, then it gets put back on when you add them again but usually in different order.
The trick is set your gear up how you want it then never remove ninjas form battle. Instead drag new ones over them to replace them, this way it won't keep getting swapped around.