So we meet again... Anyway this happened to me too and here's what I noticed:

The one I faced against is waaaay lower in initiative in terms of position 1 but he has me outclassed in positions 2-4. So that might be the case for you as well. Kindly check his other positions as well because in survival trial and matsuri, the equipment stats get mixed around (to what degree, I don't know). If that's not the case, then there might be other problems that someone more knowledgeable might be able to explain.