Was the chaos icon showing above his his head when he attacked you? If it was showing, then there must be a problem. Otherwise, some debuff removing ninja like jinpachi,edo sasori,sailor..... or double attack got rid of his debuff. If I remembered correctly, chaos was not supposed to be healed but changed after 3.0.