You definitely should be receiving the 4 fragments every day from elite instance clears. Others come from survival trial breakthrough rewards and all of the ninja treasure scroll draws.