Did you at any point put the game out of focus? Because I know that could cause this problem.
I think unstable network might too, but I'm not sure on that one.