It's happened to me a few times. Usually the whole lobby gets kicked from the game and everyone gets the message. Yet we all are still in the lobby together and can still talk to each other. I don't know what causes it.
happens here and again, could be your router/modem. I used to get dropped from alot of games untill I bought a new one during the second half of mw3.