I'm guessing you have not configured your router or PS3 for optimum connection.
If your in-game NAT is not Open then you will have trouble.
Give the following link a read:
Forget that your other games play fine. You want to have Ghosts set up correctly. This will also improve your connectivity in all other games.