Its possibly an internet connection problem. I have the same problem, when I try to play by using my mobile internet (the wifi in the house is a piece of *, its nothing for 5 people, so its unable to play any multiplayer games with it). So I tried with my mobile internet, but its not connecting, after I get the invite notification, the lobby not loading on.