Lag and disconnects in multiplayer

I’ve being play with friends and the game seems to lag or be very slow. It also constantly keeps saying waiting for players, while for my friends it says waiting for me. Than I keep losing connection to photon cloud and going into a solo game. It’s very frustrating cause I like the game and this really takes me out of it. I’m also on Xbox