Salutations xxShakeNBakexx,
Are you unable to get into a match completely when partied or is it delay a little bit? Did you manage any of your router settings for either console? Do you have static ip addressed to either or both of your consoles? Have you tried power cycling your router? Is the host between you two, playing on a wired or a wireless connection?
Thanks,
^AJ