PS4 connection issues with my roommates

I currently live in an apartment with 3 of my buddies. We all have ps4's and the internet connection is actually quite fast here. However, we cannot play together as we cannot connect to each other whether it be an in game lobby or a PS4 party chat. Does anyone have any suggestions how to fix this? PS each of our PS4's are hooked up directly, we are not playing through the connection of a router