Problem with game audio and party chat simultaneously

I've been trying to figure out how to run both game audio and party chat/ game chat through my headset. I've selected all audio but that only includes game audio. When I'm in a party I can't hear anyone. But when I select chat audio I can hear people but I lose of course the game audio that I want though my headphones. If anyone has a solution to this that would great!