Windows VPN connections interrupt network connectivity

I've been testing out VPN connections with the client that's built into Windows 8. I got it to connect to the VPN server, but a few seconds after Windows marks it "Connected", I briefly lose connection to everything on my normal interface. That's kind of unfortunate, since it interrupts some applications I'm running. At least it goes back to normal after that, though.