I’ve tried doing that too but the delay was far too much, around 3-4 seconds and the bitrate was so low it looked like a 480p stream. How did you set your proxmox?
It sounds like you didn’t set up gpu passthrough
I passed through my GPU and the SSD to the VM directly. Performance has been solid for me. With 8 cores, 32GB RAM assigned and a GTX 1070. Monitors are plugged directly into the card with the display setting in proxmox set to none since I don’t use the console screen in proxmox for the Windows VM.