My main display is on Gentoo, using xorg 1.15.1 (maybe I should try 1.16.0). I'm running applications in a RHEL 6.5 VM (using xorg 1.13.0). I ssh into the RHEL virtual machine, launch some heavy (java-based?) X applications that don't otherwise work on Gentoo, and get them to display on my main screen. This has the advantage of allowing the windows to move around my desktops or even integrate with my system tray.
Unfortunately, when I do this, my entire X server stops responding fairly quickly. Nothing pops out at me in the X server logs. The screens stop repainting, except for the mouse, and even the mouse eventually stops moving. This is usually within 5 to 10 minutes, but sometimes faster.
Making this worse is that my kernel can't seem to display to the console, most likely due to a combination of nvidia proprietary driver + UEFI, so hitting ctrl-alt-F1 and looking at the logs isn't an option (but I can restart X that way, losing my VM, etc., in the process). This is a different problem that isn't part of the question, only the context as to why the above is a significant issue.
I'm looking for anything I can try to get this configuration to stop locking up my X server. Restarting X every ten minutes can really impact one's productivity.