So it seems at least 1 person got the LG 5k + nvidia to work:
https://twitter.com/herrhaase/status/897224092184694785
I asked him for more details via Twitter..
Most Vega chips are supported. It doesn't matter if it's Frontier or RX. Same PCB, same chip and all the ids are in the AMD10000 controller (not sure for the Pro WX 9100) . The new drivers in 10.13.2 beta 1 are much better. (Closer to point release iMac Pro)
Have you tried running Electron based apps on 10.13.2 beta 1 to see if they still crash? Or running Chrome without disabling the GPU? If you run Slack or anything like that you can generally get it to crash the whole machine in a couple of clicks.