@kenwsf,
If you open Hackintool, go to PCIe page, and look for your RX 580, over in the left side of the table should be a "Device" column. What is the number in there for your device? If you have a "true" RX 580, the number should be
0x67DF. If it is not, what is the number? From what you sent before, I think it will be
0x46443736. Mac OS (any version of it) will not recognize that device id. So you have to "fake" MacOS into thinking it is a device 0x67DF. And maybe that will not work either. In Open Core, you could try this by adding to config.plist/DeviceProperties/Add, a
new item that looks like what Utter Disbelief wrote in his post above.