I created a new EFI folder for that system on a USB flash disk maybe 2 days ago using the procedure in the 10.15.4 Catalina Mini-Guide (and the files from the ZIP attached there).
I used config-AMD-GPU.plist and copied/pasted the SMBIOS/RtVariables sections from old config.plist into this file, then renamed it to config.plist.
Then I made sure MSR 0xE2 was unlocked (native NVRAM) and Clover "rc" scripts were deleted.
After booting from the USB flash disk, I verified that Catalina 10.15.4 was able to load and run just fine. Then I copied the EFI folder from USB flash disk to the EFI partition of the Catalina internal SSD.
And then today I ran the Combo Update with no issues at all. And yes those leftover install volumes are completely and totally gone.