Cannot update and having certificate issues

[lahdekorpi]

Hi!

I'm having issues with a Hackintosh install that I've been upgrading for years. If I recall correctly, I did a fresh install last time on 10.9 and been upgrading to every version since. Currently at 10.15.7 (19H2).
But now I started having issues, I get an error trying to update through the software update (both, GUI and CLI). When installing updates manually from the DNG files, everything works perfectly.

The error I get:

softwareupdate -l
Software Update Tool

Finding available software
The operation couldn’t be completed. (NSURLErrorDomain error -1012.)

When looking at the logs:

2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Starting softwareupdate CLI tool
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Adding client SUUpdateServiceClient pid=74306, uid=501, installAuth=NO rights=(), transactions=0 (/usr/sbin/softwareupdate)
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Query for available updates: FINISHED
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Adding client SUUpdateServiceClient pid=74306, uid=501, installAuth=NO rights=(), transactions=0 (/usr/sbin/softwareupdate)
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: Waiting for SUAppStoreUpdateController to populate initial list of available updates
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Waiting for available updates to be initially populated
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Done waiting for available updates to be initially populated
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: Done populating initial list of available updates: [] with major os updates: []
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: Time interval since last scan - 562.699885
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: shouldScan - 1, productKeysInActiveForegroundTransactions - 0
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: Scan is in progress
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUScan: Scan for client pid 941 (/System/Library/CoreServices/Software Update.app/Contents/Resources/softwareupdated)
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Adding client SUUpdateServiceClient pid=74306, uid=501, installAuth=NO rights=(), transactions=0 (/usr/sbin/softwareupdate)
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Failed Software Update - Refusing invalid certificate from host: swscan.apple.com
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Failed Software Update - Refusing invalid certificate from host: swscan.apple.com
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUScan: Fetching the catalog failed due to an error. Although our catalogTestMode is nil, we will not exit a TestMode (if we are in one).
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUScan: Elapsed scan time = 0.2
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUScan: Error encountered in scan: Error Domain=NSURLErrorDomain Code=-1012 "(null)" UserInfo={NSErrorFailingURLStringKey=https://swscan.apple.com/content/catalogs/others/index-10.15-10.14-10.13-10.12-10.11-10.10-10.9-mountainlion-lion-snowleopard-leopard.merged-1.sucatalog, NSErrorFailingURLKey=https://swscan.apple.com/content/catalogs/others/index-10.15-10.14-10.13-10.12-10.11-10.10-10.9-mountainlion-lion-snowleopard-leopard.merged-1.sucatalog, NSLocalizedRecoverySuggestion=Varmista, että olet yhteydessä internetiin, ja yritä uudelleen., SUErrorRelatedCode=SUErrorCodeScanCatalogNotFound}
2020-10-22 21:09:54+03 Mac-Pro SoftwareUpdateNotificationManager[939]: AssertionMgr: Take com.apple.softwareupdate.NotifyAgentAssertion-BadgingCountChanged assertion with type BackgroundTask for pid 939, id 0x9E4C
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Scan got error Toimintoa ei voitu suorittaa. (Virhe -1012 kohteessa NSURLErrorDomain.)
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUScan: Scan for client pid 941 (/System/Library/CoreServices/Software Update.app/Contents/Resources/softwareupdated)
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: SUStatisticsManager: Successfully reported statistics for category 5
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: SUPrefPaneController: Scan has ended
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: Controller: Scan finished with error
2020-10-22 21:09:54+03 Mac-Pro softwareupdate[74306]: SUPrefPaneController: Last known CatalogURL is default.
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Adding client SUUpdateServiceClient pid=939, uid=501, installAuth=NO rights=(), transactions=0 (/System/Library/PrivateFrameworks/SoftwareUpdate.framework/Versions/A/Resources/SoftwareUpdateNotificationManager.app/Contents/MacOS/SoftwareUpdateNotificationManager)
2020-10-22 21:09:54+03 Mac-Pro SoftwareUpdateNotificationManager[939]: AssertionMgr: Cancel com.apple.softwareupdate.NotifyAgentAssertion-BadgingCountChanged assertion for pid 939, id 0x9E4C
2020-10-22 21:09:54+03 Mac-Pro SoftwareUpdateNotificationManager[939]: (null)：softwareupdated: Service connection invalidated!
2020-10-22 21:09:54+03 Mac-Pro softwareupdated[941]: Removing client SUUpdateServiceClient pid=939, uid=501, installAuth=NO rights=(), transactions=0 (/System/Library/PrivateFrameworks/SoftwareUpdate.framework/Versions/A/Resources/SoftwareUpdateNotificationManager.app/Contents/MacOS/SoftwareUpdateNotificationManager)
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Failed Software Update - Refusing invalid certificate from host: swscan.apple.com
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Failed Software Update - Refusing invalid certificate from host: swscan.apple.com
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: SUScan: Fetching the catalog failed due to an error. Although our catalogTestMode is nil, we will not exit a TestMode (if we are in one).
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: SUScan: Elapsed scan time = 0.2
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: SUScan: Error encountered in scan: Error Domain=NSURLErrorDomain Code=-1012 "(null)" UserInfo={NSErrorFailingURLStringKey=https://swscan.apple.com/content/catalogs/others/index-10.15-10.14-10.13-10.12-10.11-10.10-10.9-mountainlion-lion-snowleopard-leopard.merged-1.sucatalog, NSErrorFailingURLKey=https://swscan.apple.com/content/catalogs/others/index-10.15-10.14-10.13-10.12-10.11-10.10-10.9-mountainlion-lion-snowleopard-leopard.merged-1.sucatalog, NSLocalizedRecoverySuggestion=Varmista, että olet yhteydessä internetiin, ja yritä uudelleen., SUErrorRelatedCode=SUErrorCodeScanCatalogNotFound}
2020-10-22 21:09:55+03 Mac-Pro SoftwareUpdateNotificationManager[939]: AssertionMgr: Take com.apple.softwareupdate.NotifyAgentAssertion-BadgingCountChanged assertion with type BackgroundTask for pid 939, id 0x9E4D
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Scan got error Toimintoa ei voitu suorittaa. (Virhe -1012 kohteessa NSURLErrorDomain.)
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: SUStatisticsManager: Successfully reported statistics for category 5
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Adding client SUUpdateServiceClient pid=939, uid=501, installAuth=NO rights=(), transactions=0 (/System/Library/PrivateFrameworks/SoftwareUpdate.framework/Versions/A/Resources/SoftwareUpdateNotificationManager.app/Contents/MacOS/SoftwareUpdateNotificationManager)
2020-10-22 21:09:55+03 Mac-Pro SoftwareUpdateNotificationManager[939]: AssertionMgr: Cancel com.apple.softwareupdate.NotifyAgentAssertion-BadgingCountChanged assertion for pid 939, id 0x9E4D
2020-10-22 21:09:55+03 Mac-Pro SoftwareUpdateNotificationManager[939]: (null)：softwareupdated: Service connection invalidated!
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Removing client SUUpdateServiceClient pid=939, uid=501, installAuth=NO rights=(), transactions=0 (/System/Library/PrivateFrameworks/SoftwareUpdate.framework/Versions/A/Resources/SoftwareUpdateNotificationManager.app/Contents/MacOS/SoftwareUpdateNotificationManager)
2020-10-22 21:09:55+03 Mac-Pro softwareupdated[941]: Removing client SUUpdateServiceClient pid=74306, uid=501, installAuth=NO rights=(), transactions=0 (/usr/sbin/softwareupdate)

Could this be an SSL issue or something? Looking at the https://swscan.apple.com/content/ca...n-lion-snowleopard-leopard.merged-1.sucatalog URL in Safari works fine and the cert is valid.

Is there a way to completely reset /Library/Keychains to defaults, including certs? I don't mind clearing everything in there.

I also tested from a new account and had the same issue.

Any ideas on how to start debugging this? I don't really like to do a fresh install right now.

Thanks a lot for any ideas in advance, I've run out of them...

 

[lahdekorpi]

Tried replacing /Library/Keychains and ~/Library/Keychains with ones from a clean install in recovery mode without any effect.

For anyone finding this page, a nasty workaround is to find out your sucatalog file URL and use it with HTTP instead of HTTPS. In my case:

Spoiler: Unsecure workaround

sudo defaults write /Library/Preferences/com.apple.SoftwareUpdate CatalogURL "http://swscan.apple.com/content/catalogs/others/index-10.15-10.14-10.13-10.12-10.11-10.10-10.9-mountainlion-lion-snowleopard-leopard.merged-1.sucatalog"

WARNING: This may leave your software updates open to man-in-the-middle attacks.