Given some Windows updates can take 20-30 mins to complete it took a while to establish there was an actual problem!
As I'm a remote worker, I then had to go through the process of contacting the service desk (who were busy helping other people with the same issue), and authenticate accordingly. They then had to find my laptop in the asset management system in order to provide me the BitLocker key needed to boot into safe mode and remove the offending updates. It then took an age to reboot.
I pretty much lost an entire morning because of this, and I'm still waiting for the explanation as to why our patch testing procedures didn't pick this issue up?!