Server stuck in POST when Nitrokey HSM is inserted

I am sorry, but I do not have any other ideas.
Here I’ve found a similar topic with Nitrokey Pro: UEFI boot slow with Nitrokey Pro plugged in.
Regarding workaround for now, I would use another machine to access the device over the network, e.g. with a Raspberry PI.