Importing private key fail on HSM2

The SmartCard-HSM does not support key import in clear for security reasons.

You need to use the Smart Card Shell for encrypted import. There is a detailed blog that explains the process step-by-step.