saper
2
On this forum we’ve had an attempt to do this with EC keys already:
(you are using RSA so you are not affected by the potential problem mentioned there).
But once you get the key in the proper format you’ll run into another issue - getting SSH to talk to the HSM during authentication.
Here is a guide how to do this:
https://www.smartcard-hsm.com/2015/03/11/Using_the_SmartCard-HSM_with_SSH.html