Use a key stored in HSM as "plain text input" for encryption

No, the SmartCard-HSM has no mechanism to wrap internal AES keys other than with the Key Encryption Key.

There are just too many variants in key wrapping to implement them all in a device like this.