Generating the keys did work fine with pkcs11-tool, but it required the key-type to be set to the right curve beforehand with gpg tools.
Already fixed (in master) github issue #1906 might also be related.
Anyway I’m currently using a Nitrokey HSM 2 for this, which works great.