I don’t know how your OS is configuring gpg and scdaemon, but you have to check if it is compiled with CCID support and needs direct access to the hardware via USB or does it need to use pcscd.
If pcscd is installed, there should be automated pcscd activation rule in systemd (socket activation).
To make GPG work with pcscd, you might need disable-ccid in your $HOME/.gnupg/gpg-agent.conf
More about this:
You might need to talk to your distribution maintainers if there are problems.
