You'd have to memorize a separate seed phrase for your RSA encryption and yet another seed phrase for your PGP. They aren't mathematically compatible with each other.