You could create a watch-only wallet so that your private key is always offline. I would recommend creating another wallet, since this private key has already been in contact with internet connected devices.