Definitely not a Ledger. The security issues with Ledger are not pretty.

If you did buy a hardware wallet, make sure it's Bitcoin only - that limits the list quite a bit. And also I suggest that you use Sparrow Wallet to coordinate transactions, instead of any wallet software associated with the hardware wallet.

If you want to pursue the USB stick option - here's some detailed instructions on how to create a wallet with a USB stick/TailsOS written up by @Natalia a while back How to MAKE your own Cold Wallet 🕶️.