pull down to refresh

You're basically describing NIP-26 which is key delegation. It didn't get adopted though it seems. This kind of thing is very tricky to get right. Most solutions are either very complicated or not very robust. Hot key management is very hard.