We will be exploring non-custodial wallets later this year. It's complicated because of latency, failure modes, and security.
At the very least we'll be providing ways for you to keep your wallet below a certain threshold.