You may need to do offline YNAB, aka the Envelope System: https://www.nerdwallet.com/article/finance/envelope-system
P.S. I love YNAB, it's awesome!