Right, non-upgraded nodes would accept the old rules or the new rules, but upgraded nodes and miners would enforce the new rules. If a majority of the network and hashrate enforces the new rules, the best chain converges on the new rules. That’s the definition of a soft fork.