The solution is natural selection. There are still subsets of the population that are above replacement level. Over the course of a few generations, we'll be back on a growth track with their descendants.

There might be significant population declines before that.