I find Pieter Wuille's argument to be quite compelling:

"The alternative is that millions of BTC become vulnerable to theft; I cannot see how the currency can maintain any value at all in such a setting. And this affects everyone; even those which diligently moved their coins to PQC-protected schemes."

The idea that millions of bitcoin will flow to a single thief (with immense resources, who wields a powerful supercomputer) is a bit unsettling. But I'm not totally sold yet - a lot of drawbacks.