The worst of what you fear is already going on and the people who do it are a bit more careful / better with cryptography than your average crypto degen.