The question is, would you rather trust some random VPS provider, or Proton who has E2EE by default and a good track record?

Mhh, good point. However, whatever provider, I would recommend to not store any data without encrypting it yourself first. I think that would require the least amount of trust.

So

no matter what

is not true. They will only see random garbage if it's encrypted.