When you spent multiple inputs in the same transaction, that allows blockchain analysis to link your transactions that created those coins together. So, a transaction that uses many inputs will damage your privacy more than a transaction that uses one input.

Ultimately, you have to use coinjoin in order to keep your Bitcoin transactions private. Otherwise, you will eventually have to leak your entire transaction history once it comes time to sweep the dust in your wallet.