We don't. Down votes are always use as a tool to suppress others even if the initial goal is not that, look at that cesspool of reddit for example

By doing what bitcoin does, incentivize good behavior as much as we can and make it extremely expensive to spam and flood SN with junk posts/links