That's how I read it. The quote seems to be saying that people may apply negative descriptors to someone who is quiet. Why should one care what others may perceive you to be without speaking to you? It feels like the quote is almost encouraging the reader to develop a people-pleasing attitude because somehow "being quiet is bad".

Again, my interpretation.