I think there's a lot of historical ignorance driving these current sentiments. The US dollar predates the Fed, so obviously the Fed is not necessary to have dollars.

People are told the Fed is necessary and they have Stockholm Syndrome, so they freak out when it's challenged.