The libertarian vision, unlike the anarcho-capitalist one, is compatible with the existence of a government. Personally, I also don't believe things can function with absolutely zero government (although I often say that if I had to choose between anarcho-capitalism and anarcho-communism, I would choose the former as it's more ethical). At the end of the day, governments should represent the will and consent of the people, and as you rightly pointed out, not all will and consent can be expressed through market prices. So, the issue isn't governments per se but how they are implemented: too large, influential, detached from the actual will/control of the people, and most importantly and dangerously, they have control over money manipulation.