Yes, going voluntarist on your own does the exact thing you want to do. It is even better if there is a like-minded group of voluntarists going their own way, together. I personally think that the future is full of small groups self-ruling as they please and melding into a larger society by live-and-let-live rules in a sort of anarchic situation.