I understand your feeling! We had a debate previously on meta in which I made the case that the cowboy hat had become a badge, even if that was never the intention. The guys clarified that they were thinking about implementing badges, so in a future you will have the right to keep your hard-gained medals my friend.