You don't go to conferences for the panels and keynotes (in this day and age you can find the recordings online). You go there for the networking. It's up to you to decide whether the ticket it worth the opportunity to make new connections that could become friends or business partners in the future.
Also, make sure you're up to the task of networking. I am a highly introverted person, unable to connect with people "organically". As soon as I understood that I stopped wasting money on conferences, but your case might be different.