I had the se situation before deleting the data and restoring the whole wallet. No amount of reseting the graph or chosing low ping peers fixed that. And yes, the nubmer of channels was incorrect.
After deleting and restoring the wallet yhe zombie channels get cleaned up and are usually below 100.
I am quite sure that this is some kind of a bug in the wallet.