> binary / judgement questions to LLMs 

Well they're not classifiers, so they shouldn't be used as classifiers.

How do you explain this without your audience reaching for ChatGPT to ask, "what's a classifier?"?!?


adlai

I'm personally a bit on the fence about binary / judgement questions to LLMs simply because whenever I bench a true cognitive skill "is this A or B", or "express as a % certainty" then the results are still all over the place, also with expensive models. But it's cool that it worked for you.

AskSN

Did a Chatbot Solve a Problem for You?

optimism

Glad no one got seriously injured! 

I'm personally a bit on the fence about binary / judgement questions to LLMs simply because whenever I bench a true cognitive skill "is this A or B", or "express as a % certainty" then the results are still all over the place, also with expensive models. But it's cool that it worked for you.