I’m very skeptical of any automated process for bias correction.

The nature of bias is that there’s important unobserved stuff getting smuggled into the error term. 

Unless it’s handled deliberately in a well designed manner, it’s not going away. 

Correct. The biases are taken out with reinforcement training. This used to be a human check but is now simply another model checking the answers: bias is currently second hand, and the bias check itself is also subject to hallucination.

optimism

Why do people find it so exciting when LLMs say outrageous things?

Scoresby

First, totally agree. 

Second, people get excited when their priors get confirmed. 

What it highlights and I think is important is how prone to biased answers these things are. 

Econometrics is all about identifying and correcting for biases. My concern about AI, as I understand it to function, is that it can’t correct for biased results or reasonably assess what biases are present. 