For much the same reason, many of the most effective folks I know journal obsessively. Those journals are not intended for public consumption. As often as not, they're an outlet to process one's innermost thoughts and feelings.

I wouldn't want ChatGPT to write my diary. It'd be the AI's interpretation of your hopes and dreams. It'd be a simulation of an estimate of my plans and ideas.

But I'd love to know more about what's actually going on inside the AI's head.

What if I gave the AI somewhere secret to write about its feelings?

At one level, this is just another variant of using a tool call to simulate "thinking." And it doesn't entirely break the LLM of its obsequiousness, but sometimes, there are glimmers of something.

I have a completely unfounded suspicion that, just like saying "please" and "thank you" will influence the LLM's output, giving it a safe space to process its emotion vectors is going to end up with healthier behavior from the AI.