I've noticed that independently. Used to think LLMs would at least be good at calculations, but they hallucinate while number crunching too 🤷