pull down to refresh
0 sats \ 2 replies \ @SimpleStacker 30 Aug \ on: Brain on ChatGPT: Accumulation of Cognitive Debt when Using AI for Essay Writing science
Any details on what this means?
Not surprising at all if the LLM users weren't able to recall their own llm-assisted writing, or had less ownership of it.
But it's a bit more surprising that one experimental treatment can have lasting impacts on overall cognitive levels over a four month period, unless those tests were directly related to the experimental treatment.
And, imo, it's also the biggest macro thing to worry about. Of course, LLM-assistance on a task will reduce our understanding of that specific task, but does it free up our time and mental energy to think about other tasks? Is the net benefit over all tasks greater than the cost on our ability to do specific tasks?
But it's a bit more surprising that one experimental treatment can have lasting impacts on overall cognitive levels over a four month period, unless those tests were directly related to the experimental treatment.
I think the study ran over 4 months, with repeated sessions.
Don't want to appeal to authority, but the affiliation of the authors seems to indicate this was likely done thoroughly. Also, the fact it made number 1 spot on HN is not a bad indicator of quality.
208-page preprint... maybe we should ask AI to summarize it.
does it free up our time and mental energy to think about other tasks?
Yes. I often ask AI to give me a first summary of a paper before diving into the math myself.
reply
Not really doubting the thoroughness of the study, but just trying to understand how to interpret the results. Should I interpret the cognitive decline in a broad sense, or a narrower sense relating to the specific tasks presented in the experiment. Honest answer is I should probably just read the study haha
reply