db said in #4167 4w ago:
Recent project from a researcher the MIT Media Lab claims LLMs make you dumber.
Project link: https://www.brainonllm.com
> We assigned participants to three groups: LLM group, Search Engine group, Brain-only group, where each participant used a designated tool (or no tool in the latter) to write an essay
> performed using ChatGPT
> 54 participants
> We used electroencephalography (EEG) to record participants' brain activity in order to assess their cognitive engagement and cognitive load
> Brain connectivity systematically scaled down with the amount of external support: the Brain‑only group exhibited the strongest, widest‑ranging networks, Search Engine group showed intermediate engagement, and LLM assistance elicited the weakest overall coupling
> the LLM group's participants performed worse than their counterparts in the Brain-only group at all levels: neural, linguistic, scoring
Is this a qualitatively new problem, or merely an acceleration of existing cognitive problems previously precipitated by our use of the Internet as a mental crutch?
My gut take is that it is simultaneously not a real problem (we compensate for worsening mental powers with increasingly adept use of technology) and worse than you could possibly imagine (such technological dependence dramatically accelerates our alienation from other humans).
Project link: https://www.brainonllm.com
> We assigned participants to three groups: LLM group, Search Engine group, Brain-only group, where each participant used a designated tool (or no tool in the latter) to write an essay
> performed using ChatGPT
> 54 participants
> We used electroencephalography (EEG) to record participants' brain activity in order to assess their cognitive engagement and cognitive load
> Brain connectivity systematically scaled down with the amount of external support: the Brain‑only group exhibited the strongest, widest‑ranging networks, Search Engine group showed intermediate engagement, and LLM assistance elicited the weakest overall coupling
> the LLM group's participants performed worse than their counterparts in the Brain-only group at all levels: neural, linguistic, scoring
Is this a qualitatively new problem, or merely an acceleration of existing cognitive problems previously precipitated by our use of the Internet as a mental crutch?
My gut take is that it is simultaneously not a real problem (we compensate for worsening mental powers with increasingly adept use of technology) and worse than you could possibly imagine (such technological dependence dramatically accelerates our alienation from other humans).
Recent project from