- 🧠🤖 Chatbots show cognitive decline This @bmj.com study finds that leading large language models show signs of mild cognitive impairment in tests used to detect early dementia. The older the model, the lower the score 🔗 press.psprings.co.uk/bmj/december... #AI #Neurology 🧪 #SciCommDec 19, 2024 21:19
- Hold on, that's not at all what this shows -- they don't evaluate how a single model's performance changes over time, they just observe that newer models (trained on more data with newer and more advanced methods) are better than different, older models
- To be clear, this study doesn't in any way show that e.g. ChatGPT4o will get worse over time This study shows progress in the field (newer models improve on previous iterations), not "cognitive decline"
