Archive · 24 Jul 2025
Researchers Report ChatGPT's Growing Unreliability and Errors
Imagine a helpful robot that helps researchers find information.
But lately, this robot, ChatGPT, has started making things up!
It invents quotes and mixes up ideas from different topics, making it hard to trust what it says.
This is frustrating because it used to save researchers time.
Now, they have to double-check everything, and the robot keeps getting things wrong, even after being corrected.
Some researchers are now thinking about going back to doing things the old-fashioned way or trying other tools.
Researchers report ChatGPT is increasingly unreliable, hallucinating quotes and blending topics.
Users express frustration with the AI's tendency to invent citations and misattribute quotes.
The issue has worsened in recent months, disrupting workflows and undermining trust in the tool.
The AI's personalized memory function is criticized for inserting niche details from previous conversations.
Academics are considering reverting to traditional methods due to these inconsistencies.
- Who
- Researchers and academics using ChatGPT are affected.
- What
- Researchers are experiencing increasing unreliability with ChatGPT, including fabricated quotes and blended information.
- When
- The issue has worsened in recent months.
- Where
- N/A
- Why
- ChatGPT's memory and response behavior are leading to inaccurate and unreliable information.
Users' concerns
OpenAI's response
Memory Functionality
Users' concerns
ChatGPT is unreliable and often fabricates information.
OpenAI's response
OpenAI promotes memory as a feature to personalize and enhance responses.
- Issue
- ChatGPT's hallucination of quotes and blended topics
- Affected users
- Researchers, academics, and writers
- Problem
- Inconsistent and inaccurate information
- User workaround
- Starting new chat threads or re-uploading documents.