Archive · 30 Jun 2025
Five Surprising Facts About How AI Chatbots Work
AI chatbots, like ChatGPT, are like students.
They learn from both the massive amount of text data (pre-training) and the feedback given by human teachers.
They break down words into small pieces called tokens.
They don't know everything, because their knowledge is limited to a specific date and might need to search the internet for new stuff.
Sometimes, they make mistakes and give incorrect information.
Also, they use a calculator in the background to help with math problems.
AI chatbots are trained through human feedback to ensure safety and ethical alignment.
Chatbots use tokens, not words, to process and understand language.
The knowledge of AI chatbots is limited by a cutoff date; they may require internet searches for recent information.
AI chatbots can 'hallucinate', generating false information due to their reliance on pattern prediction.
Chatbots use built-in calculators to perform mathematical computations.
- Who
- The article discusses AI chatbots like ChatGPT.
- What
- An explanation of how AI chatbots work.
- When
- The article discusses how AI chatbots function as of the publication date, focusing on current capabilities and limitations.
- Where
- The article does not mention a specific geographic location, but discusses research in Germany.
- Why
- To inform readers about the inner workings of AI chatbots and how to use them effectively.
- Training Method
- Human Feedback and Alignment
- Language Processing Unit
- Tokens
- Knowledge Limit
- Knowledge Cutoff
- Current ChatGPT Cutoff Date
- June 2024
- Error Type
- Hallucinations
- Mathematical Calculation Method
- Chain of thought using calculators