Archive · 30 Jun 2025

Five Surprising Facts About How AI Chatbots Work

Five Surprising Facts About How AI Chatbots Work

AI chatbots, like ChatGPT, are like students.

They learn from both the massive amount of text data (pre-training) and the feedback given by human teachers.

They break down words into small pieces called tokens.

They don't know everything, because their knowledge is limited to a specific date and might need to search the internet for new stuff.

Sometimes, they make mistakes and give incorrect information.

Also, they use a calculator in the background to help with math problems.

Sources