Why AI Chatbots Forget the Conversation: The LLM Context Window Explained

A neural network's context window is an architectural trait that explains why AI doesn't work like a person with memory. Instead, it works like an expert who rereads the entire correspondence from scratch every time before writing a reply.

Why does AI forget parts of a conversation?

AI doesn't forget in the usual sense — it has neither working memory nor long-term memory. The model receives the whole conversation every time, but the amount of information it can process at once is capped by the context window. Once a conversation grows too long, older messages fall outside the window and the model can no longer see them.