Comment by Reza Shahamiri

Large Language Models such as ChatGPT and Gemini do not “know” things the way humans do. They are trained on massive datasets including hundreds of billions of words, code repositories, and images. Through this training, they map mathematical relationships between words to mimic natural human language. When we ask such models a question (prompting), it’s not fetching a fact from a traditional database; it’s guessing the next most likely word based on the statistical patterns it has learned. Because they rely on these learned patterns rather than genuine comprehension, they struggle with novelty.