Generative AI
Large Language Model
Large language models generate text from context, but their fluent answers still need source checks, privacy judgment, and human review.
Reviewed 2026-08-04
One-Sentence Definition
A large language model is a machine-learning model trained on very large text datasets to predict tokens--small units of text--and generate language from the context it receives [1].
Quick Answer
An LLM is the engine behind many chatbots, writing assistants, coding assistants, and document tools. You give it a prompt. It uses the prompt, the conversation, and patterns learned during training to predict the next token or sequence of tokens. The answer can be helpful, structured, and fast, but it is generated output, not verified knowledge by default.
The safest mental model is simple: an LLM is very good at producing plausible language from context. It can explain, summarize, translate, draft, classify, work through examples, and produce structured analyses. Modern LLMs are strongly shaped by Transformer architecture [2]. They can also miss facts, invent details, or sound certain when the evidence is weak. NIST treats generative AI risks as something organizations must manage across design, use, monitoring, and evaluation, not as something solved by model choice alone [3].
Why It Matters
LLMs now sit inside search tools, office suites, code editors, support systems, learning products, and analytics workflows. If users do not understand what kind of system they are using, they may treat a draft as a verified answer or paste private material into a tool without thinking about data rules.
Understanding LLMs also helps people ask better questions. A prompt that includes the task, audience, source material, and constraints usually gives the model a clearer path. That does not guarantee accuracy, but it reduces ambiguity. It also helps the user separate generated wording from facts that still need a source.
This matters for teams as well as individuals. A teacher may use an LLM to create practice questions, a manager may use one to rewrite a policy summary, and a developer may use one to draft code. In each case, the model output can save time, but the user still owns the decision to check fit, evidence, and risk before using it responsibly.
How It Works
At a high level, an LLM turns input into smaller text units, processes those units through a model, and predicts what should come next. Modern LLMs are strongly shaped by the Transformer architecture, which introduced attention-based sequence modeling in the 2017 paper "Attention Is All You Need" [2]. That paper is an important origin point for today's model architecture, but it does not by itself define every modern LLM, product, training method, or safety system.
During training, a model learns statistical patterns from data. During use, the model does not normally retrain on your prompt. It uses the prompt and the available context to generate an output. Google's LLM introduction is useful for language-model mechanics such as tokens, context, prediction, and generated text, but vendor education pages should not be treated as the only authority for risk or safety claims [1].
Many deployed assistants add extra systems around the model: instructions, retrieval, safety filters, tool calls, logging, product policies, and user-interface choices. Those systems can improve usefulness, but the visible answer is still generated language. OpenAI's own user guidance says its systems may be inaccurate and that users should verify important information; that guidance is useful as vendor-specific advice, not as a universal guarantee about all AI systems [4].
The difference between training and use is especially important. Training shapes the model before the user arrives. Prompting gives the model task-specific context during an interaction. Retrieval tools may add outside documents. Product rules may block some outputs. When a user sees one answer, all of those layers may be involved, so it is too simple to say "the model knew" or "the model looked it up" without knowing the system design.
End-to-End Example
Imagine a manager pastes a new return policy into an AI assistant and asks: "Summarize this for frontline support staff in five bullets. Use only the supplied policy. Flag anything that needs legal review." The LLM reads the prompt and the pasted policy as context, then generates a summary that follows the requested structure.
The result may be a strong first draft. The manager should still check whether each bullet is supported by the policy, whether any condition was dropped, and whether the legal-review flag is sensible. If the policy says refunds depend on country, product type, and purchase date, the user should verify those details in the source document before sending the summary to a team.
Common Misconception
The most common misconception is that an LLM works like a database. A database stores records and returns matching records. An LLM generates likely language from context and learned patterns. It may produce a correct fact, but the mechanism is not the same as opening a trusted record and copying the answer.
That distinction matters. If you ask for a definition, a draft email, or a list of questions to consider, generation can be useful. If you ask for a legal citation, customer-specific account detail, medical dosage, or a current policy deadline, you need an authoritative source and a review step.
Risks And Limitations
LLMs can hallucinate, reflect bias in data or design choices, miss information outside the context window, and respond differently to small prompt changes. They can also expose risk when users paste personal, confidential, regulated, or proprietary information into a tool without checking the policy for that tool.
A longer answer is not necessarily a better answer. A confident answer is not necessarily a verified answer. A citation-looking string is not necessarily a real source. Prompting can improve the shape of the output, but it cannot guarantee truth. Human review can catch many problems, but it also fails if the reviewer lacks time, context, or expertise.
Practical Judgment Checklist
Before relying on an LLM answer, ask: What source material did it use? Which claims matter? Which claims are opinions, summaries, or guesses? What would happen if this answer were wrong? Is any sensitive data included? Do I need a human expert, a primary source, or a second system check?
Use LLMs for drafting, explanation, brainstorming, summarizing supplied text, and making work easier to start. Slow down for decisions involving money, health, law, safety, employment, private data, security, or public claims. In those cases, treat the LLM output as a draft that must be checked against real evidence.
A practical workflow is to ask the model for a structured draft, then separate the output into claims, recommendations, and style choices. Style choices may only need editing. Recommendations need judgment. Claims need sources. This keeps the tool useful without letting fluent language replace verification.