Understand AI Marketing

What Is an AI Context Window?

Understand an AI context window as a model-specific working limit, separate it from memory and choose the minimum relevant information for one task.

3 September 2026By Michael Sweenie7 min read

An AI context window is the amount of tokenised information a model can work with for one response. It can include the current instructions, your question, selected conversation turns, supplied files, tool results and room for the answer. The exact limit and counting method vary by model and application.

If a conversation or document is too large, the application may shorten it, summarise part of it, select material, reject the request or reduce the available answer space. There is no universal rule that the oldest message is always dropped. A context window is a working limit, not long-term memory. For a useful result, include the minimum relevant current information and check what was actually available.

Context means relevant background

In marketing work, context is the background that helps a tool understand a task: audience, offer, terminology, evidence, constraints and the decision you need to make. What Does Context Mean in AI Marketing? explains how to choose that background.

The context window is the technical space in which some of that background can be supplied. It does not decide what is relevant. You do.

What sits inside the working context?

The exact surface differs between products, but a working request may contain:

ComponentExamplePractical question
InstructionsRole, task and output requirementsIs the current job clear?
ConversationEarlier turns or a selected summaryWhich previous details are still needed?
Source materialNotes, files, links or tool resultsWhich source supports each important claim?
Current requestThe question or decision nowIs the key question easy to find?
Response spaceRoom for the model's answerWill a longer answer leave less room for input?

Some interfaces hide system instructions, file processing or summaries. Treat this table as a practical model, not a promise that every product exposes every part.

Tokens are the counting units

AI systems usually count tokens rather than words. A token can be a word, part of a word, punctuation or other text unit. Images, audio, video, tool definitions and tool results may also consume model-specific tokens when a product supports them.

Google's current token documentation defines a Gemini context window as the combined limit of input and output tokens. That means a request needs space for what you send and for what the model will return. Do not assume a token number converts neatly into the same number of English words, or that two applications count files identically.

A context window is not long-term memory

Working context answers: “What information is available for this interaction?” Memory answers a different question: “What information can a system store or retrieve across interactions?”

A model can have a large context window and still not retain a fact after the task. An application can offer a memory feature while each request still has a finite context limit. A context file can provide useful background, but it still has to fit into the working interaction in the form the application accepts. How to Create Your First AI Marketing Context File in Markdown covers that broader file practice.

Why can a long conversation lose useful detail?

As a conversation grows, the available working set can become crowded by old turns, repeated drafts, pasted documents, tool output and long answers. The application then has to manage the material. Depending on the product, it may:

  • keep only selected turns;
  • create a summary;
  • remove or shorten older material;
  • refuse the request;
  • leave less room for the response.

Do not infer which action happened unless the application documents it or shows you. Even when all the text fits, a buried instruction can be missed or two versions of a fact can conflict. “Available” does not mean “used correctly”.

A simple working-context picture

Think of one response as a bounded working set:

[instructions] + [current task] + [selected conversation]
                    + [files or tool results]
                    + [space for the response]
                    = one model/application-specific context window

The brackets are not a universal interface. They are a reminder to ask what the current task needs and what the product can actually process.

A current provider example

Google's Gemini 3 developer guide lists model-specific figures including a 1 million token input context window and up to 64,000 tokens of output for the Gemini 3 models covered by the guide. The page is dated 26 August 2026.

That is a useful illustration of why capacity belongs to a named, dated model record. It is not a universal AI limit, a recommendation to paste a million tokens or evidence that a longer request produces a better marketing answer. Check the model and application you actually use.

Bigger is not automatically better

A larger window can make it possible to supply more material, but it can also make selection harder. A long input may contain duplicate, outdated or contradictory information. A model may give equal attention to a minor detail and a crucial constraint, or the application may compress part of the material.

The useful question is not “How much can I paste?” It is “What must be available for this decision?” Keep the current task, evidence, definitions and non-negotiable constraints clear. Remove unrelated background and stale drafts.

Choose the minimum useful context

For one marketing task, make five decisions:

  1. Output: What decision or deliverable is required?
  2. Facts: Which facts and constraints are necessary?
  3. Source: Which file, note or link supports those facts?
  4. Exclusions: What can be removed, summarised or linked separately?
  5. Check: How will you confirm that the key constraint was included?

For example, a brief asking for a three-line product explanation may need the audience, approved product description, prohibited claims and output format. It probably does not need the last six campaign drafts or every meeting transcript.

What to do when material is too large

First, preserve the source and identify the decision the response must support. Then split the work into smaller questions, summarise a section with a human check, or provide only the relevant extract. Label summaries as summaries and keep the original source available for verification.

If the task depends on a precise sentence, quote or number, put it near the question and ask the tool to identify the source passage it used. If the answer matters, verify the result against the original file. A shorter, well-labelled input is often easier to review than an undifferentiated document dump.

Your next step

Choose one current marketing task. Write down the output, necessary facts, supporting source, material you can leave out and one check that confirms the important constraint was included. If you cannot name the check, the context is not ready yet.

Further Reading

You Might Still Be Wondering...

Frequently asked questions

Back to Blogs