Interactive articleTinker with the stack that drives your AI service

Anatomy of an AI “model”

Everyone nods along when someone says "ooh, new AI model". But what actually makes it tick?

Let's pull an AI chat apart and see which bit the model really is.

See the stack

0 of 3 layers removed
Appthe window you type in
Toolssearch, weather, code
Harnessinstructions, memory, turns
Model
text in, next text out

What you see

in the app
AssistantSaved chats · New chat

What the model gets

sent every turn

          

Meet the layers

You've probably used all four today without noticing.

Here's what each one actually is, how you'd spot it at work, and some places you've already met it.

App

The window you type in. It handles the look and feel, your saved chats, file uploads and the voice button. It doesn't do any of the thinking.

How you spot it

Chat bubbles, a history sidebar, an upload button, a "new chat" button.

Where you've seen it

ChatGPT website and appClaude appCopilot in Word and OutlookYour intranet chatbotSlack bots
Harness

The code running the show behind the window. It writes the hidden instructions, decides which bits of your chat to re-send, and runs the loop that lets the model take several steps in a row.

How you spot it

The bot sticks to company rules, remembers what you said ten minutes ago, and works through a task step by step without you poking it.

Where you've seen it

The hidden prompt behind every chatbotClaude CodeCursorGitHub Copilot agent modeLangChainAgent SDKs
Tools

Things the harness runs on the model's behalf. The model asks for one, the harness runs it, and the result comes back as plain text.

How you spot it

"Searched the web", "Ran code", or an answer that quotes your own company's documents.

Where you've seen it

Web searchRunning Python for chartsSearching SharePoint or Confluence (RAG)Email and calendar connectorsMCP servers
Model

The trained engine. Text goes in and the next text comes out. It lives in a data centre, and you pay for it by how much text it reads and writes.

How you spot it

A model picker dropdown, or a line in your company's AI policy saying which provider you're allowed to use.

Where you've seen it

GPT (OpenAI)Claude (Anthropic)Gemini (Google)Llama (Meta)Mistral

So what's a new AI model?

It's a new engine dropped into the same plumbing.

Keep the harness and tools exactly as they are and swap out the engine in the middle. Here's Anthropic's Claude line-up, from smallest to biggest. It's the same question every time, so pick one.

Appunchanged
Toolsunchanged
Harnessunchanged
Sonnet
Speed
Cost per question
Depth on hard jobs

These bars are rough and relative, not benchmarks.

Our checkout API got slow after Tuesday's deploy. What should I check first?

The answers are illustrative and written to show the difference, so real outputs will vary. Each model also gets upgraded over time, like Opus 5 becoming Opus 5.5.

Bigger isn't automatically better.

You don't need Opus to tell you what's for lunch, and you probably don't want Haiku running your incident.

The model guesses the next words.

Everything else is plumbing.

Memory, live info and actually doing things all come from the harness and the tools, not the model.

I've watched teams blame "the AI" when the real problem was the plumbing around it. Call me biased, but check the harness first.

ChatGPT, Copilot, Claude and your work chatbot all run on this same stack, with different parts inside.

Summary breakdown of the layers

Model
Guesses the next words.
Harness
Re-sends your chat, adds hidden instructions and runs the tools.
Tools
Lookups and actions that hand their results back as text.
App
The window you type in.
Wrapper
Someone's app and harness built on top of someone else's model. That describes most "AI startups".