Back to Blog

Context Engineering: Is It Actually Different From Prompt Engineering?

#ai#context-engineering#opinion
Context Engineering: Is It Actually Different From Prompt Engineering?

“Context engineering” is everywhere in AI content right now — courses, newsletters, threads calling it “the real skill” that supposedly makes prompt engineering look quaint. I run an AI coding agent on client work most days, I’ve written before on this blog about token efficiency and how I structure agent instructions, and my honest reaction reading a lot of this content is mixed: there’s a real, useful distinction buried in here, and there’s also a fair amount of buzzword churn dressed up as a new discipline.

Let me steelman the distinction first, because I don’t think it’s nothing. Prompt engineering, at least how the term got used a couple of years ago, was mostly about one message: how do you word a single instruction so the model does what you want. Context engineering, as the more thoughtful writers on it describe it, is about something broader — what information is present in the model’s context at any given point across an entire multi-turn agentic session, where it came from, how it gets refreshed or discarded, and how you avoid drowning the model in stale or irrelevant material as a task runs longer. That’s a genuinely different problem than crafting one good prompt, and it’s one I deal with directly every time I set up a coding agent for a new client project.

Where I actually apply this distinction in my own work is deciding what belongs in a system prompt, what belongs in a tool description, and what belongs in a file the agent has to actively fetch. Those are three different mechanisms with different costs and different failure modes, and picking the right one for a given piece of information is a real skill that took me a while to develop through trial and error, not something I’d have called “prompt engineering” a year ago even though it’s adjacent to it. A CLAUDE.md-style instructions file that’s too long slows every single turn down; a tool description that’s too vague means the agent picks the wrong tool; context that goes stale mid-session because I didn’t refresh it after a big refactor means the agent is confidently wrong about the state of the codebase. None of that is solved by wording a prompt more cleverly.

But here’s where I get skeptical: a lot of “context engineering” content I’ve read this year is just describing good software engineering discipline applied to an AI agent’s inputs, wearing new vocabulary. Deciding what information a system needs, keeping that information current, not overloading a component with irrelevant state — none of that is new. We had names for most of these ideas before large language models existed. Calling it “context engineering” when applied to an agent’s working memory isn’t wrong exactly, but a chunk of the content trading on the term reads like it’s manufacturing a new discipline mainly so there’s something new to sell a course or a framework around, not because the underlying practice actually changed.

The tell, for me, is how much of the “context engineering” advice would have been called just “good prompting” or “good system design” a year earlier, with no substantive change to the actual technique. “Keep your instructions concise,” “don’t include irrelevant information,” “retrieve only what’s needed for the current step” — these are good pieces of advice, and I don’t disagree with any of them, but they were good advice before this term existed too. If you strip the framing away, some of it is a rebrand more than a rethink.

I’ll also admit my own bias here, because it’s relevant: I get asked by non-technical clients to explain what I’m doing when I set up their project’s agent workflow, and buzzword churn makes that conversation harder, not easier. Every time the vocabulary shifts, I have to either adopt the new term and explain it from scratch, or use my own plainer language and risk sounding out of date to a client who read a headline about “context engineering” being the new must-have skill. Neither option is really about better outcomes for their project — it’s overhead created by an industry that seems to enjoy renaming things.

Where I land: the underlying practice — deliberately managing what enters an agent’s context, when, and through which mechanism — is real, useful, and worth getting good at, and I’ve genuinely gotten better at my own client work by thinking about it explicitly instead of intuitively. But I’d push back on treating it as a wholesale successor to prompt engineering, or as some previously-unknown discipline that just got discovered. It’s closer to prompt engineering growing up to cover a longer time horizon and a bigger surface area than a single message, which is a real and worthwhile evolution — it just doesn’t need as much marketing packaging as it’s getting.

I could be wrong about how much of this is genuinely new versus repackaged — I’m reading the same public content everyone else is, not running controlled experiments on it. If there’s a specific technique under this label that’s actually novel rather than a renamed version of something I was already doing, I’d rather learn it and use it than dismiss the whole category out of stubbornness. My skepticism here is about the volume of buzzword-driven content relative to the amount of genuinely new technique inside it, not a blanket claim that nothing under this label is worth your time.