Enjoying this issue?
Get tomorrow's AI & engineering digest in your inbox — hand-picked, summarized, and always spam-free.
TLDR
Learning to build software is still worth it, but the focus shifts from writing code to 'intent engineering' – communicating intent to AI agents. The viral 'reverse engineer anything' repository works because the existing app provides a perfect reference, but most tasks require humans to craft that reference. As AI improves, skills like intent engineering and harness building become more important, while prompt engineering becomes less important.
Key points
Intent engineering – communicating intent to AI agents – is the most important skill for engineers.
The 'reverse engineer anything' repository succeeds because the existing application provides a clear reference for the agent.
The speaker proposes a test: if the next model is twice as good, does the skill matter more or less?
Prompt engineering and crafting rule files are becoming less important as LLMs improve.
Engineers should become 'engineers of the harness' rather than engineers of the codebase.
Tools mentioned
Techniques
- intent engineering
- harness engineering
- reverse engineering (for AI agents)
- PRD-driven development
- software factory workflow
Stop scrolling. Start reading smarter.
Receive the day's most important AI & engineering updates in one concise email. No spam.
Transcript (captions)
reverse engineer anything. This is the latest viral GitHub repository and it is genuinely fascinating. It's a really good example of what we're able to accomplish with agents when we have
proper harness engineering. But I'm seeing this all over the place right now. People are completely blowing this out of proportion, saying if agents are able to do something this difficult, it
means that coding and engineering is entirely solved and we don't even have to apply our minds to it anymore. Or at least that's coming very soon. But there is a very specific reason why agents are
so good at this task in particular. And so we'll talk about this today and how that kind of plays into the larger conversation I want to have here, which is what is even worth learning as AI
starts to take over more and more complicated tasks like this. And I get it. With all the hype around AI and the doom and gloom in the engineering space, like this tweet that went viral last
month, it might genuinely feel like to you that it's less important for us to invest in the skills of building as AI gets more capable and we're just simply becoming meat proxies where agents are
getting good enough where we're just going to delegate all of the critical thinking to them. But this is not the way to go. I firmly believe that there are some skills that actually become
more important for us to invest time into as agents get more capable because not everything is reverse engineering. There are certain tasks that agents completely knock out of the park, but
that doesn't mean we can just extrapolated to it solving everything. So, keep this repository in mind cuz we'll come back to it in a second. But first, I want to hit the nail on the
head here. The big question that I've been teeing up is, is anything still worth learning with AI? And spoiler, yes, very much. There are skills that we want to be investing in. And the biggest
reason is large language models can't read your mind. No matter how powerful they are, you still have to have the larger harness around the agent to properly communicate your intent. That
is the shift that we're seeing in the engineering space. So agents do genuinely write all the code. I haven't written a single line of code myself in over a year. So I delegate the coding,
but I'm very much a part of the planning up front and the validation at the end. Even if I have a very elaborate harness with a super good large language model and I trust it to write very clean code,
I still need to make sure that I'm getting what I actually want. So if the agent makes a mistake, it's actually more my fault that I didn't properly communicate my intent. And so I need to
have the harness up front where it's grilling me with questions, getting on the same page, validating my intent at the end as well. This is never going to go away. And the skill of communicating
our intent and building the harness around the agent to allow us to do so is only ever going to get more important as we task our agents with accomplishing harder things. But the problem is
exactly because agents are so good at the middle part. Everyone is tempted to become a meat proxy. I mean, I've dealt with this temptation myself. Wherever I might receive a request like a Jira
ticket or something from a teammate, I'm just going to dump that right into my coding agent without any planning, any critical thinking of my own. And then whatever I get back out from the agent,
I just spew that back into Slack or as a pull request, whatever that might be. And so in this situation, the person giving the original request may as well have just gone to the coding agent
themselves because you've added no value in going through this process. But the code is still on you, right? Like as an engineer, you still have to take responsibility for the output even if
you didn't apply any of your own critical thinking. So you better make sure that you've communicated your intent properly because if you really are just a meat proxy, I can guarantee
for most tasks, the agent is not going to do it as you actually need because it doesn't understand the nuances of how you want to fix the bug or the feature you want to build, whatever that might
be. The point is, you absolutely do not want to be that person where if you get asked a question in Slack, you just dump it to your coding agent and then you reply, "Claude said," and then here's a
giant AI response. You make the other person review. This is the ultimate form of being a meat proxy. Okay, cool. I get it. But if it's so important for us to communicate our intent properly and
build that larger harness to make that possible, like I'll talk about more in a little bit, how can we have examples like this? I mean, with reverse engineer anything, if you take a look at the
readme here with their quick start, it is a very simple request to reverse engineer any kind of application. And with this MCP, I mean, the reason this GitHub repo blew up is because it is so
incredibly easy to build anything, to reverse engineer anything with it. But like I said at the start of the video, there is a very specific reason why this works. Think about it. The reason this
works so incredibly well is because the application that you are reverse engineering literally is the intent. You need nothing else to communicate properly what the final product should
be because the final product is already there. And so the agent is constantly able to validate its own work 100% reliably because it's able to see what it's building right now. Does that align
with the features or the behavior of the application that it's reverse engineering? That is why this process works so incredibly well. And of course also added in is the fact that there's a
very well-designed harness here. So of course that is important as well. But even with a harness generally you have to do a lot more of that intent engineering. But here you don't need to
because you already have it. That's why I think people are so wrong when they say that this repository proves that soon agents will be able to build literally anything. It's not a fair
example because it has such a good reference. Now, a lot of the things that we build, there are good references we can give the agent and you do want to do that as much as you possibly can. But
for most of what you build, it's simply going to start with an idea in your head or someone who's assigning you the task. And in that case, it is still up to you to communicate the intent with your
agent. if you just give it a vague idea, if you're just the meat proxy, you're going to produce good code because LLMs write good code, but it misses the point of what you actually want to build. And
so most of the time when you aren't, you know, reverse engineering an app and you don't have that clear example, you essentially have to make the reference, right? Like this is where as builders,
we still very much have to apply our own critical thinking because we have the agent gorillas with questions. We're answering these and actually putting a lot of thought into them as we should.
We're building up that reference with documentation like a PRDA, a plan document, whatever that might be. The point is we build the reference for the agent to go off of so it actually
understands what we want in the end. And so with all that being said, the most important skill to invest your time into right now as AI gets more and more capable is building the harnesses around
communicating your intent. So giving it references and allowing it to discover references when possible. Otherwise, going through the process of essentially building your own. A lot of people call
this intent engineering. Whatever it is, the point is you have to be able to recognize, apply your own critical thinking to know when you can give it examples and when you have to
essentially craft a replacement. Right? I've always said for years, examples are the most powerful thing for large language models. And it doesn't matter how powerful the LLM is, it still needs
that to really know what you actually want. The sponsor of today's video is Firecrawl. They call themselves the context API for AI agents. I covered their incredible search a few weeks ago,
but this time I want to show you Alexandria, which they just launched. It is a knowledge library, a massive catalog of over 100 data providers your agents can pull from directly for things
like benchmarks, company data, job boards, podcasts, and Firecrawl's own indexes for research papers and developer docs. And I'm able to access Alexandria directly in my coding agents
like Claude Code through the Firecrawl MCP server. So here I asked it to use Alexandria to answer the question which openweight model gives me the most intelligence per dollar for coding
agents right now which is a genuinely interesting question for me. And so first it calls into Alexandria to figure out the right data provider and then for free it can determine the cost of
searching through that data provider and then after that just a single call to pull the full leaderboard and get me the answer. And now that I found this model I want to hook it into my cloud code.
And so Firecrawl also offers their developer index which allows me to quickly search through a bunch of GitHub issues, pull requests, readmes, documentation. It finds the setup very
quickly here to incorporate this model with Cloud Code and even find some gotchas from the GitHub issue list for the Cloud Code GitHub repo. Firecrawl is free to get started with a,000 credits
per month and browsing everything in Alexandria doesn't cost anything. I'll have a link to them in the description. Now, not everything is reverse engineering where we have the perfect
reference. But for a lot of what you build, you can give a reference or even craft one for at least part of your intent. And so I want to give you an example of that from my own work. And
then I want to end the video by covering the test to help you identify as LLM get more capable. Is a skill still worth learning? Because yeah, there's a lot more than just intent. I don't want to
just leave you with that, even though that is the main example for this video. Cool. So now let me show you an example from my own work. So I've been spending a lot of time refining my AI software
factory recently and building a lot of different applications with it just to test it out. And so I've covered my software factory a lot on my channel already. I'll link to a video right
here. But the main idea is that you give it a PRD where you've done a lot of planning and of course communicating your intent. And then the factory is responsible for autonomously splitting
it into tasks and then knocking them out each one at a time to build out your full application. So very autonomous, but you're still very much a part of the process building that initial PRD. And
so I've been experimenting with this a lot throughout the year, and it's getting really, really good now. And so this is an example of a game that I built with it. And so I let the factory
go for maybe like a dozen laps to build out the initial proof of concept for this. And it's a it's a great game. And so genuinely, like this isn't like something I'd go and publish on Steam
right now, but it's a good starting point. I could definitely build on top of this. But the problem is the real game. I didn't actually want to be 2D like this. I really wanted a 3D game.
But the problem is I'm not a graphic designer or an artist in any way. I actually had trouble figuring out how I wanted to communicate that this needed to be 3D to the agent when I was first
building the PRD. Without a reference, it was really hard for me to get the agent to actually do a good job making something 3D. And so I ended up having to settle for this this 2D version of
the game. So, it works well, but it's not what I actually wanted because I failed to communicate my intent. And the reason I know it's not the agent's fault is because of what I'm about to show
you. And so, going along the same lines as reverse engineer Anything, I figured instead of trying to meticulously explain the 3D graphics and exactly how I wanted it to look, what if I gave it a
reference to work towards and set up the workflow in PRD to actually have it build towards that and then compare things side by side to validate. And that is exactly what I did with this
game. I've always really loved the graphics of this Legends of Zelda game. It's super unique cuz it's not fully 3D like, you know, Super Mario Galaxy or like of course a firstp person shooter,
but it's also not like fully top down like Pokemon cuz that honestly is more like just top down 2D. I don't know. I just I love these graphics. And so I figured what if I give this to the
agent? I plan with it up front like here's the game I want to emulate the graphics of maybe just a little less toyish and then I want you to constantly compare the output of the game to this
and just align on the graphics over time. And so this worked really really well. So here is a very initial proof of concept for the game that I built with the factory using the Legend of Zelda
game as the graphics reference. This is the first time I've actually attempted a 3D version of this game probably like five or six times already. This is the first time it actually looks close to
what I wanted because of this whole, you know, harness around validating against the graphics of the other game that I specifically chose. And there's a lot of planning and designing that went into
that. So, I definitely applied my mind. A lot of critical thinking went into getting here, even though I'm using a software factory with a very autonomous version of AI coding. But, I love this
and I just got started building this. Literally, I've had the factory only running for like a day or two on this application, but it's already starting to look really, really good. And just
for fun here, I'll show you what a battle looks like. Kind of like what we had with the 2D version of the game. Definitely a lot of things I have to tune up like this weird circle appearing
once in a while. U but yeah, like the combat is actually pretty smooth. Yeah, the game is just fantastic. And the important thing here is with every failed version of the 3D game, I'm using
the most powerful LLM, Opus 5.5, with a very elaborate harness, my software factory. yet I still need to spend a lot of time communicating my intent because without that your agent will write good
code that misses the point. That's why it is the most important skill to learn and it doesn't matter how much more powerful LLMs get. And so that segus really nicely into the test. We've
talked a lot about communicating our intent as the most important skill, but there's a lot of other important skills as well. The question to ask yourself is if the next model is twice as good. Does
this particular skill we're analyzing matter more or less? And I would say if it matters the same amount, it's, you know, obviously still worth putting your time into learning it. And there are a
lot of things that matter less. Now, as LLM get more capable, we have to deal with prompt engineering less. Like those little tricks that used to help you get better output just don't matter anymore.
We don't have to roll our own loops. LLMs do a lot of reasoning and walking themselves through a workflow automatically. And we have things built in harnesses like /goal. Giant rule
files. Even especially in the last few months, we've learned that really long rule files trying to communicate all of our constraints and conventions can sometimes just bloat the agent more than
help. LLM don't need to be taught general software engineering principles, for example, like they used to be maybe a couple of years ago. And it's crazy because even a year or two ago, these
things used to matter a lot. like prompt engineering and crafting good rule files, but it's just not where you should be investing your time. Where you want to invest your time is everything
at the bottleneck with the planning that you do before writing the code and the validation after, right? especially communicating your intent, but even just like the harness engineering as a whole,
building your skills and sub agents and hooks and bringing that together into the more comprehensive system for your agent. Like what I'm working on with the software factory, what the person
engineered for reverse engineer Anything, right? For every single powerful system, there's someone who's put a lot of critical thinking into this system to set the agent up for success.
Because as LLMs get more and more powerful, we're just going to give it harder and harder tasks. And so we still need our conventions and workflows built in. And so yes, we're not going to focus
as much on the rule file and dedicating hours and hours and hours to crafting out like we did before, but going up to the higher level. This system is still very critical. Like I always tell
software engineers, we are no longer engineers of the codebase. We have delegated that to the agent. Instead, we are engineers of the harness for the agent, setting it up for success and
using every mistake as an opportunity to make our agent better. And so, for some engineers, they don't like this. You might like coding, but you don't like building these harnesses. I get it. It
doesn't jive with everyone. If that's you, I am truly sorry. Like I understand that your role might not be as fulfilling, but at least for me, and I hope this is for you as well, building
these harnesses is very satisfying and fulfilling because you're getting the job done in the codebase just in a different way. And it's so cool to see your harness get better and better over
time. That data flywheel making it so you just operate more and more efficiently, assuming you're applying your critical thinking to build it out, and you're always making sure that you
communicate your intent and you're a part of that process. And so with that, that's everything I had to cover in this video. I hope the test was helpful, just helping you think about what are the
skills still worth investing your time into because there are definitely still a lot even with LM's getting so capable, especially with this biggest example here of we always need to communicate
our intent and have a part of the harness for that. And so I hope that you found this useful. And if you're looking forward to more things around agentic engineering and what I've covered here
with intent engineering, I would really appreciate a like and a subscribe. And with that, I will see you in the next