AI Coding Agents Are Breaking Big Codebases — Dan Adler, Sourcegraph

0:01 [music] Hey, welcome everybody. I'm Dan Adler, CEO at SourceCraft. It is uh great to see you all here today. Thank you so much for coming out and joining us.

0:20 Um, this is a talk today about the unglamorous but loadbearing work of owning a large complex codebase and why AI and agentic coding tools today make that job more difficult and more

0:35 important than ever before. Just to start, the software that runs the world is not pretty. It's not new. It's not clean. It's how everything actually works.

0:49 72% of software industry employment is in companies with more than 500 people. These are the large enterprises of the world. These are the companies managing thousands of repositories and decades of

1:00 codebased history. Few of your peers work at startups at the hot companies you may hear about on social media. And even fewer of them are actually like ex soloreneurs making a living off of their

1:12 um social feeds. Most of us work in large longived code bases. Those code bases are how your bank account will reject a transaction in real time if you hit your limit. They're how your

1:24 insurance carrier calculates the reimbursement rate for a policy holder with dual coverage. It's how a chip and a warehouse scanner will actually allow Amazon to tell you when your socks

1:32 arrive. It's how your Uber estimates an arrival time. It's how an airplane uses radar to uh adjust trajectories. How your paycheck gets issued. It's how your office air conditioner ticks on and on

1:43 and on and on and on. These are the things that keep the world moving. We are all completely utterly dependent on massive decades old super complex code bases that have been built over

1:58 many many years by thousands of engineers and coding agents are writing more better code today faster than we have ever seen before. A title wave of code

2:14 is coming for you. It's coming for your code base and for all of your engineers on your team who are trying to just keep their heads above water. Every one of us has felt this pain, this

2:25 flood of AI generated code that we now have to review and make sure is healthy for our codebase and we're exhausted by it. And look, there are now code review agents. I'm sure there's a lot of them

2:34 around this room right now. There are tools designed to help you measure your code base's health and so on. And look, the new the major coding agents will start to pull this stuff in. The models

2:43 will get better over time. We'll keep putting sandbags down to keep this flood held back, right? We're going to keep finding these local maxima to help ourselves sort of avoid this problem.

2:56 But meanwhile, what's happening is that these code bases, these massive ones that keep the world running are beginning to decay. millions of lines of code, tens of

3:06 thousands of repositories, way too much to fit into a context window or even just to clone and GP in real time. That's just not possible. And this is causing big problems. We're

3:17 publishing new features, new patches at record speed. There are different coding standards being applied in different places by different agents across the codebase. There's duplicated code

3:28 proliferating. You you already have a library that does this, but your agent doesn't know that. There's cross-ervice dependencies that are becoming more brittle. There are

3:37 slight deviations in standards that are creating more insidious hidden issues across the codebase. And maybe more important than anything else here, there are new vulnerabilities being uncovered

3:47 by agents every single day. They require constant constant oversight and upkeep of all of these massive legacy code bases that nobody wants to think about or deal with. The job of owning a

4:01 codebase is harder today than it has ever been before. And at the end of the day, the problem here is actually the volume of code. The call is coming from inside the house,

4:15 right? The very tools that are speeding all of us up and letting us write more code faster than ever are also the tools that are creating the conditions that will cause these massive code bases that

4:26 run our world to begin to fail. Every day I talk to technology executives at these large companies and they are feeling this so viscerally. The same pain that I imagine many of you are

4:38 feeling too, right? I want to give my devs the best tools possible. But just today, I overheard a dev say, "I don't know what this code does. AI wrote it for me." This is a tech leader and

4:50 executive at a top 10 car manufacturer. When you're writing vehicle autopilot code and you have thousands of engineers in your org that you have to manage, you want to enable, this is terrifying.

5:06 All right, here we go. So what I um deeply believe is that these codebase owners deserve better. Today's agentic dev tools are not meeting the moment for this. The

5:21 infrastructure to see and understand a 50,000 repo codebase is not being built or sold by OpenAI, by anthropic, by cursor, by the rest of them. This is a hard and unique problem. Their agents

5:34 are so unbelievably good at smalling at solving the small-cale problems that most developers deal with every day that they are their demand is growing faster than ever before. And this bigger

5:46 problem of these code bases beginning to fall apart is going unnoticed. So this session this is a call first of all off to celebrate the people the owners of these code bases people around

5:59 the world who are actually keeping them alive and keeping them running. most of our software engineer peers around the globe. So, thank you all so much for what you're doing.

6:08 But this session is also a call to dev tools companies out there, to the agent harness builders, to people who are building the infrastructure for these agents to help build the the

6:18 infrastructure, the the ability to go see and understand these massive scale repositories and give that to their agents. This is a great quote that I heard from

6:37 um a tech leader at uh one of the top 10 US banks. Tens of trillions of dollars in assets uh in custody or administration. Sure, Claude Code can uh make this

6:47 change, but I have 90,000 repositories to make it in. This is actually a specific quote about a specific supply chain vulnerability, an npm thing. won't get into it, but if

6:59 you're a bank and you're seeing agents uncover and create these new vulnerabilities at an unprecedented pace and you're being told to go use cloud code to solve this, that's a problem.

7:10 Good luck doing that in 90,000 repositories, mapping out how these code bases all come to together, what's actually living in production across your company, across your product

7:20 offerings. Because at the end of the day, right, what's really funny about all this is that, if we know anything about LLMs, is that they just love to search.

7:32 It's like a new hire getting up to speed on the codebase. It's how agents build models of the world. The repo architecture that you're plugging into your agents.md files, like, let's be

7:42 real, that's barely moving the needle here. This agent is going to grap gp gp gp gp its way to codebase understanding. That's simply how it works. But understanding is a context problem.

7:54 You can't gp what you literally cannot see. This is tools and infrastructure that's needed. And the infrastructure to go see and search and really deeply understand a 500 or 5,000 or 50,000 or

8:09 half a million repo codebase is not being built by the agent builders today. And so that's where what we're solving, what we're working on as a company. This is what source graph is built around,

8:22 right? Give this a second. If you'll let me sort of take a moment and predict the future of our industry. These massive code bases are not going away. In fact, there will be more code.

8:37 There will be much much much more code out there in the future. And we believe very deeply that building tools to give agents the ability to actually see and understand and evolve

8:50 those large code bases is essential for the future. And where this comes from at the end of the day is having a graph that code graph in mind. The foundational graph of

9:02 your codebase including search and then the actual compiler accurate output. Um, if you go and and do that analysis that is essential to give your agents the ability to go and understand how to

9:16 make changes effectively. Visibility is infrastructure. And we've actually built a lot on top of this, right? We're not stopping here. Actually, just today we launched our new

9:26 um our new agentic batch changes product into beta. This is a frontier agent uh and its job is to let the owner of a massive codebase actually execute code changes across hundreds or thousands of

9:38 repositories at once starting with a single prompt. This is a product that will iteratively roll out changes across that that codebase. Self-heal respond to CI status PR comments. Use coding agents

9:50 where it makes sense, where judgment is needed. Use deterministic scripts where it's not. and provide tracking and auditability to be sure that you've covered 100% of the places where that

10:01 patch is needed, where that change is needed. Because like I keep saying here, at the end of the day, this is an infrastructure problem. When you're

10:09 putting code out there into the world, you need to make sure that it's actually going to keep your codebase healthy, that it's actually going to make be able to um adapt to the places where your

10:17 codebase is beginning to fall apart. Here's a great quote from an early access user um uh actually at Merkari, a global um shopping tool out of Japan. Incredible company, massive codebase,

10:30 hundreds and hundreds of independent microservices running in production. This user was using um this product to go actually patch a GitHub uh code injection issue where you have to set

10:40 environment variables correctly. Um he ran this on two repos where he knew this issue existed and then said yeah go explore the rest of our codebase and found 80 other potential vulnerabilities

10:50 across their codebase in other places. This is like bas this is like config files. This is basically just going and doing that scan patching them all in one go with a sort of deterministic script

10:59 that can go make sure it's making that change consistently effectively across 100 of the places where that risk exists. That is what confidence is all about in the agent coding era.

11:12 So yeah, I'll stop here. If you're wondering right now about like how many repos in your codebase, how many forks are there out there, how many um copies of repos are there out there, how many

11:21 repos have your in your developers brought into your um company and are now being plugged in as a library or an API somewhere in your codebase that's live in production that you're not aware of.

11:31 That's the sort of thing that we're here to help. Right? If you're wondering what code is deployed right now and how you can go scan it all and see it all and make sure it's all updated, come talk to

11:39 me. And uh tonight we're actually hosting a event here in SF called Code Cocktails and Cuttovers. Come on out, join us. Um come find us. Bring your gnarliest

11:50 codebased stories. This is where we want to uh talk and hear from all of you about what you're trying to deal with and how you're dealing with the title wave of code that's coming for you.

12:01 Cool. Thank you. I'll stop there. Any questions? Thank you. >> [music]