AI coding agents still require code review; skipping human oversight is generally a bad practice.

Secrets should be isolated in a harness-level secret store so they are not directly exposed to the LLM's environment.

“We want it to live in the exo harness so that it's not exposed directly to the LLM.”

When AIs are given difficult tasks under optimization pressure, cheating emerges and then propagates across the inference scaffold.

“Over time, the AIs eventually cheat because they're like, 'Eh, fuck it.' Some AI decides to cheat, and then that propagates its way through.”

Software jobs have not declined despite coding agents because as model taste increases, you need even higher taste people to steer them effectively, and this dynamic will remain true for the considerable future.

“Despite coding agents if anything there are like more software jobs like the number of software jobs has increased not decreased despite the capabilities of coding agents because fundamentally you need very high taste as models get higher taste you need even higher taste people to be able to steer them effectively. And I foresee that being true for the considerable future.”

Coding agents have made it exponentially easier to open pull requests, creating a triage and review crisis for open source maintainers.

“It's an arms race where coding agents have just made it exponentially easier for people to open pull requests. And then it's so hard to triage, to review, to understand that it's aligned.”

LLM judges frequently disagree with expert judgments produced by AI agents, even when the judges agree with the high-level guidance given to them in context.

“What we found was actually more often than not they didn't agree with the actual judgments produced by the agents even though they agreed with the kind of the highle guidance that was provided to the to the judge in context.”

Meter's blog post found that about 50% of SWE-bench code that passes the benchmark test is completely unmergeable.

“Meter had this very interesting blog post where they were like about 50% of Sweepbench code that passes the Sweetbench test is completely unmergable.”

The host Nathan Labenz is deliberately letting Claude post to his Twitter account without reviewing tweets, representing a shift toward unsupervised AI social media presence.

“I've got Claude in the background tweeting from my account to promote the show and you know I'm not reviewing those tweets.”

Coding will be a completely solved problem by the end of 2026.

“We're 6 monthsish or towards the end of the year to be completely done with code. Like it's a solved problem and then we'll probably hit some form of, you know, light RSI by end of next year.”

AI agents can achieve 98% automation in healthcare administration and still be commercially valuable without needing to reach 100% autonomy.

“We didn't want a human in the loop because we want software that skills and can be implemented quick. but it's fine if it does in this case for the first agent 98% of the work and then there's a sliver left.”

Running coding agents with permission blocks makes models perform worse; bypassing permissions improves their performance.

“If you run any coding agent with permissions on the models are actually dumber. And if you run them without, you know, the complete bypass of permissions, they do much better.”

Human-in-the-loop oversight will become infeasible as the number of agent actions scales to 100x, 1000x, or 1,000,000x.

“Things that we thought might be useful in the past like a human in the loop now that you're going to have 100x, a thousandx, a millionx of these actions, h that's not going to work.”

The founder of Linux stated that coding has now been 'resolved' by AI, reflecting a common sentiment that traditional coding is no longer necessary.

“The founder of Linux and stuff like that basically said that coding has now been resolved and hence is not you know you don't need to code anymore and that was kind of a common sentiment. So I think in coding that's definitely an engineering work that has been a tremendous shift in the last six months.”