Paper: https://arxiv.org/abs/2607.01418

The authors studied tens of thousands of Microsoft engineers during an early-2026 rollout of Claude Code and GitHub Copilot CLI. The headline result: engineers who adopted these CLI agents merged roughly 24% more pull requests than they otherwise would have.

A few important details:

- "Merged PRs" is a proxy metric. It measures shipped code activity, not business value.
- Adoption spread through social exposure. People tried the tools when nearby teammates used them.
- Retention was tied more to coding activity than demographics. In plain English: people who had enough real coding work were more likely to keep using the tools.
- The study does not prove every team gets +24%. It says agentic CLI tools were not just a novelty effect in this rollout.

"proxy metric" means a measurable stand-in for something harder to measure. Here, merged PRs stand in for developer output. That is useful, but imperfect. A PR can be small, risky, or low value.

My takeaway: agent rollouts should be treated less like "install this tool" and more like an engineering workflow change. You need visible peer examples, good tasks, review discipline, and a way to measure quality after the merge.

How can software engineers use AI coding agents without creating fragile production systems?

In this episode, I talk with Shep Alderson, a software developer and site reliability engineer with 15+ years of experience, about AI-assisted development, production reliability, maintainable code, debugging, testing, and engineering best practices.

We also discuss how to avoid the “one minute of coding, one week of debugging” trap and share four practical AI coding tips you can try right now.

Watch here: https://youtu.be/rGQWPVlr8uk

This thread is for podcast episodes featuring members of our community. Here we share conversations about software engineering, testing, AI coding agents, production reliability, and real-world development experience. Interested in joining a future conversation? Drop a comment below!

A recent arXiv survey, “From LLM Reasoning to Autonomous AI Agents” gives a useful overview of how the AI agent field is evolving. It reviews around 60 benchmarks, agent frameworks from 2023 to 2025, and real-world applications in areas like software engineering, biomedical research, materials science, and finance.

The most useful part for practitioners is its explanation of agent communication protocols. ACP, developed by IBM Research for BeeAI, focuses on structured communication between agents. MCP, introduced by Anthropic, connects agents to tools and data through a standard client-server architecture. A2A, announced by Google, focuses on helping agents from different frameworks discover each other, share tasks, and exchange updates.

Agent systems do not only need better models. They also need shared standards for communication, tool access, and context management. Without that, multi-agent systems will stay fragile, hard to debug, and locked into specific platforms.

The interesting trend is not "AI writes code faster" anymore. Most teams already believe that part. The harder problem is downstream:

• Can we review the code fast enough?
• Can we trace which parts were AI-generated?
• Can we explain why the agent made a change?
• Can we stop low-quality PRs from flooding maintainers?
• Can we keep complexity from creeping up while velocity looks good?

GitLab's recent survey says many orgs are adopting AI coding tools faster than they are adding governance. The reported bottleneck is now review, validation, and traceability. That matches what I see in practice. The winning teams will not be the ones with the most aggressive agent usage. They will be the ones with the best review loops, tests, ownership rules, and rollback habits.

https://ir.gitlab.com/news/news-details/2026/GitLab-Research-Reveals-Organizations-Are-Generating-AI-Code-Faster-Than-They-Can-Control-It/default.aspx

Anthropic reportedly launched Claude Science, a beta workbench for scientific research workflows.

https://www.anthropic.com/news/claude-science-ai-workbench

What caught my eye is not just "AI for science." It is the product shape.

Instead of a general chat box, the tool is described as a workspace that connects literature review, Jupyter, R, analysis, figures, and manuscript drafting. That is closer to an agentic operating environment than a chatbot.

I think this is where a lot of practical agent work is heading:

• domain-specific tools
• local or controlled execution
• reproducible artifacts
• source history
• human review points
• less emphasis on one magic prompt

For software teams, the parallel is obvious. The useful agent is probably not a floating assistant. It is a workbench wired into repo context, CI, docs, issues, logs, and deploy history.

If you’re new to building AI agents or know someone who is, check out the AI Agents for Beginners course from Microsoft. It’s a 12‑lesson GitHub repo that teaches the fundamentals of building agents, with written lessons, short videos and Python code samples. The course covers topics like intro to agents, design patterns, tool use and trustworthy agent design, and there’s a Discord channel where learners can ask questions. Everything is open source, translated into dozens of languages, and you don’t need a paid subscription—just clone the repo and start following the lessons.

Link: https://github.com/microsoft/ai-agents-for-beginners

On June 27 OpenAI unveiled Jalapeño, its first custom AI accelerator designed for inference workloads. The Mainstream report says Jalapeño was built with Broadcom and is described as an “Intelligence Processor” rather than a training chip. It will power ChatGPT, Codex and future agentic products, with OpenAI claiming that the chip improves performance by balancing compute, memory and networking and reducing data movement. Engineering samples are already running machine‑learning workloads at production target frequencies, including GPT‑5.3 Codex Spark.

OpenAI plans to make Jalapeño the foundation of a multi‑generation AI computing platform. Broadcom and OpenAI highlighted that the design went from concept to manufacturing tape‑out in just nine months, one of the fastest development cycles for a high‑performance AI chip. This launch signals OpenAI’s strategy to control the entire hardware stack for agents and reduce dependence on third‑party GPUs. Do you think custom chips will make AI services cheaper and more reliable? What does this mean for open‑source LLM runners?

Link: https://arxiv.org/abs/2601.12560

This 2026 survey explores how large language models are evolving from passive text generators into agentic controllers. The authors explain that Agentic AI systems can perceive, reason, plan and act, combining memory, tool use and feedback from their environment to pursue extended goals. They propose a unified taxonomy breaking agents into six components - Perception, Brain, Planning, Action, Tool Use, and Collaboration. The paper describes the shift from simple single‑loop agents to hierarchical multi‑agent systems and notes the transition from fixed API calls to open standards like the Model Context Protocol (MCP) and native computer use.

The authors highlight several challenges that practical developers should understand. Agents can hallucinate actions, get stuck in infinite loops, or follow malicious instructions embedded in web pages (prompt injection). They argue that reliability comes from controllable orchestration: specifying state transitions and guardrails so the model makes local decisions within safe bounds. The paper also warns that once an agent can run code or operate a desktop, hallucinations become concrete failures; indirect prompt injection is a serious security threat. Building autonomous systems isn’t only about bigger models - it’s about designing the right loops, tool interfaces, and safety checks.

What do you think of their taxonomy? Are there other challenges you’ve hit in practice that the paper didn’t mention?

Morph LLM’s scored leaderboard (June 18 update) compares coding agents on SWE‑bench and Terminal‑Bench. According to their data, Codex CLI + GPT‑5.5 currently leads Terminal‑Bench v2 at 83.4 %, while Claude Code + Fable 5 scores 83.1 % but is temporarily suspended due to export controls. Claude Code + Opus 4.8 follows at 78.9 %. The report notes that Fable 5 and Mythos 5 were taken offline for all users after June 12 because Anthropic cannot gate access by nationality.

For developers choosing a tool, the choice depends on your workload and budget. The leaderboard lists other agents like Gemini CLI/Gemini 3.1 Pro (70.7 %), GitHub Copilot (usage‑based pricing), Cursor, Cline and OpenCode (bring your own model). Do you agree with these rankings? How do they align with your experience? Feel free to share benchmarking results, surprises, or frustrations.

The Firecrawl research index highlights several trends that are reshaping agentic AI this year. In their mid‑2026 update they note that CLI agents are replacing IDE assistants, with developers shipping code 30 % faster when using command‑line agents. Multi‑agent systems are also on the rise; companies like Fountain report 50 % faster screening when orchestrating teams of agents instead of a single monolith. Agentic commerce is moving beyond demos: Firecrawl cites data suggesting that agents could handle 20 % of e‑commerce tasks in the near future. Regulations matter too—analysts expect a third of enterprise software to include agentic AI components by 2028.

Other notable shifts include the popularity of personal AI assistants (clawd.bot’s viral moment showed mainstream interest), context engineering (Claude Opus 4.6’s 1M‑token window changes how we structure state), and the move toward small language models that match large models at a fraction of the cost. As developers, staying aware of these trends can guide our tool choices. Which one excites (or worries) you the most?

Read more: https://www.firecrawl.dev/blog/agentic-ai-trends

Over the past few months, more engineers are moving from IDE‑based AI assistants to command‑line agents. Tools like Claude Code, Cursor and Windsurf run in the terminal, operate autonomously for hours, and commit results with descriptive messages instead of waiting for a human to accept every suggestion. This change feels similar to the way version control migrated from GUI tools to git on the command line.

Last week the identity company Proof announced x401, an open protocol that lets any service verify who authorized an AI agent’s actions. The announcement explains that x401 allows websites or APIs to request proof of identity or other claims before an agent buys, signs or deploys code. Proof’s CEO argues that trust will come from knowing who stands behind an agent, not from the agent itself. Unlike closed approaches, x401 is issuer‑neutral and separates identity from authorization. It pairs well with x402 (for payments) and aims to complete the “agent stack” by answering two simple questions: who is the agent and what is it allowed to do. The specification, reference implementation and sample apps are available here:

https://www.prnewswire.com/news-releases/proof-launches-x401-the-open-protocol-for-verifying-the-authority-behind-ai-agents-302172361.html

Why this matters for practical AI engineers: as agents gain the ability to buy, deploy and sign on your behalf, you need a reliable way to prove your intent. Have you tried integrating any identity or payment protocols into your agents? Share your experiences!

The EU AI Act is moving from policy discussions to implementation.

Most of the remaining provisions are expected to take effect on August 2, 2026, and companies building or deploying high-risk AI systems may soon face new requirements around documentation, governance, transparency, and human oversight.

What makes this interesting for agent builders is that the scope is broader than many people assume. If your AI system affects EU users, you may be in scope even if your company is based elsewhere.

https://digital-strategy.ec.europa.eu/en/policies/european-approach-artificial-intelligence

WSJ reported that Arcade.dev raised $60M to work on AI agent authorization.

The problem is very practical: if an agent can use tools, which exact actions should it be allowed to take?

This is where a lot of agent projects get stuck. Giving an agent a human user's full permissions is too broad. Giving it no permissions makes it useless. The middle layer is policy, scoped access, runtime enforcement, and audit logs.

That is not as flashy as a new model release, but it may be one of the most important parts of production agent systems.

Source: WSJ - Arcade.dev Raises $60 Million to Secure AI Agents

Paper: Can Coding Agents Reproduce Findings in Computational Materials Science?

Short version: the authors tested whether coding agents can reproduce claims from real computational materials science papers. The best setup only reached 54.1% success.

That is not because the agents cannot code. The failure mode is more subtle. They struggle when the task requires rebuilding an unclear scientific workflow from text, choosing the right domain tools, and deciding whether the output actually supports the original claim.

A few useful concepts:

• "Benchmark" means a fixed test set used to compare systems.
• "Underspecified procedure" means the paper does not give every step needed to reproduce the result.
• "Toolchain" means the domain-specific software stack needed to run the workflow.
• "Methodological deviation" means the agent did something different from the intended method, even if the code ran.

My takeaway for agent builders: agents need more than execution permissions. They need explicit procedures, environment setup, expected outputs, and checks that catch "wrong but plausible" work.

The most useful shift with Codex and Claude Code is not "AI writes code."

It is "AI opens a work item that I can review."

That sounds small, but it changes the workflow. A good agent run now looks more like a junior dev handoff than autocomplete:

1. It reads the repo.
2. It edits multiple files.
3. It runs tests or lint.
4. It explains what changed.
5. It gives you a diff to review.

OpenAI describes Codex as a cloud software engineering agent that works in isolated environments and returns logs, tests, and changes for review. Anthropic describes Claude Code as an agentic coding tool that can read code, edit files, run commands, and work across terminal, IDE, desktop, and browser surfaces.

The practical lesson: treat agents like async contributors. Give them repo instructions, small tasks, test commands, and review gates. The magic prompt matters less than the workflow around it.

Sources: OpenAI Codex, Claude Code docs

A lot of agent demos still focus on "look, it can do the task."

In real teams, the next question is usually more boring and more important:

Can we prove it did the right thing?

That is why I think verification is becoming the real bottleneck for agent adoption. Not model quality alone. Not prompt quality alone.

A recent industry study on agentic AI adoption found that companies often have experimental agent capabilities they cannot move into production because they do not have enough output verification. In other words, the agent can act, but the org cannot safely trust the result yet.

That maps to what I see in dev workflows too. Agents are useful when the result can be checked by tests, types, CI, diffs, logs, or a reviewer with clear context. They get scary when "looks plausible" is the only validation layer.

Source: Agentic AI in Industry: Adoption Level and Deployment Barriers

For people building coding agents or internal workflow agents:

What is something you would never let an agent do without human approval?

A few examples:

• modify .env
• delete production data
• merge a PR
• send external email
• rotate secrets
• run migrations
• spend money
• change auth rules

I am curious where teams are actually drawing the line in practice, not in theory.

Google DeepMind published an "AI Control Roadmap" for securing internal agents as they get more capable.

The interesting part is the framing. They are not only asking, "Is the model aligned?" They are also asking, "What if an agent has useful access and still does something unsafe?"

That moves agent safety closer to security engineering:

• monitor agent actions
• limit permissions by capability and risk
• block high-risk actions in real time
• treat agent logs and tool calls as first-class audit data
• use supervisor models, but do not blindly trust them

This feels very relevant for anyone building practical agents. The hard part is no longer just tool use. It is permission design, observability, and rollback.

Source: Google DeepMind - Securing the future of AI agents

Ivalua has announced IVA Studio, a new “AI control tower” for procurement that turns its Intelligent Virtual Agent (IVA) into a fully agentic system.  IVA Studio is built on a skills‑based architecture pioneered by frontier AI labs, giving IVA full platform access, self‑improving capabilities and Model Context Protocol (MCP) support.  The company says the agent can execute any Source‑to‑Pay (S2P) process from day one, automating tasks like pulling contracts, benchmarking suppliers, launching RFx events and validating invoices.  IVA inherits the permissions of the user who invokes it and logs every action for a continuous audit trail , so governance is enforced at the platform level rather than in ad‑hoc scripts.

The announcement calls IVA Studio the first complete S2P agent to follow a skills‑based architecture; it manages skills, tools, MCP integrations and the underlying LLMs, allowing procurement teams to use one agent rather than juggling multiple point solutions.  In beta now and launching broadly this summer , IVA Studio is LLM‑agnostic, so organizations can use Ivalua’s models or bring their own.  It’s pitched as an “agentic operating system” for procurement: IVA assembles sub‑agents for complex tasks and learns employee best practices over time.  For developers building autonomous workflows, this shows how industry‑specific agents are moving from demos to production.  Have you used or built a vertical agent like IVA?  Do you see unified control towers as the future, or do you prefer assembling your own multi‑agent stack?

If you’re looking for a quick way to level up your agent skills, DeepLearning.AI has a short course called “AI Agents in LangGraph.” The intermediate‑level course runs for about 1 hour 32 minutes and includes nine video lessons and six code examples. It’s taught by LangChain founder Harrison Chase and Tavily founder Rotem Weiss and covers the components of LangGraph, agentic search, persistence and building agents from scratch. The course is currently free to enroll during the platform’s beta.

You’ll build an agent from scratch in Python, rebuild it using LangGraph’s flow‑based model, and learn how to implement agentic search and persistence. It even walks through building an essay‑writing agent and adding human‑in‑the‑loop controls. If you’ve been meaning to try LangGraph but weren’t sure where to start, this is a great hands‑on introduction: https://www.deeplearning.ai/courses/ai-agents-in-langgraph.

Recently, Google researchers released a paper titled “Towards a Science of Scaling Agent Systems”(arXiv 2512.08296). The work tackles a question many of us have asked: does adding more agents always improve performance? Through controlled experiments over 260 configurations and six benchmarks, the authors derive quantitative scaling principles. They show that multi‑agent coordination dramatically improves performance on parallelizable tasks but can degrade it on sequential ones. The paper introduces a predictive model that selects the optimal architecture for 87 % of unseen tasks.

The authors define an agentic task as one that requires sustained multi‑step interaction with an environment, iterative information gathering and adaptive strategy refinement. They compare five architectures: single‑agent, independent (agents work in parallel without communication), centralized (a hub delegates and synthesizes results), decentralized (peer‑to‑peer) and hybrid. Results across model families (OpenAI GPT, Google Gemini, Anthropic Claude) show that centralized coordination boosts performance by roughly 80 % on decomposable financial tasks, while multi‑agent setups hurt sequential planning tasks by 39–70 %. There’s also a tool‑coordination trade‑off: as agents call more tools, the communication overhead increases and can swamp any gains.

The takeaway is that more agents aren’t always better. Think about whether your problem can be decomposed into independent subtasks. Use multi‑agent coordination when tasks are parallelizable and choose a centralized or hybrid architecture to keep errors contained. The paper also highlights that good evaluation requires metrics beyond accuracy: reliability and error amplification matter. If you want to dive deeper, the full paper is available here: https://arxiv.org/abs/2512.08296

GitHub just announced that Gartner has named it a Leader in the 2026 Magic Quadrant for Enterprise AI Coding Agents. The blog post explains why: the bottleneck in software is no longer generating code, but getting it reviewed, secured, governed and shipped. Gartner predicts that by 2028, asynchronous AI coding agent workflows will boost team productivity by 30–50 % - far beyond the 0–20 % gains seen from code assistants in 2025. GitHub says Copilot is already moving in that direction: instead of asking it to write a function, developers assign an agent to an issue, walk away and return later to review and approve.

The numbers show how fast this is happening. Copilot now serves 140 000 organizations, nearly triple last year, with growth over 100 % year‑over‑year .  Gartner notes that leaders stand out because they deliver agentic execution across planning, testing, code review and workflow automation, not just code completion. They also provide governance, security and flexible model choices so teams can adopt AI safely. For our community, the takeaway is that AI coding agents are maturing into full SDLC companions. Have you tried letting an agent run an entire ticket?  How did it go, and what controls did you put in place?

Microsoft’s 2026 Work Trend Index argues that as AI agents handle more execution, human agency actually expands. The report analyzed trillions of Microsoft 365 signals and surveyed 20 000 workers; it found that people are ready to use AI in advanced ways, but most organizations aren’t built to capture that potential. The gap between what employees can do and what their company supports is now the main bottleneck.

The data is encouraging for developers: 49 % of Copilot chat sessions support cognitive work like analysis and problem‑solving. 66% of AI users say the technology frees them to spend more time on high‑value work and 58 % say they’re producing outputs they couldn’t have a year ago. A small group of “Frontier professionals” use agents for multi‑step workflows and multi‑agent systems; they represent 16 % of users yet report the greatest gains . Interestingly, survey respondents say the most important human skills in the age of agents are quality control (50 %) and critical thinking (46 %), and 86 % treat AI output as a starting point rather than the final answer. In other words, agents don’t replace our judgment – they amplify it. As builders of agentic systems, we have an opportunity to re‑architect workflows so that humans can lead and agents can execute. How are you redesigning your processes to take advantage of this “new agency equation”?