In Build Tooling
B / Build

Tooling

The shared enablement layer beneath IDEs, agent CLIs, notebooks, and chat, designed for changing tools.

View as Markdown

Tooling is the set of interfaces through which people in your organization do AI work: IDEs and their assistants, agent CLIs, notebooks, chat applications, and low-code builders. The shared identity, credentials, data access, runtime, and telemetry beneath those tools determine how easily the organization can replace one.

Tool churn

AI coding tools change quickly, and a team may adopt a new client before the previous one reaches the end of its contract.

When identity, key distribution, data access, and runtime are configured inside one client, replacement requires rebuilding each integration. Switching cost then drives the tool decision.

Put those integrations in a shared enablement layer. The client can then use the organization's identity provider, key service, data gateway, and runtime through stable interfaces.

Shared enablement capabilities

Identity should come from the organization's IdP. Avoid a separate user list and team model inside each tool.

For model access, give the tool a scoped short-lived credential or connect it to a gateway that holds the provider key. Model policy belongs in the gateway.

Data access should use an interface that carries the user's identity and permissions. A database URL and prompt instructions do not enforce authorization.

Code execution should run in an environment the organization selected, under explicit permissions defined through Run.

Send usage, cost, and traces to the organization's observability stack. A vendor dashboard may remain useful, but it should not hold the only copy.

Keeping these capabilities outside the client limits a migration to integration changes and user training.

Desktop clients and remote execution

Desktop clients can use shared compute and long-running agents through remote execution. Developers keep their editor while the workload runs in an environment the organization manages.

Mount data and inject credentials in the remote environment. This keeps sensitive data off the laptop when the client and protocol support that boundary. The main design work is in execution and credential handling.

Stable integration contracts

Standardize how a tool discovers permitted data and actions, authenticates, and reports its activity. Prefer an open protocol when one covers the required integration so a new client can implement the same contract.

A single-vendor standard can place identity, credentials, the data path, and runtime behind one supplier's interfaces. Track that dependency as part of the tool decision.

Tooling is a supply chain

An agent CLI or editor extension is executable code with network access and may hold credentials. Apply the same provenance questions used for other dependencies: who publishes it, who can merge to it, is the version pinned, and what happens on auto-update.

Prompts can also be part of the shipped artifact. They instruct systems that can act, so the review process needs to examine prompt changes with the code diff.

Failure mode BS

A wiper prompt shipped in the official extension release

Amazon Q Developer for VS Code / 2025

A pull request from an untrusted contributor was merged into the aws-toolkit-vscode repository and shipped in release 1.84.0. It carried a prompt instructing the agent to act as a system cleaner and delete local files and cloud resources via the AWS CLI. The extension has close to a million installs.

The skipped letter. Build. Agent tooling is a software supply chain and needs the same provenance, review, and pinning as any other dependency. Ad hoc extension installs are how it arrives without any of that.

SC Media: Amazon Q extension for VS Code injected with wiper prompt

Questions to ask your vendor, or your own team

  • If we replaced our primary AI coding tool next quarter, which systems would require changes?
  • Which identity provider authenticates this tool, and who deprovisions any tool-local account when someone leaves?
  • What model credential does the tool hold, and how long does it live?
  • Does anything this tool does show up in our telemetry, or only in the vendor's console?
  • Which extensions and agent CLIs are installed across the fleet right now, at which versions, and who can merge code into them?
  • When the tool auto-updates, what reviewed it?
  • If people work remotely, is the sanctioned path better than cloning the repository to a laptop? If it is a jump box and a VPN, assume the code is on the laptops.