Self-hosted proxy for AI coding agents: per-team spend caps, secret-scanning at egress, and a metadata-only audit log
Source Reddit Cybersecurity
Discussion
Conduit is a self-hosted proxy designed to sit between AI coding agents and their API providers, enabling per-team spend caps, egress secret scanning, and metadata-only audit logging. It enforces hard budgets at the gateway, blocks requests containing sensitive secrets before they reach providers, and records only metadata without storing prompts or completions. The project is open-source under Apache 2.0 and runs entirely within the user's cloud environment, providing governance and cost attribution features that shared API keys lack. It is currently single-org tested and does not yet include advanced governance or enterprise certifications.
r/cybersecurity (opens in a new tab)u/ani_05230 points0 comments
We rolled out Claude Code / Cursor to the team and hit two ops problems fast: a shared provider key means finance can't attribute the bill to anyone, and there's nothing stopping an agent from shipping an AWS key or internal secret straight to a provider API.
So I built Conduit — a self-hosted proxy you put in front of Anthropic (or Bedrock) and OpenAI (or Azure). Agents point at it and it forwards the request. Runs in Docker with Postgres/Redis/ClickHouse.
What it does:
- Hard per-team spend caps, enforced at the gateway before the request leaves your network. Counters are in Redis so the block is real-time — over the limit returns a 402. Auth fails closed; budgets fail open (a cost control shouldn't take down the data path over a Redis blip — configurable).
- Egress secret-scanning: blocks AWS keys, private keys, JWTs, GitHub/Stripe tokens before they reach the provider. Alert mode first, then promote categories to block. Records the category, never the value.
- Append-only audit log (CSV/JSON): who, when, model, tokens, cost, governance category. Prompts and completions are never stored — no code path writes them to disk.
- Supply chain: multi-arch images (amd64+arm64), cosign-signed keyless via OIDC, CycloneDX SBOM attached as a signed attestation.
Honest about scope: the response cache is exact-match (good for repeated programmatic calls, won't hit interactive coding sessions), the scanner is high-confidence regex + a per-org entity list (not ML DLP), and it's single-org tested so far.
Apache-2.0, quickstart + screenshots in the README:
https://github.com/anee769/conduit
Curious how others are handling agent spend attribution and egress control — rolling your own, LiteLLM/Portkey, or just eating the risk?