Paving the Road to Production: Governed Enterprise AI Agents — Harish Gaggar, Credit Karma
A Credit Karma engineer reports that a context optimizer which prunes, re-ranks, dedupes, and compresses payloads before they reach an LLM cut tokens for the same Artifactory query from about 24,000 to 2,400, a roughly 90% saving, with 70-78% savings typical. The broader talk is a blueprint for governed enterprise agents: a centralized MCP gateway for authentication and routing, custom MCP servers, memory, tracking and eval, PII blocking, and human-in-the-loop approvals. The concrete token numbers are the most useful evidence here; everything else is proposed architecture rather than measured results.