AI ENGINEER · 1D AGO
Deploying AI agents in group settings (e.g., family, work chats) introduces unique challenges around security, memory, and privacy that differ from single-user agents. The talk presents Judith, an agent deployed for 8 months, and discusses a security layer that guards actions rather than inputs, memory design using atomic fact extraction and relevance scoring, and privacy via per-user Lora adapters baked into the model.
[agents] [group-chat] [memory] [security] [privacy] [llm]
→ Watch on YouTube
·
→ Full summary
AI ENGINEER · 1D AGO
Nubank ships AI agents 20× faster by using simulated eval data instead of waiting on production traces. Generating evaluation data in simulation short-circuits the release cycle, enabling rapid experimentation and catching regressions before they reach users. The approach has led to significant TNPS and self-service rate improvements across multiple agents in production.
[agents] [evaluation] [simulations] [customer-support] [nubank] [snow-globe]
→ Watch on YouTube
·
→ Full summary
AI ENGINEER · 1D AGO
Morgan Stanley's AlphaLab is an agentic harness for automating quantitative research, using a multi-agent system with research, evaluation, and mass experimentation phases. The team found that building rigorous environments and evals is critical for measuring and improving agent performance, and that the true value for enterprises lies in creating these environments rather than the agent framework itself. The project has been open-sourced and shows promising results in both academic benchmarks and internal production improvements.
[agents] [multi-agent] [quantitative-research] [automation] [llm] [enterprise-ai]
→ Watch on YouTube
·
→ Full summary
AI ENGINEER · 1D AGO
Most production agent failures are not model failures but harness failures—the system that owns state, orders mutations, and proves actions. The talk presents a blueprint for agent reliability: own the state, order the mutation, and prove the action, using OpenAI's open-source agent SDK as a case study. Key failure modes include state holes, overlapping writers, dangling tool calls, approval drift, and missing edge proof, all of which can be caught by a proper receipt chain.
[agents] [harness] [reliability] [state-management] [openai] [production]
→ Watch on YouTube
·
→ Full summary