Agentic AI Night: AI Infrastructure

About this event

Join us for an evening of insightful talks, valuable connections, and great company. This one is a collaboration: CNCF Sydney x AAIF are bringing the cloud native and agentic AI communities into the same room. Everyone is shipping agents. Far fewer people are talking about what it takes to actually run them. As agentic AI moves from prototypes to production, the infrastructure underneath matters as much as the models and the agents themselves. Speaker 1: Hrittik Roy, Founding Platform Advocate at vCluster and CNCF Ambassador Talk 1: From Local Inference to Kubernetes: What Changes When Your LLM Gets Busy? Details: Running an LLM locally is a great starting point. But what happens when one user becomes hundreds, requests compete for GPU memory, and response times start climbing? This talk follows an inference request from prompt to generated tokens, explaining prefill, decode and the KV cache. We’ll explore how batching, model caching and GPU scheduling affect latency and throughput, then introduce disaggregated inference: running prefill and decode on separate workers, including when the added complexity actually makes sense. Using vLLM and NVIDIA Dynamo as examples, we’ll connect these concepts to serving models on Kubernetes and measuring what matters: time to first token, token generation speed, and GPU utilisation. You’ll leave understanding what happens inside an LLM inference request, where the bottlenecks appear as you move beyond local serving, when disaggregated inference is worth considering, and the Kubernetes building blocks for GPU workloads. Speaker 2: Olga Mirensky, Senior Staff Site Reliability Engineer at Ping Identity Talk 2: Platform Engineering for AI Agents Details: Managed agent platforms give you runtimes, sandboxes and enforcement points, but not an internal platform. Drawing on enterprise delivery in financial services and tech, this talk walks through a multi-agent architecture on a cloud managed platform, and the layer you still build yourself: policies derived from your own architecture, reusable blueprints, and telemetry across a fleet of agents. Platforms make agents fast to build. Deciding what’s worth building is still the hard part. On the night: Free entry · Food & drinks · Networking · Live Q&A Thanks to Google for hosting us, and to the AAIF team for partnering on this one. Seats are limited - RSVP to save your spot. See you there! 👋