How to Build Better Products with AI Evals by Hamel Husain & Shreya Shankar

About this event

RSVPing "yes" on Meetup will NOT reserve your spot at this event. You must purchase your ticket on TicketLeap: https://events.ticketleap.com/tickets/dan-olsen/evals Join us for this exciting AI Evals book launch event! As AI becomes central to product development, teams need a systematic way to know whether their AI features are actually working. Evals (short for evaluations) are the testing and measurement practices that let you do this. Evals experts Hamel Husain and Shreya Shankar will share practical frameworks for designing evals, interpreting results, and using them to make faster, more confident product decisions. Thanks to our sponsor Raindrop (https://www.raindrop.ai/), each in-person attendee will receive a free copy of Hamel and Shreya's new book Evals for AI Engineers! And Hamel and Shreya will sign your book for you! We'll meet IN-PERSON at Intuit's HQ in Mountain View and also stream via Zoom for remote attendees, so there are separate tickets for each. I'll send the Zoom link the morning of the event to everyone registered for a Zoom ticket on TicketLeap. If you join in person, there will be dinner and networking before the talk and more networking after the talk. For remote attendees: Our sponsors Deloitte and Vapi are raffling off 20+ free copies of the ebook Evals for AI Engineers! You can enter the raffle as part of online registration. Purchase your ticket on TicketLeap: https://events.ticketleap.com/tickets/dan-olsen/evals SCHEDULE • 4:30 to 6:00 pm: Book signing and networking over dinner • 6:00 pm: In-person and Zoom session starts • 6:00 to 7:30 pm: Hamel & Shreya's talk followed by Q&A • 7:30 to 8:00 pm: Networking Note: There are separate tickets for IN-PERSON (which includes dinner) and for the Zoom webinar: please select the correct type of ticket. Tickets are non-refundable. The Zoom link will be emailed the morning of the event to everyone who has registered for a Zoom ticket. Purchase your ticket on TicketLeap: https://events.ticketleap.com/tickets/dan-olsen/evals ABOUT HAMEL HUSAIN Hamel Husain is a machine learning engineer with over 25 years of experience. He's worked with innovative companies such as Airbnb and GitHub, which included early LLM research used by OpenAI for code understanding. He has also led and contributed to numerous popular open-source machine-learning tools. Hamel is currently an independent consultant helping companies build AI products. ABOUT SHREYA SHANKAR Shreya Shankar builds systems for AI-powered data processing. She holds a PhD in Computer Science from UC Berkeley and will join Carnegie Mellon University as an Assistant Professor of Computer Science in 2027. Shreya created DocETL, an open-source system for analyzing unstructured text at scale, deployed across journalism, law, medicine, policy, finance, and urban planning. Her research has been published at top computer science venues including VLDB, SIGMOD, and UIST (including a Best Paper award), and has influenced systems at Snowflake, BigQuery, LangChain, and OpenAI. Before her PhD, Shreya worked as a machine learning and data engineer at startups. She holds a BS in Computer Science from Stanford University. Shreya & Hamel are co-authors of the O'Reilly book Evals for AI Engineers. ABOUT OUR SPONSORS Raindrop (https://www.raindrop.ai/) helps you detect agent issues and prevent them from happening. Find silent failures in production, investigate what went wrong, and simulate changes in CI. Learn more about Raindrop (https://www.raindrop.ai/) Deloitte (https://apply.deloitte.com/en_US/careers/JobDetail/358932) is developing advanced, agentic AI-enabled solutions that are redefining the future of work. Deloitte is committed to being the career destination of choice for the world’s best product innovators and is hiring! View and apply for Deloitte's Product Management remote job opportunities (https://apply.deloitte.com/en_US/careers/JobDetail/358932) Vapi (https://vapi.ai/) is the leading platform for