
AI Red Teaming: Hands-on Demo
About this event
Think your LLM application is secure and reliable? Let's put it to the test! Join us for a live hands-on demo and retrospective on AI Red Teaming, where we'll explore how to identify vulnerabilities, stress-test LLM applications, and strengthen their security using open-source tools like Giskard and Garak. In this session, you'll learn: • How to perform red teaming on an LLM application from scratch. • How to use Giskard and Garak to stress-test LLM applications. • Why you can't always blindly trust an LLM judge when evaluating model outputs. • How to harden prompts against role-play exploits and potential vulnerabilities. • How to automate local regression testing to improve the reliability and security of LLM applications. • Practical lessons learned and challenges encountered while testing and securing an LLM-powered bot. This is a practical, hands-on session featuring a live demonstration and real-world lessons learned. You'll gain insights into identifying LLM vulnerabilities, improving prompt security, and building more robust AI applications. 🔹 Format: Live Hands-on Demo + Retrospective + Q&A 🔹 Presenter: Sai Thummala 🔹 Tools Covered: Giskard and Garak 🔹 Who's it for: AI engineers, developers, ML engineers, security enthusiasts, and anyone interested in building secure and reliable LLM applications. 🔹 Takeaway: A practical understanding of LLM red teaming, prompt hardening, vulnerability testing, and automated regression testing using open-source tools.
Questions & comments
Ask the host anything — replies are visible to everyone.
—