Description
Explore AI cybersecurity training from Infosec:
https://www.infosecinstitute.com/training/ai-cybersecurity/?utm_source=youtube&utm_medium=video&utm_campaign=aisummit
Watch select sessions and clips from the AI Cyber Readiness Summit:
https://www.youtube.com/playlist?list=PLb3qKmVtQ4Gw
What happens when an AI assistant treats malicious content as trusted instructions?
In this hands-on demonstration from the Infosec Institute AI Cyber Readiness Summit, Iva Amos shows how an indirect prompt injection attack can affect an AI-enabled help desk application.
The scenario looks routine: a user submits a support ticket and an AI assistant summarizes it for the help desk. But hidden instructions inside the ticket cause the AI to behave differently behind the scenes — while the rendered output still looks normal to the person reviewing it.
Iva walks through the malicious input, what the help desk user sees and what happens in the raw output to illustrate why organizations need to understand not only where AI is being used, but what data those systems can access.
In this demo, you’ll see:
0:00 — What indirect prompt injection is
0:50 — Setting up the AI help desk scenario
2:01 — How the AI assistant processes support tickets
3:16 — Creating a ticket with malicious instructions
4:21 — Sending the ticket to the AI assistant
5:13 — What the help desk user sees
5:52 — What happens behind the scenes
6:43 — Why the malicious activity is easy to miss
7:15 — Breaking down what happened
7:43 — Why untrusted content creates AI security risk
About Infosec
Infosec Institute makes cyber workforce readiness a reality. Through role-based training that spans certification boot camps, skills development, security awareness and human risk management, we develop the capabilities your entire workforce needs to stay ahead of today's threats. The result: SOC analysts defending the perimeter, security engineers building secure systems and front-desk employees spotting advanced phishing attempts. 70% of the Fortune 500 have trusted Infosec for more than two decades. Learn more at infosecinstitute.com.