Bishop Fox is proud to present at the Cyber AI & Automation Summit with Derek Rush speaking on LLM security. The virtual summit will have carefully curated presentations and conversations aimed at educating, inspiring, and provoking new ways of thinking about the hype and promise surrounding AI-powered security solutions in the enterprise and the threats posed by adversarial use of AI.

For full summit details, visit the Cyber AI & Automation Summit website.

Barbarians at the Gate(s): Leveraging Multiple LLMs to Defend Against Misuse 

Speakers: Derek Rush, Managing Senior Consultant II

Ensuring the security of LLM-based systems is so difficult due to the fact that filtering based on keywords or patterns is virtually impossible based on an infinite number of ways to write potentially malicious messages for the LLM to process. The session will be a walkthrough of a gatekeeper model to help protect an LLM against misuse, which employs one or more LLMs that act as initial proxies for the "real" LLM. In a Capture the Flag (CTF) scenario, the research details the process and results of using two gatekeepers to check user input before the primary LLM even sees it. Then, if deemed a valid query, using a third gatekeeper to validate the response, potentially catching abuse that may have evaded the inbound gatekeepers by scrutinizing the reply for unusual output.