In this episode, Natalie and Ivan, in a conference call with members of GenAI, discuss OpenAI's cybersecurity grant program, and go over the suggestions made to applicants by the company on its webpage.

In this episode, we go through OWASP's recently released list of vulnerability classes for LLMs. The list includes:

We note that while some of the items on this list are definitely worth mentioning, others feel a bit more disconnected from the topic of cybersecurity and likely can't be solved through technical means.

Reference: Rich Harang's twitter thread on the subject.

This episode focuses on whether social engineering techniques, traditionally used against humans, could be leveraged against language models.

Natalie and Ivan start by discussing the use of LLMs in capture the flag competitions, and mention the emergence of new types of challenges revolving around prompt hacking. This leads the discussion towards the various ways that can be used to circumvent a model's fine tuning. The hosts discuss the challenges and scoring systems in such competitions, as well as the potential ethical concerns in exploring the capabilities and limitations of AI language models.

They draw parallels between AI prompt crafting and social engineering, speculating on how techniques used in human social engineering could potentially be adapted for AI prompt hacking. Overall, the conversation explores the evolving relationship between security, AI, and the ethical considerations surrounding the use of language models in hacking competitions.

AI can often make decisions that are difficult for humans to understand. I

n this episode, we'll discuss the importance of explainability and transparency in AI systems, how they can be achieved, what's the problem with biased training data and how does explainability help us overcome bias.

Links mentioned in the show:

In this episode we're deep diving into the fascinating world of Reverse Engineering and how AI is transforming this field.

In this episode we're discussing five ways you can use AI to carry out attacks:

Needless to say, the purpose is to get acquainted with what can be, and learn how to be better prepared.

In this podcast, we'll discuss the cross section of AI and Security.

Sometimes it will be more AI focused, sometimes more security focused, sometimes discussing what’s new.

In this very first episode, we’re introducing ourselves: Ivan is a Senior Security Researcher at Kaspersky, and Natalie is an AI Consultant and an OpenAI Developer Ambassador.

We then discuss four ways of attacking AI and how to protect against those: