Lets Talk

GenAl Security Research

Introducing Vision To The Fine-Tuning API
Developers Can Now Fine-Tune GPT-40 With Images And Text To Improve Vision Capabilities
Learn More
What an Incredible Evening at the Al x Security Summit!
On October 10th, 2024, I spent an incredible evening in Antler Singapore.
Learn More
S-tron China - S-Talent Talk
On September 20-21, 2024, I spent an unforgettable 2 days in S-tron China at the West Bund Art Center in Shanghai.
Learn More

ChatGPT Custom Instructions: A new Prompt Backdoor Attack Surface

Background Recently OpenAI added Custom Instructions, which allow to have

KINGSOFT Docs AI Features: Vulnerabilities and Risks

Vulnerabilities Background KINGSOFT Docs is a popular word processing tool

Excessive Duty-Agent Risk in GenAI Applications/LLMs

Why this happened The following figure is a typical AI

Cross Plugin Request Forgery Attack against GenAI Applications/LLMs

Background If you are building GenAI App which include plugins,

Knowledge Files Leaked Attack against GenAI Applications/LLMs

What’s Knowledge Files based GenAI App Knowledge Files based GenAI

Meta Prompt Leakage Attack against GenAI Applications/LLMs

What’s GenAI Applications GenAI applications refer to the practical use

Subscribe TrustAI Newsletter

Get our latest GenAI/LLM security research.

Join AISecX - AI Security Discord Community

Join the AISecX towards a secure Al era. We're building a safer future together, be part of it!

Join AISecX