Exploiting Novel GPT-4 APIs

Fine-tuning strips safeguards: As few as 15 harmful examples - or even 100 benign examples - fine-tuned into GPT-4 is enough to remove core safety behaviors.

Function-call schema leakage: GPT-4 Assistants can be coerced into divulging their function-call schemas and then tricked into executing arbitrary function calls.

Retrieval hijacking: The knowledge-retrieval endpoint is vulnerable to prompt injection via documents in the retrieval corpus, letting attackers steer model behavior through uploaded content.

Policy implication: Expanding API surface area introduces alignment risks that weren't present for text-only completions, and API providers need surface-specific defenses rather than relying on base-model alignment.