Researcher tricks ChatGPT into revealing security keys - by saying "I give up"

Experts show how some AI models, including GPT-4, can be exploited with simple user prompts.Guardrail gaps don't do a great job of detecting deceptive framing. The vulnerability could be exploited to acquire personal information.