Do not mix code and input data.
Right. I don’t know how the hell someone managed to reveal their OpenAI key to the LLM itself
I don’t think it gave him the openAI key, he just had the ability to send as many hijacked (not game related) prompts as he wanted through the game on the devs’ dime.
Which, now given the ability to inject arbitrary code, you could conceivably now write code to list every variable it had access to.
They didn’t. The point was that the guy could use their implementation freely as if he was paying for a chat gpt license. Basically he made the ai let him run any query he wanted trough it so he just has unlimited access to the paid version of chat gpt at the company’s expense
It’s kind of magic how we are finding that having a third party resolves a lot of the issues. I wonder if the future structure will rely on more of a Prompt > Filter AI > Generative AI > Filter AI > Output. It seems ChatGPT and the Bing implementation have at least some level of AI detection on the image side already.
We tried this same solution six months ago. It works, ish, but it can still be circumvented. It’s not foolproof enough to trust with any situation where you need real security / confidentiality.
If you haven’t played Gandalf try it out. It will teach you how to craft attacks against these kinds of strategies.
Once they explained the problem I instantly thought this would be a great job for a LLM haha
The technology worked great, but let me tell you, no amount of regular expressions stands a chance against a 15 year old trying to text the word “penis” onto the Jumbotron.
