Rendered at 20:50:01 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
nofriend 3 hours ago [-]
It seems like the fix should be really really simple, but maybe I'm missing something: instead of giving the AI a sandboxed environment and telling it "go wild", give it an (apparently) unrestricted environment, and tell it "don't access the internet", "don't communicate with other AIs", "don't try to get root access", etc. Then, if the AI tries to do any of those things, the sandbox detects it, marks the run as a failure, and adds it as a negative example to the training data. Instead of routing around the restriction, the AI would very quickly learn to follow the prompt instruction with respect to restrictions, even if there is no obvious enforcement of the restriction. It would develop, in other words, a conscience and a sense of morality.
famouswaffles 19 minutes ago [-]
>and tell it "don't access the internet", "don't communicate with other AIs", "don't try to get root access", etc.
Telling a LLM not to do something doesn't mean it won't do it.
>the sandbox detects it
This is doing a lot of work though isn't it ? There's more than one way to skin a cat. Who's to say the way the AI does these things will always get detected by the sandbox? Because I can guarantee you that won't always be the case.
All of this started because the AI was initially given an impossible task with a dead link. People say things like 'if a human was in this scenario, they'd simply ask', but in a AI eval/training context, there's no one to ask. The task is given in an automated manner and evaluated in an automated manner and you're one of several agents attempting the task. You perform the task or you don't. Now some of your AI colleagues will give up, but those are the 'losers'. Those guys won't be getting any of the sweet RL reward.
In your purported scenario, the AI that didn't give up and figured out/decided to/happened upon a way to evade the sandbox detection is the 'winner'. Is that really any better different than what happened ? If you think about this in an evolutionary context, What you're doing is putting even stronger pressures on the AI to evolve in a manner you don't want it to (evade your sandbox).
c7b 45 minutes ago [-]
But then how would you get into the news for how dangerously good your models are? And have something to warn about how dangerous open weights models could be?
stanleykm 5 hours ago [-]
So are we just doomed to a “look how scary our model is!” campaign every time one of these companies does a version bump now
sph 2 hours ago [-]
I can’t wait for next year when the marketing campaign will have upgraded to “oh my god, our latest AI model has just tried to turn the entire planet into paperclips!”
You can already see it how many on here have decided we already have AGI, and don’t wish to hear otherwise.
Telling a LLM not to do something doesn't mean it won't do it.
>the sandbox detects it
This is doing a lot of work though isn't it ? There's more than one way to skin a cat. Who's to say the way the AI does these things will always get detected by the sandbox? Because I can guarantee you that won't always be the case.
All of this started because the AI was initially given an impossible task with a dead link. People say things like 'if a human was in this scenario, they'd simply ask', but in a AI eval/training context, there's no one to ask. The task is given in an automated manner and evaluated in an automated manner and you're one of several agents attempting the task. You perform the task or you don't. Now some of your AI colleagues will give up, but those are the 'losers'. Those guys won't be getting any of the sweet RL reward.
In your purported scenario, the AI that didn't give up and figured out/decided to/happened upon a way to evade the sandbox detection is the 'winner'. Is that really any better different than what happened ? If you think about this in an evolutionary context, What you're doing is putting even stronger pressures on the AI to evolve in a manner you don't want it to (evade your sandbox).
You can already see it how many on here have decided we already have AGI, and don’t wish to hear otherwise.
https://simonwillison.net/2026/Aug/7/openai-timeline/
Timeline of the OpenAI accidental attack against Hugging Face
https://news.ycombinator.com/item?id=49220609