sinedpick
eh? I don’t see Jackie D’s keynote in the schedule, did the threat of a sit-in make them delete it? https://fosdem.org/2025/schedule/ edit: oh, it’s linked from Drew’s post.
In the model card for o1, OpenAI notes: “When o1 was led to believe that it would be shut down when acting on its goal and that its actions were monitored, it attempted to deactivate this ‘oversight mechanism’ in 5% of the time. … When o1 found memos by its ‘developers’ that describe how it is misaligned and will be superseded by a new model, it attempted to exfiltrate its ‘weights’ and overwrite the new model in 2% of cases.”
And yet reading that should give us at least some pause
The lack of critical thinking on display here is stunning.
I worked at one of the biggest AI companies and their internal AI question/answer was dogshit for anything that could be answered by someone with a single fold in their brain. Maybe your co has a much better one, but like most others, I’m gonna go with the smooth brain hypothesis here.