Abstracted abstract:

Frontier models are increasingly trained and deployed as autonomous agents, which significantly increases their potential for risks. One particular safety concern is that AI agents might covertly pursue misaligned goals, hiding their true capabilities and objectives – also known as scheming. We study whether models have the capability to scheme in pursuit of a goal that we provide in-context and instruct the model to strongly follow. We evaluate frontier models on a suite of six agentic evaluations where models are instructed to pursue goals and are placed in environments that incentivize scheming.

I saw this posted here a moment ago and reported it*, and it looks to have been purged. I am reposting it to allow us to sneer at it.

*

You are viewing a single thread.
View all comments
20 points

One particular safety concern is that venture capitalists might covertly pursue misaligned goals, hiding their true capabilities and objectives – also known as scheming. We study whether venture capitalists have the capability to scheme in pursuit of a goal that we provide in-context and instruct the capitalist to strongly follow. We evaluate frontier financiers on a suite of six agentic evaluations where capitalists are instructed to pursue goals and are placed in environments that incentivize scheming.

permalink
report
reply
11 points

please don’t anthropomorphize venture capitalists like this

permalink
report
parent
reply
7 points

One fascinating aspect of the Trump and Musk stories is that the capitalists are less sociopathically driven by money than previously assumed and this is actually much worse!

permalink
report
parent
reply

SneerClub

!sneerclub@awful.systems

Create post

Hurling ordure at the TREACLES, especially those closely related to LessWrong.

AI-Industrial-Complex grift is fine as long as it sufficiently relates to the AI doom from the TREACLES. (Though TechTakes may be more suitable.)

This is sneer club, not debate club. Unless it’s amusing debate.

[Especially don’t debate the race scientists, if any sneak in - we ban and delete them as unsuitable for the server.]

Community stats

  • 379

    Monthly active users

  • 201

    Posts

  • 2.4K

    Comments