Start your day with intelligence. Get The OODA Daily Pulse.

Home > Briefs > Technology > Measurements for understanding the pace of AI development inside frontier labs

Measurements for understanding the pace of AI development inside frontier labs

AI systems are becoming exponentially more powerful and have begun to automate more of the process of building themselves. As the world considers slowing the pace of frontier AI development, the public needs more information. In this post, we lay out measurement tools that can illuminate three critical aspects of AI development:

  1. The extent to which AI is building the next version of itself, as opposed to being built by humans
  2. Our ability to oversee and intervene in actions that AI agents take on Anthropic’s systems
  3. The resources that power the development of more capable models

We also provide a snapshot of these metrics from inside Anthropic. It’s important to note that we would expect these numbers to shift if there were coordination on pacing the frontier, as called for by Anthropic CEO Dario Amodei.

    Full report : Anthropic outlines metrics to track AI development at frontier labs: how much AI R&D is done by AI, how well agents are overseen, and how compute is allocated.