The pace of AI model releases is accelerating, forcing safety evaluators to shift from pre-deployment to post-deployment research.

UK AISI is shifting from pre-deployment evaluations to longer post-deployment research collaborations due to the increasing pace of model releases.

“We are shifting a lot of that work not least because the pace of model releases is increasing to longer research collaborations that might go back either are post deployment or they go back further before deployment is finalized.”

Anthropic's Mythos model was available internally to Anthropic employees in February but only released to the public in June.

“We saw, for example, that Mythos was available internally to Anthropic employees in February, but only released to the public in, I think, June, actually.”