Summarize with AI
Anthropic has given six employees of METR, a nonprofit that evaluates frontier AI models, what it calls "employee-like access". The team gets company hardware, office space and access to internal tools and systems, roughly on par with what Anthropic's own risk assessment teams have. METR will publish its own analysis, and Anthropic cannot veto publication.
Anthropic announced the arrangement on October 15, 2026, as the top tier of a new three-tier system for outside evaluators. It also named SecureBio, Accenture and Faculty as current evaluation partners.
What METR gets
- Six METR employees, onboarded with company hardware and office space.
- Access to internal tools and systems roughly on par with Anthropic's own risk assessment teams.
- Anthropic staff are encouraged to share information with them as they would with a fellow employee working on alignment risk.
- A few categories are excluded, for example customer data, attorney-client privileged information and information about model architectures.
Publication terms
- METR will publish its analysis of Anthropic's risk levels, incidents or practices.
- Anthropic cannot veto publication.
- Anthropic can require redactions when information falls into predefined categories, and Anthropic decides what falls into them.
- METR reserves the right to make certain statements about the level of access and information it received.
Three tiers of access
| Tier | Access | Publication |
|---|---|---|
| 1 | Narrowly scoped risk investigations. Anthropic decides what access to provide. | With Anthropic's approval |
| 2 | More information | Without approval. Anthropic can require removal of specific categories of information, and evaluators can publish their views on whether the redactions were justified. |
| 3 | Employee-like access (the METR arrangement) | Rights similar to tier 2 |
Anthropic says it hopes to have several evaluators at the third tier over time.
Other evaluators
- SecureBio is reviewing the chemical and biological weapons chapter of Anthropic's August Risk Report, after a published pilot review of the previous report. Anthropic will consider projects with more access after this review.
- Accenture and Faculty are working with Anthropic toward a partnership covering model evaluation and red-teaming, alignment assessments, testing safeguards and building capabilities.
- Hugging Face is among several organizations in early discussions.
Anthropic does not say which tier SecureBio or Accenture is in.
Sources
Did this land? Leave a reaction.
Discussion
0 commentsMembers can join the discussion
Become a member to comment and reply to other members.
Become a MemberNo comments yet
Be the first to start the discussion.