Serkan Özcan

Audio summary0:00 / –:––
Posts
#Artificial intelligence · #Anthropic · #Independent evaluation

Internal access for AI oversight: Anthropic's next step

Testing an AI system through external questions alone may not reveal all the risks visible inside its developer. How the model was developed, how safeguards operate, and how previous incidents were handled can all affect an assessment.

In an arrangement announced on October 15, 2026 and clarified the following day, Anthropic says it has provided six external evaluators with company hardware, office space, and access to internal tools. That access is intended to be broadly comparable to what its own risk assessment teams receive.

Publication rights matter alongside access

The arrangement allows assessment results to be published without a company veto. However, redactions can be required for predefined categories of confidential information. The company retains the final decision about whether information falls into those categories, while evaluators retain rights to make certain statements about the access they received.

Customer data, legally privileged information, and some architectural details fall outside the arrangement. Describing it as unrestricted transparency would therefore be inaccurate. It offers a deeper examination under specified rules.

How I would assess it

Its value depends on an external team being able to produce its own findings rather than repeat the company's account. The scope of access, potential conflicts of interest, and the reasoning behind published assessments need to be considered together.

The first substantive reports will matter: which risks were examined, what information was unavailable, and how did those limitations affect the conclusion? Being inside an organization does not itself guarantee independence, but it can reduce the blind spots of external testing.

The cover is an AI-generated illustrative scene.

Loading…