Anthropic gives third-party auditors ’employee-like access’ in AI industry first
Source: ZDNet ·
As AI labs continue to self-regulate, external evaluators play a crucial role in spotting risks.
From the source
On Thursday, Anthropic announced that it will “give employee-like access” to six evaluators from METR, a third-party nonprofit that tests frontier models. Also: Claude sent a false homicide tip to police – and it’s part of a troubling AI pattern The employees have been given Anthropic hardware and office space, and can access “internal tools and systems that are roughly on par with what our own risk assessment teams have access to,” Anthropic said. “Outside a small number of clearly defined categories (e.g., data about customers, attorney-client privileged information, or information about our model architectures), Anthropic employees are encouraged to share information with them just as they would with a fellow employee working on alignment risk.” METR will publish its findings, none of which Anthropic is allowed to withhold, but the company will ask METR to redact sensitive information where necessary. Anthropic CEO Dario Amodei proposed embedding evaluators from nonprofits like…