Anthropic Becomes One of First to Allow Third Party Test of AI Dangers

Anthropic is giving six researchers from AI evaluation nonprofit METR employee-level access to independently assess its models, safety practices, and risk management.

Key points

• Anthropic, OpenAI, Google, Meta, Nvidia and xAI have additionally signed a White House agreement committing to independent review.
• Meta Muse Open is a Top New Open Weight AI Model.
• Organizations in the lowest tier, such as biosecurity nonprofit SecureBio, conduct narrower reviews and require Anthropic's approval before publishing their findings.
• After a series of incidents disclosed since late August, the move comes as reservations grow over AI agents acting outside their instructions.
• Under the arrangement, METR researchers have received Anthropic-issued laptops, office space, and access to internal tools broadly similar to what the company's own risk-assessment teams employ.

Anthropic remarked it wants to produce its decisions more publicly accountable and reduce the gap between what outside evaluators understand regarding its systems and what the business itself knows. Meta Muse Open is a Top New Open Weight AI Model. METR Gets Access Similar to Anthropic's Own Risk Teams.

Anthropic employees are additionally encouraged to share information with the researchers in the same way they would with an internal employee working on alignment risk.

Anthropic compared the setup to the banking industry, where regulators place resident examiners inside major banks. Anthropic Cannot Block METR's Findings.

METR will publish its own assessments of Anthropic's risks, incidents and safety practices.

Anthropic has given up the right to block those reports from being published.

Nevertheless, the business can require METR to redact information that falls into narrow predefined categories, including customer data, attorney-client privileged material and details regarding model architectures.

As long as it does not reveal the protected information, METR is allowed to publicly describe Anthropic's redactions and state whether it believes those redactions were justified. METR Sits at the Top of Anthropic's Three-Tier System.

METR is at present the only evaluator in the highest level of a new three-tier independent evaluation system Anthropic is building.

Meanwhile, the middle tier receives more information and can publish without Anthropic's approval.

For context, the highest tier adds the kind of employee-level access now given to METR. Claude Reportedly Resets Your Cache to Charge You More. Anthropic Had Previously Promised More Independent Oversight.

For context, the arrangement follows a proposal Anthropic CEO Dario Amodei created in a September essay, where he suggested embedding outside evaluators directly inside AI labs as an initial step toward slowing frontier AI development. OpenAI afterwards produced a similar commitment.

In practice, the new METR arrangement gives outside researchers unusually deep access to Anthropic's internal systems while allowing them to publish findings without the firm having final approval over the results. Stay Connected with ProPakistani.

Obtain the latest tech news, telecom insights, and product launches wherever you prefer. Follow on Google Discover. Follow on Google News Join WhatsApp. See more ProPakistani stories in Google Search and Top Stories.

Technology and Automotive Specialist covering the latest cars, smartphones, AI breakthroughs, and.

In short, anthropic Becomes One of First to Allow Third Party Test of AI is the central thread here, and readers can expect follow-up reporting as the picture becomes clearer.