Artificial intelligence evaluators are being called upon to audit powerful new models. They work on behalf of the companies that create these systems. As concerns about serious risks from artificial intelligence grow, policymakers are turning to these evaluators to mitigate those risks.

Governments are starting to establish standards for these evaluators. Recently, a law was signed establishing standards for independent verification. This is part of a broader effort to address concerns around artificial intelligence.

Further details about the role of AI evaluators and the challenges they face are available. This includes issues like conflicts of interest and the difficulty of auditing certain technologies.