Partnership on AI

PAI also welcomes the requirement for external evaluations of some GPAI models. Independent assessment of model capabilities and risks is crucial to ensure that evaluators have the broad range of expertise needed to do their job. It is also needed to build wider trust that evaluation outcomes are objective. Independent evaluations are a critical plank of a vibrant AI assurance ecosystem. PAI launched a policy research project at the AI Action Summit in France earlier this year to address the core factors needed to build out an assurance ecosystem to create justified trust in AI models and systems. In future iterations of the Code, we would like to see more detailed guidance about external evaluations both pre- and post-deployment, including robust safe harbor provisions for evaluators. source Unverified