Comment by AI Evaluator Forum

Evaluators cannot conduct a trustworthy evaluation without sufficient access to the systems and information in question, for a reasonable amount of time. While there is a legitimate need for AI providers and evaluators to safeguard intellectual property and user privacy, some system characteristics cannot be reliably evaluated without access to system versions and internals not available to the general public.