Require AI systems above a capability threshold to be interpretable

For (26)

• 

  Gary Marcus

  Professor of Psychology and Neural Science

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Algorithmic transparency. When a driverless car has an accident, or a consumer’s loan application has been denied, we should be able to ask what’s gone wrong. The big trouble with the black box algorithms that are currently in vogue is that [nobody] ... more Unverified source

  1 added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Rob Strayer

  EVP Policy, Information Technology Industry Council

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Transparency is a key means by which to achieve that trust. [...] Transparency is an overarching concept [...]. Transparency requirements should be risk-based. Unverified source (2023)

  added 1mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Victoria Espinel

  CEO, BSA Software Alliance

  I am this person! Add a sourced quote Report comment

  votes For and says:

  My message to Congress is: Do not wait. Focus on high-risk AI uses. Companies should publicly certify that they have met these requirements. Unverified source (2023)

  added 1mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Ramayya Krishnan

  Dean, Heinz College, Carnegie Mellon

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Congress should require standardized documentation. Congress should require a model validation report. [...] provide the required assurance prior to deployment. Unverified source (2023)

  added 1mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Sam Gregory

  Executive Director, WITNESS

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Transparency [...] is a critical area. [...] Embed human rights standards and a rights-based approach in the response to AI. [...] Place firm responsibility on stakeholders [...]. Unverified source (2023)

  added 1mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  White House Office of Science and Technology Policy (OSTP)

  U.S. White House science office

  I am this person! Add a sourced quote Report comment

  votes For and says:

  You should know that an automated system is being used and understand how and why it contributes to outcomes that impact you. Designers, developers, and deployers of automated systems should provide generally accessible plain language documentation i... more Unverified source (2022)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Consumer Financial Protection Bureau (CFPB)

  U.S. consumer finance regulator

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Today, the Consumer Financial Protection Bureau (CFPB) confirmed that federal anti-discrimination law requires companies to explain to applicants the specific reasons for denying an application for credit or taking other adverse actions, even if the ... more Unverified source (2022)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  UNESCO

  UN agency for education, science, culture

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Governments should adopt a regulatory framework that sets out a procedure, particularly for public authorities, to carry out ethical impact assessments on AI systems to predict consequences, mitigate risks, avoid harmful consequences, facilitate citi... more Unverified source (2021)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Frank Pasquale

  Law professor, algorithmic accountability expert

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Some of the black boxes of reputation, search, and finance simply need to be pried open. Unverified source (2015)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Alan F. T. Winfield

  Professor of Robot Ethics, UWE Bristol

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Robots should be fitted with an "ethical black box" to keep track of their decisions and enable them to explain their actions when accidents happen. Unverified source (2017)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Abraham C. Meltzer

  California judge and legal scholar

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Black box AI systems "do not explain their predictions in a way that humans can understand." Unverified source (2024)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Suresh Venkatasubramanian

  Brown CS professor; former OSTP official

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Congress should demand that these systems be explainable. How that plays out will be a matter for innovation. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Information Commissioner's Office (ICO)

  UK data protection authority

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Where an individual would expect an explanation from a human, they should instead expect an explanation from those accountable for an AI system. Unverified source (2020)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Michael Bennet

  U.S. Senator from Colorado

  I am this person! Add a sourced quote Report comment

  votes For and says:

  AI systems should undergo regular public risk assessments to examine their safety, reliability, security, explainability, and efficacy. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Lloyd J. Austin III

  U.S. Secretary of Defense

  I am this person! Add a sourced quote Report comment

  votes For and says:

  So we have established core principles for Responsible AI. Our development, deployment, and use of AI must always be responsible, equitable, traceable, reliable, and governable. We’re going to use AI for clearly defined purposes. We’re not going to... more Unverified source (2021)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  AI Now Institute

  NYU institute on AI policy

  I am this person! Add a sourced quote Report comment

  votes For and says:

  1 — Core public agencies, such as those responsible for criminal justice, healthcare, welfare, and education (e.g “high stakes” domains) should no longer use ‘black box’ AI and algorithmic systems. This includes the unreviewed or unvalidated use of p... more Unverified source (2017)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  European Parliament

  EU legislative body

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Citizens will have a right to launch complaints about AI systems and receive explanations about decisions based on high-risk AI systems that impact their rights. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Christina Montgomery

  IBM Chief Privacy & Trust Officer

  I am this person! Add a sourced quote Report comment

  votes For and says:

  AI should augment humans, not replace them, it should be explainable, and fair and private and secure. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Federal Trade Commission (FTC)

  US consumer protection agency

  I am this person! Add a sourced quote Report comment

  votes For and says:

  If you are using AI to make decisions about consumers in any context, consider how you would explain your decision to your customer if asked. Unverified source (2020)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  European Union

  Political and economic union

  I am this person! Add a sourced quote Report comment

  votes For and says:

  ensure that the AI system’s output is interpretable by the provider and the user. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Chuck Schumer

  U.S. Senate Majority Leader

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Finally, explainability, one of the thorniest and most technically complicated issues we face, but perhaps the most important of all. Explainability is about transparency. When you ask an AI system a question and it gives you an answer, perhaps the a... more Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Anthropic

  AI safety research company

  I am this person! Add a sourced quote Report comment

  votes For and says:

  The definition, criteria, and safety measures for each ASL level are described in detail in the main document, but at a high level, ASL-2 measures represent our current safety and security standards and overlap significantly with our recent White Hou... more Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Reporters Without Borders (RSF)

  Press freedom nonprofit

  I am this person! Add a sourced quote Report comment

  votes For and says:

  RSF, which has already called for the AI Act to includemeasures to protect the right to information, is convinced that that these models must be regulated. But some European countries, including France, are advocating self-regulation based on codes o... more Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Cynthia Rudin

  Duke professor, interpretable ML advocate

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining thes... more Verified source (2018)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Rohit Chopra

  CFPB Director; U.S. consumer regulator

  I am this person! Add a sourced quote Report comment

  votes For and says:

  We’ve also taken action to protect the public from black box credit models – in some cases so complex that the financial firms that rely on them can’t even explain the results. Companies are required to tell you why you were denied for credit – and u... more Unverified source (2024)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Dragoș Tudorache

  EU MEP; AI Act co-rapporteur

  I am this person! Add a sourced quote Report comment

  votes For and says:

  Then the second floor, you have the high-risk applications. And the commission is proposing in an annex, in fact – and I’ll explain why in an annex – identify several sectors where if you develop AI in those sectors, again, because the likelihood of ... more Unverified source

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate

Abstain (0)

Against (12)

• 

  Dario Amodei

  Research Scientist at OpenAI

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  Many of the risks and worries associated with generative AI are ultimately consequences of this opacity, and would be much easier to address if the models were interpretable. [...] governments can use light-touch rules to encourage the development o... more Verified source

  1 added 6mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Scott Robbins

  AI ethics researcher

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  [...] principles requiring that AI be explicable are misguided. We should be deciding which decisions require explanations. Automation is still an option; Unverified source (2019)

  added 1mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Brookings Institution

  U.S. public policy think tank

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  Explainable AI (XAI) is often offered as the answer to the black box problem and is broadly defined as “machine learning techniques that make it possible for human users to understand, appropriately trust, and effectively manage AI.” Around the world... more Unverified source (2021)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  MIT Lincoln Laboratory

  MIT research lab for national security

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  As autonomous systems and artificial intelligence (AI) become increasingly common in daily life, new methods are emerging to help humans check that these systems are behaving as expected. One method, called formal specifications, uses mathematical fo... more Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Roman V. Yampolskiy

  AI safety researcher, Louisville professor

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  Advanced AIs would not be able to accurately explain some of their decisions. Unverified source (2019)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Bruce Schneier

  Security technologist and author

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  Forcing an AI to produce a human-understandable explanation is an additional constraint, and it could affect the quality of its decisions. Unverified source (2023)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  U.S. Chamber of Commerce (C_TEC)

  Largest U.S. business federation

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  If the RMF defines and deploys these concepts beyond their current development, as it will add unnecessary burdens which could stifle innovation. Unverified source (2021)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  James Broughel

  Economist focused on regulation

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  We should strive to make AI systems interpretable where possible, but not at the cost of the benefits they deliver. Unverified source (2024)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Geoffrey Hinton

  Godfather of Deep Learning

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  GH: I’m an expert on trying to get the technology to work, not an expert on social policy. One place where I do have technical expertise that’s relevant is [whether] regulators should insist that you can explain how your AI system works. I think that... more Unverified source (2017)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Pedro Domingos

  Professor of computer science at UW and author of 'The Master Algorithm'

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  But it’s potentially disastrous, because there’s often a tradeoff between accuracy and explainability. Unverified source (2018)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Peter Norvig

  Computer scientist, AI researcher

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  You can ask a human, but, you know, what cognitive psychologists have discovered is that when you ask a human you’re not really getting at the decision process. They make a decision first, and then you ask, and then they generate an explanation and t... more Unverified source

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate
• 

  Max W. Shen

  AI researcher; trust and interpretability

  I am this person! Add a sourced quote Report comment

  votes Against and says:

  The problem of human trust in artificial intelligence is one of the most fundamental problems in applied machine learning. Our processes for evaluating AI trustworthiness have substantial ramifications for ML's impact on science, health, and humanity... more Unverified source (2022)

  added 4mo ago

  

  Choose a list of delegates

  to vote as the majority of them.

  Unless you vote directly.

  Delegate