Mustafa Suleyman

Are we committed to holding on to our place at the top of the evolutionary pyramid, or will we allow the emergence of AI systems that are smarter and more capable than we can ever be? The coming wave of technologies threatens to fail faster and on a wider scale than anything witnessed before. This situation needs worldwide, popular attention. It needs answers, answers that no one yet has. Containment is not, on the face of it, possible. And yet for all our sakes, containment must be possible. Citizen assemblies offer a mechanism for bringing a wider group into the conversation. One proposal is to host a lottery to choose a representative sample of the population to intensively debate and come up with proposals for how to manage these technologies. [...] Change happens when people demand it. [...] Anyone anywhere can make a difference. (2023) source Unverified

I honestly believe we are approaching an era of radical abundance. We are about to distill the essence of what makes us capable — our intelligence — into a piece of software, which can get cheaper, easier to use, more widely available to everybody. As a result, everyone on the planet is going to get broadly equal access to intelligence, which is going to make us all smarter and more productive. I think we are trending in the opposite direction. We are adding masses of new knowledge to the corpus of global knowledge. And that is making everyone, on average, way, way smarter and discerning. These AIs are going to catch and develop your weaknesses. They are going to lift up your strengths. We are going to evolve with these new augmentations. We are going to invent new culture, new habits and new styles to adapt. (2023) source Unverified

This is going to be the most productive decade in the history of our species. But in order to truly reap the benefits of AI, we need to learn how to contain it. Paradoxically, part of that will mean collectively saying no to certain forms of progress. As an industry leader reckoning with a future that’s about to be ‘turbocharged’ I think we all need to play a role in shaping the technology—and that includes recognizing the lines we should not cross. (2023) source Unverified

So, an intergovernmental panel on A.I. would be one that has access to all of the largest commercial labs and academic labs all around the world developing these large language models. They would be able to probe them and test them, audit them, look at what data they are, you know, using to do training and try to find weaknesses and failure modes in the models. Once they discover those, they should then be able to share those with other national or international commercial competitors in order to improve the quality and performance of those models. But the first step is really just understanding and auditing and establishing the fact pattern of what are the boundaries that these models can’t cross today and what — where are they headed in the future. In short, we need a standing, global mechanism with legitimacy and access to oversee the most compute-intensive A.I. development, the way the IAEA oversees nuclear technology — not to stop progress, but to make it safe and accountable for everyone. (2023) source Unverified