Comment by Mark Zuckerberg

The conventional view is that these concerns are about technology, and that if we take enough time then we can perfect or align the technology to produce a single benevolent superintelligence. I think this view of alignment is fundamentally flawed. Humanity is not a monoculture. People’s diverse values represent different tradeoffs they would make on important issues. There is no technological solution that can align with everyone’s opposing interests and values at once. Any singular superintelligence would have to prioritize some values over others and in the process would be incapable of being benevolent to everyone.