# Satya Nadella **Domain:** Technology Leadership / Artificial Intelligence / Human Control **Doc Type:** Person Node **Maturity:** Developing ## Overview **Satya Nadella** is Microsoft’s chairman and chief executive. In the 2026 superintelligence debate, he articulated a human-control threshold: capability is not worth pursuing when it ceases to help humanity or can no longer be governed by people. ## Institutional Context Nadella’s formulation connects corporate research direction to [[wiki/Humanist AI|Humanist AI]], [[wiki/AI Safety|AI safety]], and [[wiki/Human Control of AI|human control of AI]]. It defines control and human benefit as conditions of technological legitimacy rather than optional features added after deployment. ## Relationships [[wiki/Microsoft|Microsoft]] · [[wiki/Microsoft AI|Microsoft AI]] · [[wiki/Humanist AI|Humanist AI]] · [[wiki/AI Control|AI Control]] · [[wiki/Human Flourishing|Human Flourishing]] ## Simple Reminders, Quotations, and Thoughts > “Any pursuit of superintelligence has to be grounded in the core principle that if the AI we build is not helping humanity and under human control, it’s not worth pursuing.” > **— Satya Nadella**, *Public statement on superintelligence, September 2026* [[reminders/AI Control/Super Intelligence Not Under Human Control Is Not Worth Pursuing by Satya Nadella|Super Intelligence Not Under Human Control Is Not Worth Pursuing by Satya Nadella]] > "We simply can't outsource responsibility for what intelligence does on our behalf. A model provider's assurances do not relieve us of that responsibility." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Responsibility for Machine Intelligence Cannot Be Outsourced by Satya Nadella|Responsibility for Machine Intelligence Cannot Be Outsourced by Satya Nadella]] > "We can't treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions. We must build contained systems whose behavior we can observe, limits we can test, and actions we can always contain. In other words, we need to separate the supply of intelligence from the authority over it." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Separate the Supply of Intelligence from Authority by Satya Nadella|Separate the Supply of Intelligence from Authority by Satya Nadella]] > "Setting aside the hard problem of alignment, we need to start with an engineering approach to containment and governance. We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Surround Nondeterministic Models with Deterministic Controls by Satya Nadella|Surround Nondeterministic Models with Deterministic Controls by Satya Nadella]] > "Treating frontier closed and open weight models like insider risks is a way to build such a system. Not because they are necessarily malicious, but because any sufficiently capable actor with access to important systems can make mistakes or be compromised, and the architecture of containment and control must account for that." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Treat Frontier Models Like Insider Risks by Satya Nadella|Treat Frontier Models Like Insider Risks by Satya Nadella]] > "Every meaningful model action must leave tamper-proof human readable evidence. If it can't be observed, it can't be trusted! We need to be able to reproduce how an outcome was achieved without relying on the model to attest to it." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Every Model Action Must Leave Human-Readable Evidence by Satya Nadella|Every Model Action Must Leave Human-Readable Evidence by Satya Nadella]] > "We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/Every Advanced Model Needs an Emergency Brake by Satya Nadella|Every Advanced Model Needs an Emergency Brake by Satya Nadella]] > "The most trustworthy Super Intelligence system will not be the one with the model we trust most. It will be the one that enables us to trust the model the least." > **— Satya Nadella**, *Models as Insider Risks in the Super Intelligence Era, October 10, 2026* [[reminders/AI Control/The Most Trustworthy AI System Trusts the Model Least by Satya Nadella|The Most Trustworthy AI System Trusts the Model Least by Satya Nadella]] ## Sources / Provenance - [[research/Super Intelligence Week Index of Statements from the White House Luncheon|Super Intelligence Week Index of Statements from the White House Luncheon]]. - [[articles/Vertically Integrating an AI Superpower from AI Factory to Citizen|Vertically Integrating an AI Superpower from AI Factory to Citizen]].