Vivold Consulting

Microsoft's CEO says models learn from your 'exhaust' and calls for keeping memory, context, and orchestration outside any single provider

Key Insights

In a blog post, Satya Nadella warned that enterprises using proprietary AI models are paying twice - once in money for tokens, and again in the proprietary knowledge they must reveal to make those models useful, since models learn from the 'exhaust' of prompts, tool use, and especially corrections. He argued it is inconsistent for labs to claim fair-use rights to train on the world's public data while restricting others from distilling their models in return. Nadella - whose company invests in both OpenAI and Anthropic - later doubled down on CNN, saying firms without their own models or an AI gateway layer separating prompts, memory, and harness from the model won't survive as firms, having 'outsourced your thinking.'

Stay Updated

Get the latest insights delivered to your inbox

The most quotable enterprise-AI warning of the year, from an unlikely source

A worry that had been circulating among VCs and executives - that the big proprietary labs act as Trojan horses, gaining ever-increasing access to their customers' most sensitive business information and potentially becoming competitors to those same customers - got its highest-profile endorsement when Microsoft CEO Satya Nadella published a blog post joining the chorus. His formulation is the one that stuck: buyers pay for intelligence twice, once with money, and again with something more valuable - the proprietary knowledge you must reveal to make that intelligence useful. And the better you want the model to perform, the more of that knowledge you must feed it. He called this the reverse information paradox, noting that models learn from exhaust: the prompts people write, the tools agents use, and especially the corrections people make.

The fairness argument, and the follow-up

Nadella paired the warning with a pointed consistency challenge: while fair-use rights to train on public data drive genuine innovation, he finds it inconsistent for model providers to claim that right while restricting others from distilling their models in return. Two weeks later, on CNN's Fareed Zakaria GPS, he escalated - saying companies that rely wholly on proprietary labs for their AI needs ultimately won't survive, and that any firm without this control will not remain a firm, because it has essentially outsourced its thinking. His prescription is concrete: keep data, memory, context, and orchestration separate from any single model provider, deploy AI gateways that sit between your prompts and the model, and be wary of depending on labs' built-in coding harnesses (Claude Code, ChatGPT Codex are the named category), because keeping the harness separate from the model means any one model can go away while you stay in control. He also floated token capital - the knowledge created between employees, applications, and AI systems - as an asset class that may come to matter as much as IP or human capital.

Turning the warning into an architecture

- Build the gateway layer. A middleware tier that owns authentication, prompt templating, retrieval, logging, and routing is the single highest-leverage investment here: it makes models swappable, gives you your own record of interactions, and stops your context from being a provider's asset by default.
- Own your memory and evaluations. Corrections and feedback are the most valuable exhaust; capture them into your own datasets and eval suites rather than letting them exist only inside a vendor's product. That is the raw material for fine-tuning open weights later - which is exactly the escape hatch Nadella recommends.
- Read your contracts on training and retention with fresh eyes: zero-retention and no-training terms are negotiable at enterprise scale, and they are the cheapest version of this protection. Ask specifically about prompts, tool-call traces, and human feedback, not just documents.
- One honest caveat when you present this to clients: Microsoft is an investor in both OpenAI and Anthropic and sells the gateway-and-cloud layer his advice implies you need. The argument stands on its merits - it aligns with the same multi-model resilience lesson the Anthropic export blackout taught - but the messenger has a product to sell, and saying so builds your credibility rather than undermining it.

Related Articles

Discovery Loop aims to automate science itself - and Google is funding the startup draining its own bench, as Hassabis exits the DeepMind CEO role

Jeff Dean, Google's chief scientist and 30th employee, is leaving after 27 years to found Discovery Loop, a public benefit corporation using AI to automate scientific research - taking co-founders Sanjay Ghemawat, Quoc Le (Google Brain), and Oriol Vinyals (DeepMind) with him. Google is a founding investor and cloud partner, supplying compute for at least the first year, with Radical Ventures and Khosla Ventures co-leading the seed. In the same announcement, Demis Hassabis steps down as DeepMind CEO to become chairman and Alphabet chief scientist, with Koray Kavukcuoglu taking over Gemini model development. Alphabet stock fell about 4%.

Abbott orders audits of every new project as ERCOT's queue hits 474GW, roughly 90% of it data centres

Governor Greg Abbott announced that all new Texas data-centre projects must be audited by the Public Utility Commission and grid operator ERCOT - a sharp turn for a state whose loose regulation and cheap power made it second only to Virginia for data centres. The trigger is a staggering queue: ERCOT's interconnection requests doubled from 233GW in January to 474GW, about 90% data centres, more than five times the grid's all-time peak demand. Audits will demand power and water use, noise mitigation, light controls, tax-incentive use, and ownership details - after a voluntary survey that most operators simply ignored.

Volta and Bitdeer will build a 133MW Nvidia Vera Rubin data centre in Norway - Anthropic's latest move in a compute land grab

Anthropic has reportedly signed a $10 billion, six-year compute deal with Volta, an AI cloud startup founded only earlier this year, per Bloomberg. Volta is partnering with crypto-mining firm Bitdeer to develop the data centre - located in Norway, delivering 133 megawatts, and running Nvidia's Vera Rubin architecture - and is a member of Nvidia's Cloud Partner programme. It caps an aggressive capacity spree that also includes recent compute deals with SpaceX and Amazon, as Anthropic races rivals for the scarcest input in the industry.