Vivold Consulting

Fresh off OpenAI's Jalapeno reveal, Anthropic explores custom silicon with an ex-OpenAI chip lead on board - inference costs are the war

Key Insights

Anthropic has begun early-stage work on its own AI chip and is in talks with Samsung as a manufacturing partner - specifically eyeing Samsung's 2-nanometre process and advanced packaging - per The Information, days after OpenAI unveiled Jalapeno, its Broadcom-built inference chip claiming ~50% cost savings versus GPUs. Anthropic just hired Clive Chan, the second engineer ever on OpenAI's chip team, and Samsung (with SK hynix and Micron) already invested in Anthropic's $65B Series H as a strategic infrastructure partner. Anthropic stresses Nvidia GPUs, Google TPUs, and AWS Trainium remain central - this is diversification, not divorce, with Nvidia still holding ~74% of the AI chip market.

Stay Updated

Get the latest insights delivered to your inbox

Every frontier lab now wants its own silicon

Anthropic is in early discussions with Samsung Electronics about manufacturing a custom AI chip, The Information reported - talks centred on Samsung's leading-edge 2-nanometre process and its advanced packaging capabilities, which bind processors and high-bandwidth memory tightly together. The project is genuinely nascent: no detailed design, no prototypes, no timeline, and per sources the chip's purpose, power envelope, and server configuration are still being defined. But the personnel move is telling - Anthropic hired Clive Chan in June, the second hardware engineer ever to join OpenAI's custom-chip programme, after two and a half years building the accelerator OpenAI just unveiled with Broadcom as Jalapeno, an inference processor Broadcom's CEO says showed roughly 50% cost savings versus typical AI GPUs in early testing. Anthropic, for its part, told TechCrunch a diversified stack of Google, Amazon, and Nvidia chips remains pivotal, and it separately holds discussions with Microsoft and UK startup Fractile - multi-vendor by design.

Why Samsung, and why now

The financial alignment came first: Samsung, SK hynix, and Micron all joined Anthropic's $65 billion Series H in May as strategic infrastructure partners, and Samsung is the only one of the three with a contract foundry able to fabricate logic chips. Landing Anthropic would hand Samsung the marquee AI client it needs against TSMC's dominance - it already signed a reported $16.5 billion deal to fabricate Tesla's next-generation AI chips, and Google is reportedly considering Samsung for part of a future TPU. The economics push everything: Claude usage keeps compounding (paying consumers up roughly 75% since January, per secondary reporting), every query runs on rented silicon, industry estimates put a single advanced chip design at around $500 million, and Nvidia - despite all the custom-silicon noise - still commands an estimated 74% of the AI chip market.

Why this matters beyond the chip nerds

- The strategic pattern is now unanimous: OpenAI, Google, Amazon, Meta, Microsoft, and Anthropic all pursue inference-optimised custom silicon because serving transformer models is a single repetitive workload where an ASIC can strip out GPU overhead. If Jalapeno's ~50% saving holds at scale, expect that economics to eventually show up in API pricing - a structural tailwind for buyers negotiating multi-year AI contracts.
- For supply-chain and hardware strategists, the story is Samsung's foundry credibility: a top-tier AI lab seriously evaluating its 2nm node is the strongest external validation yet that leading-edge manufacturing is becoming a two-supplier market. Diversification below the model layer reduces the single-fab concentration risk everyone quietly carries via TSMC.
- Temper the timeline: exploratory talks are years from deployed silicon, and Anthropic explicitly is not leaving Nvidia, Google, or AWS. The near-term signal is about bargaining power - a lab that credibly can build its own chip pays less for everyone else's. The same logic applies, in miniature, to any enterprise that can credibly run open models on owned hardware.

Related Articles

Discovery Loop aims to automate science itself - and Google is funding the startup draining its own bench, as Hassabis exits the DeepMind CEO role

Jeff Dean, Google's chief scientist and 30th employee, is leaving after 27 years to found Discovery Loop, a public benefit corporation using AI to automate scientific research - taking co-founders Sanjay Ghemawat, Quoc Le (Google Brain), and Oriol Vinyals (DeepMind) with him. Google is a founding investor and cloud partner, supplying compute for at least the first year, with Radical Ventures and Khosla Ventures co-leading the seed. In the same announcement, Demis Hassabis steps down as DeepMind CEO to become chairman and Alphabet chief scientist, with Koray Kavukcuoglu taking over Gemini model development. Alphabet stock fell about 4%.

Abbott orders audits of every new project as ERCOT's queue hits 474GW, roughly 90% of it data centres

Governor Greg Abbott announced that all new Texas data-centre projects must be audited by the Public Utility Commission and grid operator ERCOT - a sharp turn for a state whose loose regulation and cheap power made it second only to Virginia for data centres. The trigger is a staggering queue: ERCOT's interconnection requests doubled from 233GW in January to 474GW, about 90% data centres, more than five times the grid's all-time peak demand. Audits will demand power and water use, noise mitigation, light controls, tax-incentive use, and ownership details - after a voluntary survey that most operators simply ignored.

Volta and Bitdeer will build a 133MW Nvidia Vera Rubin data centre in Norway - Anthropic's latest move in a compute land grab

Anthropic has reportedly signed a $10 billion, six-year compute deal with Volta, an AI cloud startup founded only earlier this year, per Bloomberg. Volta is partnering with crypto-mining firm Bitdeer to develop the data centre - located in Norway, delivering 133 megawatts, and running Nvidia's Vera Rubin architecture - and is a member of Nvidia's Cloud Partner programme. It caps an aggressive capacity spree that also includes recent compute deals with SpaceX and Amazon, as Anthropic races rivals for the scarcest input in the industry.