Latest Developments
Updated 25 Sept 2026Recent headlines reinforce the picks-and-shovels thesis while introducing fresh competitive and demand-side risks for infrastructure investors. Nvidia CEO Jensen Huang downplayed AI safety concerns, even as the company's dominant market position draws scrutiny. That dominance faces a credible long-term challenge from Huawei, which has targeted Q1 2027 for an AI chip launch aimed directly at Nvidia, alongside broader shifts in inference hardware and liquid cooling that are reshaping the semiconductor stack.
On the software layer, Microsoft open-sourced TauGrid, a Kubernetes-native GPU cluster management stack, potentially lowering barriers to efficient GPU utilization industry-wide. However, The Verge notes that slowing AI superintelligence timelines are prompting questions about whether current GPU demand assumptions are overstated. Meanwhile, leadership moves continue at supporting firms, with Lawrence Semiconductor naming Don Garrison as GM and COO. Nvidia executives also publicly debated open versus closed AI model strategies at TechCrunch Disrupt 2026, signaling unresolved strategic direction within the ecosystem.
Key Takeaways
- AI infrastructure investing spans six critical layers: semiconductors, manufacturing, data centers, power systems, networking, and software tooling.
- Meta expects to spend $35-40 billion on AI infrastructure in 2024, representing a massive multi-trillion-dollar buildout cycle.
- A single H100 GPU cluster with 25,000 chips consumes 50-100 megawatts of power continuously, equivalent to a mid-sized city.
- Goldman Sachs projects data center power demand will grow 165% by 2030, driven primarily by AI workloads.
- Infrastructure providers historically outperform application companies during technology cycles, offering predictable revenue streams versus winner-take-all dynamics.
- Power generation and data center REITs provide the most defensive AI infrastructure exposure with long-term contracts and high switching costs.
While venture capitalists and retail investors chase flashy AI applications, sophisticated investors are quietly positioning themselves in the infrastructure layer that powers artificial intelligence. This picks-and-shovels approach—borrowing from the California Gold Rush strategy where Levi Strauss profited more reliably than most prospectors—offers a compelling risk-adjusted path to AI exposure. The current AI boom requires massive infrastructure buildout across six critical layers: semiconductors, data centers, power systems, cooling technology, networking equipment, and software tooling. Companies operating in these foundational layers are capturing predictable revenue streams while application-layer businesses face uncertain demand and fierce competition.
The Infrastructure Imperative
Training and deploying large language models demands extraordinary computational resources. OpenAI's GPT-4 training run reportedly cost between $63 million and $100 million in compute alone, while Microsoft allocated $13 billion to OpenAI infrastructure in 2023. Meta expects to spend $35-40 billion on AI infrastructure in 2024, up from $28 billion in 2023. These figures represent just the beginning of a multi-trillion-dollar infrastructure cycle.
The scale becomes clear when examining power requirements. A single H100 GPU cluster with 25,000 chips—the minimum viable scale for frontier model training—consumes roughly 50-100 megawatts of power continuously. This equals the electricity needs of a mid-sized city. Goldman Sachs projects data center power demand will grow 165% by 2030, driven primarily by AI workloads.
"The AI revolution isn't just about software—it's fundamentally reshaping global infrastructure requirements. We're witnessing the largest technology infrastructure buildout since the advent of the internet." — Jensen Huang, Nvidia CEO, Q3 2024 earnings call
Mapping the AI Infrastructure Stack
Six distinct layers comprise the AI infrastructure ecosystem, each presenting unique investment opportunities:
| Infrastructure Layer | Key Players | 2024 Revenue (Est.) | Growth Rate |
|---|---|---|---|
| AI Semiconductors | Nvidia, AMD, Intel | $126B | 88% |
| Contract Manufacturing | TSMC, Samsung | $84B | 24% |
| Data Center REITs | Digital Realty, Equinix | $38B | 12% |
| Power Infrastructure | Eaton, Vertiv, Constellation | $45B | 35% |
| Networking Equipment | Arista, Cisco, Broadcom | $67B | 28% |
| Software Tooling | Palantir, Snowflake, Databricks | $29B | 42% |
Nvidia dominates the semiconductor layer with roughly 85% market share in AI training chips. The company's data center revenue surged from $15 billion in fiscal 2023 to $47.5 billion in fiscal 2024. However, Taiwan Semiconductor Manufacturing Company (TSMC) captures significant value as Nvidia's primary foundry partner, manufacturing virtually all cutting-edge AI chips using advanced 4nm and 3nm processes.
Beyond chips, power infrastructure represents a critical bottleneck. Vertiv, which provides cooling and power management systems for data centers, saw revenue jump 13% year-over-year in Q3 2024 to $1.9 billion. Eaton, specializing in electrical components and systems, reported 19% organic growth in its electrical sector during the same period, driven primarily by data center demand.
Historical Precedent: Internet Infrastructure Winners
The internet buildout of the 1990s and early 2000s provides instructive parallels. While most dot-com application companies disappeared during the 2000-2002 crash, infrastructure providers delivered superior long-term returns. Cisco Systems, the dominant networking equipment provider, generated cumulative returns of 285% from 2002 to 2012 as internet usage expanded globally. Akamai Technologies, providing content delivery network infrastructure, returned 420% over the same period.
Meanwhile, high-profile application companies like Pets.com, Webvan, and eToys vanished entirely. Even survivors like Amazon required nearly a decade to recover their peak valuations from the dot-com era, not surpassing their 1999 highs until 2007.
This pattern reflects fundamental economics: infrastructure providers typically sign multi-year contracts with predictable revenue streams, while application companies face winner-take-all dynamics and customer acquisition challenges. Infrastructure scales with overall technology adoption rather than depending on specific use cases achieving product-market fit.
"In technology cycles, the companies selling tools to builders often outperform the builders themselves. Infrastructure providers benefit from the entire wave of innovation rather than betting on individual applications." — Mary Meeker, former Morgan Stanley internet analyst
The Commoditization Risk
However, infrastructure investing carries material risks. Overbuilding frequently occurs during technology booms, leading to excess capacity and margin compression. The fiber optic buildout of 1999-2001 exemplifies this dynamic—companies installed far more fiber capacity than demand required, resulting in massive bankruptcies and stranded assets.
Early signs of potential AI infrastructure overbuilding are emerging. CoreWeave, a GPU cloud provider, raised $7.5 billion in debt financing in 2024 despite generating less than $500 million in annual revenue. Applied Digital, another GPU hosting company, trades at 25 times forward revenue despite uncertain long-term demand visibility.
The semiconductor sector faces particular commoditization pressure. While Nvidia currently commands premium pricing due to software advantages and CUDA ecosystem lock-in, competitors are rapidly developing alternatives. AMD's MI300X chips offer competitive performance at 20% lower prices, while Google's TPU v5 and Amazon's Trainium chips provide hyperscaler customers with internal alternatives.
Power and Real Estate: The Defensive Play
Among infrastructure layers, power generation and data center real estate offer the most defensive characteristics. Constellation Energy, which owns nuclear power plants, signed a 20-year power purchase agreement with Microsoft in September 2024 to restart the Three Mile Island facility. Nuclear power's carbon-free profile makes it particularly attractive for hyperscalers with net-zero commitments.
Data center REITs provide another defensive approach. Digital Realty Trust owns 300+ data centers globally and maintains average lease terms of 10+ years with investment-grade tenants. The company's revenue grew 6% year-over-year in Q3 2024, while occupancy remained above 88% despite significant capacity additions.
What This Means for Investors
A disciplined approach to AI infrastructure investing requires recognizing both opportunities and risks. The most attractive positions combine several characteristics: dominant market positions, long-term customer contracts, high switching costs, and exposure to the entire AI ecosystem rather than specific applications.
Position sizing becomes critical given valuation uncertainty. Many AI infrastructure stocks trade at substantial premiums to historical norms—Nvidia trades at 35 times forward earnings compared to its 10-year average of 22 times. This suggests limiting individual positions to 2-3% of portfolio weight while building exposure across multiple infrastructure layers.
Geographic diversification also matters. While US companies dominate AI model development, Asian suppliers like TSMC and SK Hynix control critical manufacturing capacity. European utilities and data center operators provide exposure to AI infrastructure buildout outside North America.
The optimal allocation framework balances growth potential against commoditization risk. Higher allocations to defensive layers like power and real estate (3-5% combined) make sense, with smaller positions in higher-risk, higher-reward semiconductor plays (1-2% each). Networking and software tooling companies occupy middle ground, warranting 2-3% allocations for market leaders with sustainable competitive advantages.
The Long View
AI infrastructure investing requires patience and selectivity. While current growth rates appear extraordinary, technology cycles typically feature 3-5 year buildout phases followed by consolidation and margin compression. The companies best positioned for long-term success combine technological leadership with operational discipline and strong balance sheets. As the AI revolution unfolds, those selling the picks and shovels to digital prospectors may once again prove more profitable than the prospectors themselves.
Frequently Asked Questions
What is the picks and shovels strategy for AI investing?
The picks and shovels strategy involves investing in AI infrastructure companies that provide foundational services—semiconductors, data centers, power systems, cooling, networking, and software tools—rather than AI applications. This approach offers more predictable revenue streams and lower risk compared to application-layer investments.
How much power does AI training require?
A single H100 GPU cluster with 25,000 chips consumes 50-100 megawatts of power continuously, equivalent to a mid-sized city's electricity needs. Goldman Sachs projects data center power demand will grow 165% by 2030 due to AI workloads.
Which AI infrastructure companies are market leaders?
Key leaders include Nvidia (85% AI chip market share), TSMC (semiconductor manufacturing), Digital Realty Trust (data center REITs), Vertiv and Eaton (power infrastructure), and Arista Networks (networking equipment). These companies captured billions in AI-driven revenue growth in 2024.
What are the risks of AI infrastructure investing?
Main risks include commoditization pressure as competitors develop alternatives to market leaders, potential overbuilding leading to excess capacity, and elevated valuations—Nvidia trades at 35 times forward earnings versus its 10-year average of 22 times.
How should investors allocate to AI infrastructure stocks?
Recommended allocation is 2-3% portfolio weight per position, with higher allocations (3-5% combined) to defensive layers like power and data center REITs, and smaller positions (1-2% each) in higher-risk semiconductor plays, while diversifying across multiple infrastructure layers.
Get MachineHours in your inbox
AI compute and the machine economy in your inbox.


