SemiAnalysis

SemiAnalysis

Home
Main Site
Models & Research
Die Yield Calculator
Compliance
Archive
About
How GLM5.3 Sparse Attention Affects HBM Memory Usage
GLM-5.3, KV Cache Offloading, HiSparse, AgentX TileRT, InferenceX DeepSeek Sparse Attention, IndexShare, Single-rollout Asynchronous Optimization…
 • Kimbo Chen, Alec Ibarra, Wenyao Gao, Pratt Bhatt, Bryan Shan, and Dylan Patel
Intel Panther Lake Teardown
Taking a look inside Intel’s latest consumer chip and 18A process node
 • Adith Shankar, Daniel Sanchez, Allison Elliott, Sarah Lawrence, Afzal Ahmad, Andrew Wagner, STEEL Team, and Dylan Patel
The Chinese AI Infrastructure Boom: Introducing the SemiAnalysis China Datacenter Model
1,000+ facilities across 60+ operators mapped, built retail-first and flipped by AI, largest hyperscaler leases 1/5 national capacity, 100MW in 12…
 • Everlyn, Dylan Patel, and Patrick Schaabi
Most Popular
View all
Claude Code is the Inflection Point
 • Doug O'Laughlin, Jeremie Eliahou Ontiveros, Jordan Nanos, Dylan Patel, and Daniel Nishball
TPUv7: Google Takes a Swing at the King
 • Dylan Patel, Myron Xie, Daniel Nishball, Wei Zhou, Jeremie Eliahou Ontiveros, Ivan Chiam, Cheang Kang Wen, Clara Ee, Wega Chu, Kimbo Chen, AJ, and Michael Chen
Microsoft's AI Strategy Deconstructed - From Energy to Tokens
 • Jeremie Eliahou Ontiveros, Dylan Patel, Myron Xie, Wei Zhou, Jordan Nanos, Clara Ee, Daniel Nishball, and AJ
OpenAI Jalapeño: Better Than Nvidia Blackwell
 • Bryan Shan, Myron Xie, Jordan Nanos, Wega Chu, Clara Ee, and Dylan Patel
Co-Packaged Optics (CPO) Book – Scaling with Light for the Next Wave of Interconnect
 • Dylan Patel, Daniel Nishball, Myron Xie, Ivan Chiam, Clara Ee, and Patrick Zhou
Gemini is Cooked but GCP is Cooking
 • Max Kan, Joey Brookhart, Doug O'Laughlin, and Dylan Patel
ClusterMAX 3.0: The Industry Standard GPU Cloud Rating System Returns
In gory detail: reliability, performance, support, pricing—and, of course, security—in our most thorough analysis of GPU cloud providers globally.
 • Jordan Nanos, Sam Harshe, Samuel Kruse, Pratt Bhatt, Billy Cao, Jack Carson, and Dylan Patel
Computation and Data Movement for Inference
Mapping MoE models onto inference hardware: structure, flow, and efficient serving
 • Tanj Bennett, Bryan Shan, and Dylan Patel
Engrams Embedding Entendre: Codesign for Efficient DRAM/SSD Offloading
New Model Architecture Implications for TAM of DRAM/NVMe, DeepSeek V4.1 Flash, AgentX, InferenceX, NVMe experiments
 • Bryan Shan, Cam Quilici, Alec Ibarra, Kimbo Chen, Myron Xie, and Dylan Patel
Everyone Says Datacenter Moratoriums Are Killing the US Buildout. We disagree
300+ moratoriums mapped, 20GW sits inside a restricted local boundary, 1,525MW actually slips, 2.3GW nationwide including New York
 • Maya Barkin, Reyk Knuhtsen, Jeremie Eliahou Ontiveros, and Dylan Patel
Vera Rubin NVL72 Agentic Inference: 67x better Performance per Dollar
Jensen Sandbagging Performance Again, 2x more Annual Profit Per GigaWatt, The More you Buy, The More you Earn, AgentX, InferenceX, Extreme Co-Design
 • Bryan Shan, Alec Ibarra, Cam Quilici, Wenyao Gao, and Dylan Patel
A Brain Too Big to Carry — On-Device vs Datacenter Inference
Robot Models, Silicon & DRAM Efficiency, Jetson Thor vs. B300 TCO, Deployments, The Network Wall
 • Ivan Chiam, Gianluca Bencomo, Zane Fong, Bryan Shan, Dylan Patel, and Reyk Knuhtsen
Long Live the Short King: Why 4-hi HBM Wins
Same Bandwidth, Fewer Dies: How 4-hi HBM Cuts Inference Costs and Makes Scarce DRAM Go Further
 • Myron Xie, Bryan Shan, Harrison Barclay, Minjae Kang, and Dylan Patel
SemiAnalysis
SemiAnalysis
Bridging the gap between the world's most important industry, semiconductors, and business.
Recommendations
View all 15
Nongaap Investing
Nongaap Investing
Mike
D2D Newsletter
D2D Newsletter
Digits to Dollars
The Chip Letter
The Chip Letter
Babbage
The Algorithmic Bridge
The Algorithmic Bridge
Alberto Romero
Artificial Intelligence Made Simple
Artificial Intelligence Made Simple
Devansh

SemiAnalysis

AboutArchiveRecommendationsSitemap
© 2026 Dylan Patel · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture