AI Infra Market Bulletin – Nov. 12, 2026
Last Modified
2026-11-12
Update Frequency
Biweekly
Format
AI growth limits copper, sparking hybrid intra-rack copper and inter-rack optics. Advanced optics will gradually scale.
Key Highlights
- Copper Limits: AI scale-up highlights copper's limits, making inter-rack optics essential.
- Hybrid Design: Balancing cost and latency, inference prioritizes intra-rack copper and inter-rack optics.
- Optical Scaling: NPO/CPO will scale to reduce power, though massive fiber deployment remains a hurdle.
Table of Contents
- Executive Summary
- Figure-1: Reach and Link Power of Interconnect Options
- Key Findings and Takeaways
- Figure-2: Meta Rack Platforms and Accelerators per Rack
- Table-1: Scale-Up Domain Scale: Vendor Descriptions
- Figure-3: Hybrid Copper/Optical vs. Full Optical Scale-up Pods
- Figure-4: Peer-to-peer Serving Architecture with PDC Disaggregation on CloudMatrix384
- Figure-5: TPU 8i Hierarchical Boardfly Topology
- Figure-6: Maximum Seven-hop Network Diameter via OCS on TPU 8i Pod
- Figure-7: Maia 200 Unified Ethernet Hierarchy
- Table-2: Scale-Up Domains and Deployment Scales for Training vs. Inference
- Figure-8: Interconnects for Training vs. Inference Clusters
- Figure-9: OpenAI Jalapeño Two-level Scale-up Topology
- Table-3: Specifications of the Jalapeño Two-Tier Scale-Up Architecture
- Figure-10: UB Switch System in CloudMatrix384
- Table-4: Cross-Rack Scale-Up Links and Optical Usage Across Inference Platforms
- Table-5: Reach and Power Consumption of Copper Interconnects (200G / 400G)
- Figure-11: Limitations of Passive Copper (DAC) at 200G
- Figure-12: Total Link Power and Reach Comparison, 200G
- Figure-13: Fibers and Installation Hours per Compute Rack, 2026-2028+
- Table-6: Comparison of Fibers per Rack: NVIDIA, Broadcom, and Meta
<Total Pages: 15>

Spotlight Report
-
DRAM Monthly Datasheet Nov. 2026
2026/11/16
Semiconductors
EXCEL
-
NAND Flash Monthly Datasheet Nov. 2026
2026/11/13
Semiconductors
EXCEL
-
4Q26 Memory Price Forecast
2026/09/24
Semiconductors
PDF
-
Memory Market Outlook: 2026-2027 DRAM & NAND Revenue and Capex Analysis
2026/10/01
Semiconductors
PDF
-
DRAM Contract Price Aug. 2026
2026/08/31
Semiconductors
PDF
-
DRAM Contract Price Sep. 2026
2026/09/30
Semiconductors
PDF
AI Infra BulletinRelated Reports
Download Report
8,000
Spotlight Report
-
DRAM Monthly Datasheet Nov. 2026
2026/11/16
Semiconductors
EXCEL
-
NAND Flash Monthly Datasheet Nov. 2026
2026/11/13
Semiconductors
EXCEL
-
4Q26 Memory Price Forecast
2026/09/24
Semiconductors
PDF
-
Memory Market Outlook: 2026-2027 DRAM & NAND Revenue and Capex Analysis
2026/10/01
Semiconductors
PDF
-
DRAM Contract Price Aug. 2026
2026/08/31
Semiconductors
PDF
-
DRAM Contract Price Sep. 2026
2026/09/30
Semiconductors
PDF