Research Reports

AI Infra Market Bulletin – Nov. 12, 2026

icon

Last Modified

2026-11-12

icon

Update Frequency

Biweekly

icon

Format

PDF



AI growth limits copper, sparking hybrid intra-rack copper and inter-rack optics. Advanced optics will gradually scale.

Key Highlights

  • Copper Limits: AI scale-up highlights copper's limits, making inter-rack optics essential.
  • Hybrid Design: Balancing cost and latency, inference prioritizes intra-rack copper and inter-rack optics.
  • Optical Scaling: NPO/CPO will scale to reduce power, though massive fiber deployment remains a hurdle.

Table of Contents

  1. Executive Summary
    • Figure-1: Reach and Link Power of Interconnect Options
  2. Key Findings and Takeaways
    • Figure-2: Meta Rack Platforms and Accelerators per Rack
    • Table-1: Scale-Up Domain Scale: Vendor Descriptions
    • Figure-3: Hybrid Copper/Optical vs. Full Optical Scale-up Pods
    • Figure-4: Peer-to-peer Serving Architecture with PDC Disaggregation on CloudMatrix384
    • Figure-5: TPU 8i Hierarchical Boardfly Topology
    • Figure-6: Maximum Seven-hop Network Diameter via OCS on TPU 8i Pod
    • Figure-7: Maia 200 Unified Ethernet Hierarchy
    • Table-2: Scale-Up Domains and Deployment Scales for Training vs. Inference
    • Figure-8: Interconnects for Training vs. Inference Clusters
    • Figure-9: OpenAI Jalapeño Two-level Scale-up Topology
    • Table-3: Specifications of the Jalapeño Two-Tier Scale-Up Architecture
    • Figure-10: UB Switch System in CloudMatrix384
    • Table-4: Cross-Rack Scale-Up Links and Optical Usage Across Inference Platforms
    • Table-5: Reach and Power Consumption of Copper Interconnects (200G / 400G)
    • Figure-11: Limitations of Passive Copper (DAC) at 200G
    • Figure-12: Total Link Power and Reach Comparison, 200G
    • Figure-13: Fibers and Installation Hours per Compute Rack, 2026-2028+
    • Table-6: Comparison of Fibers per Rack: NVIDIA, Broadcom, and Meta

<Total Pages: 15>

Reach and Link Power of Interconnect Options





USD

8,000

Get in touch with us


Get in touch with us