Research Reports

Research Reports

[Selected Topics] Era of Machine Data: Analysis on Training and Inference Applications of AI Servers

Last Modified

2023-05-08

Update Frequency

Not

Format

PDF

Overview

Summary
The expectation that AI would introduce immense benefits to the commercial market has prompted major suppliers to engage in AI training, which yielded the demand for hardware equipment. AI is currently at the mass training phase, and applications of AI servers are still focused on training, where GPU and GPGPU serve as the cores, while ASIC and FPGA facilitate inference through specific algorithms that will improve overall computing performance.

Table of Contents
1. Perpetual AI Training under Era of Machine Data
(1) Existing AI Servers Primarily Focused on Training
(2) FPGA and ASIC Could Assist with Inference

2. Analysis on Architectures and Trends of AI Servers
(1) GPU Serves as the Core for AI Servers
(2) ASIC and FPGA to Accelerate Inference Applications
(3) Mass Data Prompts Storage Demand
(4) DPU Emerges to Strengthen Resource Allocation
(5) High Energy Consumption Amplifies Demand for Cooling

3. TRI’s View
(1) Fast Iterations of AI Models Actuates Advancement of Server Modules
(2) AI Servers Currently Focused on Training with GPU Serving as a Key Factor

＜Total Pages：12＞

Spotlight Report

PDF

Popular Keywords

USD $200

[Selected Topics] Era of Machine Data: Analysis on Training and Inference Applications of AI Servers

Overview

Spotlight Report

[Selected Topics] Trump’s Impact on Trade and Energy Policies between China and the U.S.

[Selected Topics] Capacity and Price Competitions to Intensify in China in 2025 amidst 6% YoY Growth in Global Mature Nodes (Approx. 70% from Chinese Foundries)

Survey on China’s Automotive Investment_202408

Chinese NEV Brands – Survey on Ecosystem of Cockpits and ADAS Supply Chain_202407

[Selected Topics] AI Guides Development of Space Industry: Analysis on Applications, Challenges and Market Trends

[Selected Topics] Rankings of Top 10 Global SSD Module Brands for 2023

Selected TopicsRelated Reports

[Selected Topics] NVIDIA GB200 Racks May Delay in Shipment(4Q24 and 1Q25); Steady Ramp Ups after Supply Chain is Settled(2Q25-3Q25)

[Selected Topics] US Department of Commerce Released Updates on Export Controls on December 2; Numerous Export Licenses Now Require Review and Some Rules Have Expanded to Include 8-Inch Wafer Equipment

[Selected Topics] Latest US Rules Targeting Direct Export of HBM Will Hinder Development of ASICs in China

[Selected Topics] With Arrival of Peak Sales Season, 3Q24 Smartphone Production Rose 7% QoQ and Remained Flat YoY

[Selected Topics] Apple’s New Devices and Early Stocking of Memory for GB200 Supported Positive Revenue Growth in 3Q24

[Selected Topics] Global Top 10 Foundries’ Total Revenue Reached a Record High of Over US$34bn in 3Q24 as Advanced Nodes Maintain Strong Growth and China Provides Policy Stimulus

Download Report

USD $200

Membership

Spotlight Report

[Selected Topics] Trump’s Impact on Trade and Energy Policies between China and the U.S.

[Selected Topics] Capacity and Price Competitions to Intensify in China in 2025 amidst 6% YoY Growth in Global Mature Nodes (Approx. 70% from Chinese Foundries)

Survey on China’s Automotive Investment_202408

Chinese NEV Brands – Survey on Ecosystem of Cockpits and ADAS Supply Chain_202407

[Selected Topics] AI Guides Development of Space Industry: Analysis on Applications, Challenges and Market Trends

[Selected Topics] Rankings of Top 10 Global SSD Module Brands for 2023

Research Directory

Semiconductor Research

Display Research

Optoelectronics Research

Green Energy Research

ICT Applications Research

Semiconductors

Display

LED

Energy

Consumer Electronics

Emerging Technologies

Selected Topics

Research Reports

USD $200

[Selected Topics] Era of Machine Data: Analysis on Training and Inference Applications of AI Servers

Overview

Spotlight Report

[Selected Topics] Trump’s Impact on Trade and Energy Policies between China and the U.S.

[Selected Topics] Capacity and Price Competitions to Intensify in China in 2025 amidst 6% YoY Growth in Global Mature Nodes (Approx. 70% from Chinese Foundries)

Survey on China’s Automotive Investment_202408

Chinese NEV Brands – Survey on Ecosystem of Cockpits and ADAS Supply Chain_202407

[Selected Topics] AI Guides Development of Space Industry: Analysis on Applications, Challenges and Market Trends

[Selected Topics] Rankings of Top 10 Global SSD Module Brands for 2023

Selected TopicsRelated Reports

[Selected Topics] NVIDIA GB200 Racks May Delay in Shipment(4Q24 and 1Q25); Steady Ramp Ups after Supply Chain is Settled(2Q25-3Q25)

[Selected Topics] US Department of Commerce Released Updates on Export Controls on December 2; Numerous Export Licenses Now Require Review and Some Rules Have Expanded to Include 8-Inch Wafer Equipment

[Selected Topics] Latest US Rules Targeting Direct Export of HBM Will Hinder Development of ASICs in China

[Selected Topics] With Arrival of Peak Sales Season, 3Q24 Smartphone Production Rose 7% QoQ and Remained Flat YoY

[Selected Topics] Apple’s New Devices and Early Stocking of Memory for GB200 Supported Positive Revenue Growth in 3Q24

[Selected Topics] Global Top 10 Foundries’ Total Revenue Reached a Record High of Over US$34bn in 3Q24 as Advanced Nodes Maintain Strong Growth and China Provides Policy Stimulus

Download Report

USD $200

Membership

Spotlight Report

[Selected Topics] Trump’s Impact on Trade and Energy Policies between China and the U.S.

[Selected Topics] Capacity and Price Competitions to Intensify in China in 2025 amidst 6% YoY Growth in Global Mature Nodes (Approx. 70% from Chinese Foundries)

Survey on China’s Automotive Investment_202408

Chinese NEV Brands – Survey on Ecosystem of Cockpits and ADAS Supply Chain_202407

[Selected Topics] AI Guides Development of Space Industry: Analysis on Applications, Challenges and Market Trends

[Selected Topics] Rankings of Top 10 Global SSD Module Brands for 2023

Get in touch with us