Research Reports


[Selected Topics] Era of Machine Data: Analysis on Training and Inference Applications of AI Servers

Research Reports

icon

Last Update

2023-05-08

icon

Update Frequency

Not

icon

Format

PDF

icon

Membership

  • Selected Topics

  • Selected Topics-0013_Era of Machine Data: Analysis on Training and Inference Applications of AI Servers


    Report Overview

    Summary
    The expectation that AI would introduce immense benefits to the commercial market has prompted major suppliers to engage in AI training, which yielded the demand for hardware equipment. AI is currently at the mass training phase, and applications of AI servers are still focused on training, where GPU and GPGPU serve as the cores, while ASIC and FPGA facilitate inference through specific algorithms that will improve overall computing performance.

    Table of Contents
    1. Perpetual AI Training under Era of Machine Data
      (1) Existing AI Servers Primarily Focused on Training
      (2) FPGA and ASIC Could Assist with Inference

    2. Analysis on Architectures and Trends of AI Servers
      (1) GPU Serves as the Core for AI Servers
      (2) ASIC and FPGA to Accelerate Inference Applications
      (3) Mass Data Prompts Storage Demand
      (4) DPU Emerges to Strengthen Resource Allocation
      (5) High Energy Consumption Amplifies Demand for Cooling

    3. TRI’s View
      (1) Fast Iterations of AI Models Actuates Advancement of Server Modules
      (2) AI Servers Currently Focused on Training with GPU Serving as a Key Factor

    <Total Pages:12>


    Analysts

    TrendForce




    Selected Topics Related Reports



    [Selected Topics] Global GaAs Industry: Overview

    2023/12/11

    Semiconductors

     PDF

    Gallium Arsenide (GaAs) is recognized in the industry as the most mature compound semiconductor material after silicon. It possesses superior characteristics such as high frequency, high electron mobility, high output power, low noise, and good linearity, making it one of the most important support materials for microwave radio frequency and optoelectronics.
    In recent years, a surge in applications like 5G communications, autonomous driving, advanced displays, and AI has driven an increased demand for GaAs. Consequently, manufacturers are fully committed to capturing a significant share of this growing market.

    [Selected Topics] Wearable Device Industry 2024 Outlook: Smartwatches, Bands, and VR/AR Devices

    2023/12/08

    Consumer Electronics

     PDF

    The smartwatch market saw a downturn in 2023, which has significantly impacted strategies for 2024. Manufacturers are expected to adopt a conservative approach, focusing on incremental upgrades and diversification in R&D to align with market needs, with AI becoming a crucial tool in enhancing product and service offerings.
    The VR/AR sector continues to struggle with a lack of compelling content and applications, which has stalled market growth and investor enthusiasm. In response, 2024 is set to witness a stronger emphasis on technological advancements to enrich content and broaden the commercial application of devices, spurring the development of essential upstream components.

    [Selected Topics] Chinese Suppliers Shift Focus to 12-inch and IGBT amidst Decelerating Growth of Power Semiconductors

    2023/11/22

    Semiconductors

     PDF

    Power semiconductors are the core of energy conversion and circuit control in electronic devices, playing vital roles in power conversion, amplification, switching, circuit protection, and rectification in electronic circuits. They are primarily used for altering voltage and frequency, as well as converting DC to AC in electronic devices. Power semiconductors have a key and extensive role in fields such as automobiles, industry, railway transportation, and power. As the new energy sector grows, particularly in solar energy and electric vehicles, power semiconductors such as IGBT and MOS are also becoming increasingly important in the realm of sustainable energy.




    Membership





    Category