Charles Liang, President and CEO of AI server giant Supermicro, delivered a keynote speech at COMPUTEX earlier today. According to a report from CNA, while expressing his optimism in expanding the company’s market share in the Direct Liquid Cooling (DLC) field, Liang targets to capture a 15% market share in the new data center market by next year.

According to the report, Liang mentioned that Supermicro’s DLC solutions had a market share of less than 1% over the past 30 years. However, as DLC solutions now have a cost comparable to air-cooled solutions, yet more energy-efficient, more manufacturers are beginning to adopt them. It is estimated that Supermicro has around 1000 liquid-cooled cabinets shipped each month, and the aim is to capture 15% of the new data center market share within next year.

Supermicro offers comprehensive solutions at both the cabinet and data center levels. Its operations have expanded globally from the headquarter in San Jose, California, to manufacturing and operation centers in Asia and Europe. Liang stated that Supermicro’s Malaysian plant is expected to be operational in the fourth quarter of this year, with a monthly production capacity of up to 5000 cabinets, according to CNA’s report today.

Regarding Supermicro’s expansion plans, Liang said earlier that Supermicro, with over 4000 employees worldwide, its top priority would be expanding in Taiwan, aiming to finalize plans for a new campus in the near future.

In addition, Liang pointed out that AI is rapidly and significantly changing the world. Through its collaboration with GPU giant NVIDIA, Supermicro has become one of the leading suppliers of AI systems. He also emphasized that by adopting more energy-efficient systems, green computing can be cost-free and offer significant bonuses, according to the report.

While reiterating Supermicro’s strong bond with NVIDIA, Liang invited NVIDIA CEO Jensen Huang to join him on stage. When Liang introduced the liquid-cooled server cabinets on stage, Huang praised the liquid cooling solution for significantly reducing data center costs.

Read more

• [COMPUTEX 2024] The Rise of Generative AI Sparks Innovation across Industries, with Taiwan-based Companies Leading as Essential Partners in the Global Supply Chain

(Photo credit: Supermicro)

Intel collaborates with Foxconn, Microloops, and Inventec to introduce a new cooling technology. Boasting superior performance compared to conventional liquid cooling, this initiative, alongside Gigabyte and Wiwynn, aims to enter the server immersion liquid cooling technology market, positioning themselves for potential orders.

TrendForce’s Insights:

1. Intel Teams Up with Taiwanese Manufacturers to Pave the Way for Liquid Cooling Technologies, Targeting Immersive Water-Cooled AI Server Orders

Intel, in collaboration with Foxconn, Microloops, and Inventec, introduces a brand new Liquid Cooling solution. This technology, capable of managing Thermal Design Power (TDP) exceeding 1500W, utilizes the principles of physical pressurization to facilitate rapid liquid flow for efficient heat dissipation.

With a threefold improvement in performance over conventional liquid cooling, the liquid cooling plate circulates water to dissipate heat. Future developments include non-conductive liquid solutions to mitigate leakage risks.

Simultaneously, Gigabyte’s subsidiary, GIGA Computing Technology, partners with liquid cooling experts CoolIT and Motivair to unveil cutting-edge liquid cooling solutions. The strategic focus on liquid and immersive liquid cooling aims to enhance the sustainability and energy efficiency of data centers.

Wiwynn, also keenly interested in liquid cooling technology, has secured substantial orders from Middle Eastern clients by prioritizing two-phase immersion cooling technology, with rumors suggesting the order’s value is approximately USD 4 billion.

The advantages of two-phase cooling technology include fanless operation, rapid heat dissipation, noiseless and vibration-free performance, and higher cooling energy efficiency. Moreover, it is less susceptible to environmental influences, ensuring normal usage.

On the other hand, Taiwanese manufacturers, AURAS Technology and AVC (Asia Vital Components), are actively developing and mass-producing open-loop liquid cooling and immersion liquid cooling technologies.

Due to the novelty of immersion cooling technology, the current market demand visibility is relatively low. However, major Taiwanese contract manufacturers are increasingly focusing on the technical development and introduction of immersion cooling solutions. This is primarily driven by the growing demand for high-end AI servers, which require efficient computation and often generate high power consumption.

At present, only immersion liquid cooling can provide a cooling solution surpassing 1500W, meeting the requirements of large-scale data centers. Consequently, numerous Taiwanese manufacturers are actively engaging in the development of this technology to seize the opportunities presented by the initial wave of immersion liquid cooling products.

2. Short-Term Dominance of 3D VC Air Cooling and Open Liquid Cooling Technologies in Heat Dissipation Solutions

Due to the need for adjustments in facility structure, including the layout of cooling spaces, immersion liquid cooling comes with higher construction costs. Cases of immersion liquid cooling in large-scale data centers are also relatively rare.

In consideration of cost, many enterprise users still opt for 3D VC (Vapor Chamber) air cooling technology to establish their data centers, aiming to save on the significant costs associated with facility modifications.

3D VC air cooling and open liquid cooling technologies are the current primary options for heat dissipation solutions. The retrofitting cost for 3D VC is twice that of traditional cooling modes, while the cost for liquid cooling solutions can be up to 10 times higher than traditional modes.

Therefore, enterprise users need to tailor their server deployments based on specific requirements, taking into account the Thermal Design Power (TDP) to choose the corresponding heat dissipation solution.

For instance, AI servers with power consumption ranging from 1000 to 1500W can utilize open liquid cooling solutions, while those below 1000W may adopt the 3D VC cooling approach.

With the target of achieving net-zero emissions by 2050, both China and Europe impose restrictions on the Power Usage Effectiveness (PUE) of data centers, limiting it to no higher than 1.4.

In anticipation of this, server OEMs and cooling solution providers are expected to increase the development and offerings of liquid and immersive liquid cooling products. This trend aims to provide data centers with customized solutions and services, aligning with the evolving energy efficiency requirements.

GIGABYTE held an online earning call on November 1st, during which General Manager Etay Lee expressed optimism about the company’s performance. The growth momentum in server and motherboard sectors remains robust, allowing GIGABYTE to potentially reach the significant milestone of NT$100 billion in annual revenue ahead of schedule. Additionally, the company is increasing its server revenue contribution this year, aiming for a remarkable double-digit growth.

As reported by Anue, Lee focused on the server sector, noting that the third quarter demonstrated impressive server revenue, and this momentum is expected to continue into the fourth quarter. The company is poised for high double-digit revenue growth in the server sector this year, with the ambition to challenge triple-digit growth. These developments have led to an upward revision of the annual revenue target.

Etay Lee emphasized the current high demand for AI servers, with a majority being shipped as units or racks. These include high quality networking, high efficiency storage, and High Performance Computing (HPC) integration. The increased components in AI server systems has led to a boost in revenue and gross profit; however, there is a slight decrease in the gross profit margin.

Regarding the expanded chip ban controls imposed by the United States, Lee clarified that GIGABYTE’s AI server products have a limited presence in the Chinese market, thereby minimizing the impact of these restrictions. Furthermore, in regions such as the Middle East and Vietnam where approvals are required, the company will also submit applications, and the overall impact is minimal.

In terms of graphics cards, GIGABYTE reported that inventory adjustments are completed, and channels have returned to normal levels. This, coupled with competitive pricing for the company’s main products, the 4060Ti and 4070, has generated strong demand starting from late in the third quarter. Notably, the European and American regions have witnessed a resurgence in growth, with demand surpassing that of the Asia-Pacific region.
(Image: GIGABYTE)

US-based CSPs have been establishing SMT production lines in Southeast Asia since late 2022 to mitigate geopolitical risks and supply chain disruptions. TrendForce reports that Taiwan-based server ODMs, including Quanta, Foxconn, Wistron (including Wiwynn), and Inventec, have set up production bases in countries like Thailand, Vietnam, and Malaysia. It’s projected that by 2023, the production capacity from these regions will account for 23%, and by 2026, it will approach 50%.

TrendForce reveals that Quanta, due to its geographical ties, has established several production lines in its Thai facilities centered around Google and Celestica, aiming for optimal positioning to foster customer loyalty. Meanwhile, Foxconn has renovated its existing facilities in Hanoi, Vietnam, and uses its Wisconsin plant to accommodate customer needs. Both Wistron and Wiwynn are progressively establishing assembly plants and SMT production lines in Malaysia. Inventec’s current strategy mirrors that of Quanta, with plans to build SMT production lines in Thailand by 2024 and commence server production in late 2024.

CSPs aim to control the core supply chain, AI server supply chain trends toward decentralization

TrendForce suggests that changes in the supply chain aren’t just about circumventing geopolitical risks—equally vital is increased control over key high-cost components, including CPUs, GPUs, and other critical materials. With rising demand for next-generation AI and Large Language Models, supply chain stockpiling grows each quarter. Accompanied by a surge in demand in 1H23, CSPs will become especially cautious in their supply chain management.

Google, with its in-house developed TPU machines, possesses both the core R&D and supply chain leadership. Moreover, its production stronghold primarily revolves around its own manufacturing sites in Thailand. However, Google still relies on cooperative ODMs for human resource allocation and production scheduling, while managing other materials internally. To avoid disruptions in the supply chain, companies like Microsoft, Meta, and AWS are not only aiming for flexibility in supply chain management but are also integrating system integrators into ODM production. This approach allows for more dispersed and meticulous coordination and execution of projects.

Initially, Meta heavily relied on direct purchases of complete server systems, with Intel’s Habana system being one of the first to be integrated into Meta’s infrastructure. This made sense since the CPU for their web-type servers were often semi-custom versions from Intel. Based on system optimization levels, Meta found Habana to be the most direct and seamless solution. Notably, it was only last year that Meta began to delegate parts of its Metaverse project to ODMs. This year, as part of its push into generative AI, Meta has also started adopting NVIDIA’s solutions extensively.

As the struggle between China and the United States continues, in order to avoid upcoming geopolitical risks, not only have Taiwanese ODM manufacturers begun to shift some production locations, but market research firm TrendForce has also observed that American OEM companies have started to take action, discussing with partners how to reduce the proportion of Chinese supply chains and components.

TrendForce points out that, at present, American cloud service providers (CSPs) and OEM manufacturers have not yet been able to completely cut ties with Chinese-produced components. Among these, passive components and mechanical assemblies are more difficult to relocate due to factors such as cost and yield. However, other components (such as PCBs and power management control ICs) have plans to move out of China.

But where will these component manufacturers go if they want to move out of China? According to TrendForce’s analysis, PCB manufacturers are currently eyeing shifts to Thailand, Malaysia, Vietnam, and India; power management ICs and control ICs have already moved out of China and relocated to Taiwanese factories; mechanical assemblies and MLCC capacities still mainly come from China, with the former being requested to move but facing challenges due to cost and yield considerations.

TrendForce notes that the aforementioned production line and material shifts are primarily led by American CSPs. The overall server supply chain’s subsequent changes still need to be observed. For example, major players like Google, AWS, and Meta have not only moved most of their L6 production lines to Taiwan but also plan to establish bases in Southeast Asia after 2024 to handle cases within the United States, and reserve flexible production lines along the US-Mexico border, which will significantly increase utilization within this year.