AI server solution provider Supermicro, at its earnings call last week, revealed that the liquid cooling industry has been facing shortages for critical components, which further hinders its shipments. According to the latest report by the Economic Daily News, sources from the supply chain indicate that the critical component Supermicro referred to is the “quick coupling.”

The report notes that Taiwanese companies, including Global Tek, Fositek and Lotes, are accelerating their pace on sample verification.

Thanks to the soaring demand, the market is seeing a frenzy for quick couplings, with buyers willing to pay premium prices to secure capacity, the report suggests. The report notes that the price of quick couplings has surged from the original USD 40 to USD 60 per unit, with eager buyers claiming to pay for more as long as the components are available.

Citing industry experts, the report explains that the liquid-cooling system in AI servers consists of six key components: cooling distribution units (CDUs), cold plates, cabinets, fan walls, coolant distribution manifolds (CDMs), and quick couplings.

Among these, quick couplings are responsible for connecting the coolant flow between the cold plate and the CDU with great speed. In addition, as they are also prone to leakage, their quality would be especially crucial for liquid-cooling systems to operate smoothly.

The reason for the shortage, the report notes, is primarily due to the fact that a single AI server cabinet requires hundreds of male and female threads for quick couplings. As major cloud service providers (CSPs) are purchasing AI servers in large quantities, the demand for quick couplings has surged drastically, even to hundreds of times of the cabinets themselves.

It is worth noting that currently, the market for liquid-cooling quick couplings in AI servers is dominated by seven companies, including two Chinese firms. However, as the sanctions implemented in the U.S.-China tech war restrict the momentum of the Chinese companies, the market demand could not be satisfy. Also, the patents related to the components have created high barriers for other suppliers to enter the market.

Taiwanese companies, including Global Tek, Fositek and Lotes, therefore, are actively investing in the business and accelerating their sample submission, eyeing for the opportunities to receive order transfers.

Global Tek, for example, is working with partners at its Wuxi plant in China and its Taoyuan plant in Taiwan, with samples being tested. The company anticipates revenue contribution as early as the fourth quarter of this year or early next year.

Fositek, supported by its parent company Asia Vital Components, is currently focused on developing quick couplings and has already submitted samples for customer certification. Lotes, on the other hand, expects to see progress by the end of the third quarter.

Read more

• [News] Supermicro’s Financial Results Reveal Profit Shortfall
• [News] Supermicro President Charles Liang Bullish on Direct Liquid Cooling, Targeting a 15% Market Share within Next Year 

(Photo credit: Supermicro)

Tesla, the electric vehicle giant, initially planned to establish a plant in Thailand, with an estimated investment exceeding USD 5 billion. However, according to a report from Thai media outlet The Nation, Tesla has decided to scrap the plans for the Thai plant after further evaluation, shifting its focus to expanding the local charging station network instead.

The report further cited sources, indicating that Tesla has re-evaluated its expansion plans in Asia and has decided to cancel all projects in the region. This includes not only the planned one in Thailand but also projects in Malaysia and Indonesia, leaving only the most economically viable production lines in China, the U.S., and Germany.

In September 2023, Thai Prime Minister Srettha Thavisin announced the successful attraction of Tesla to Thailand following a visit to the U.S. In November, Srettha met with Tesla executives and revealed that the company had begun site evaluation for a plant, with an investment exceeding USD 5 billion.

However, due to significant changes in the electric vehicle market impacting expected investment returns, Tesla has decided to postpone its global expansion plans.

Besides the aforementioned Asian locations, Tesla had also planned to build a plant in the Nuevo León industrial park in northeastern Mexico. However, Tesla reportedly confirmed in October 2023 that the plan is on hold due to economic concerns.

Thailand is reportedly the largest automotive producer in Southeast Asia. With the global trend shifting towards electric vehicles replacing traditional combustion engines, the Thai government is said to be promoting related policies to boost local EV production.

The goal, as per a report from Bloomberg, is expected to have electric vehicles make up 30% of the country’s total automotive production by 2030.

Read more

• [News] Impacted by the Tariff Increase by EU, Tesla Reportedly Expects Price Hike for European Model 3
• [News] TSMC Reportedly Commences Production of Tesla’s Next-Generation Dojo Chips, Anticipates 40x Increase in Computing Power in 3 Years

(Photo credit: Tesla)

According to a report from global media outlet Financial Times citing sources, Chinese authorities plan to implement mandatory reviews of large AI models. Reportedly, Chinese government officials are testing the large language models of AI companies to ensure that the systems embody core socialist values.

The Cyberspace Administration of China is said to have required major tech companies such as ByteDance, Alibaba, Moonshot, and 01.AI, as well as AI startups, to participate in these mandatory reviews.

Sources indicate that this effort involves testing a range of responses from the large AI  models, including those on politically sensitive topics in China and related to Chinese President Xi Jinping. Officials from the Cyberspace Administration of China’s local branches are conducting the reviews, examining the models’ training data and other security processes.

A Hangzhou-based AI company reported that the Cyberspace Administration has dedicated teams for this task, who visit offices to conduct audits. The company mentioned that their first review did not pass, and after months of adjustments and communication with peers, they passed the second review.

Regarding the aforementioned matter, the Cyberspace Administration, ByteDance, Alibaba, Moonshot, Baidu, and 01.AI have not yet responded.

(Photo credit: Alibaba)

Read more

• [News] China Plans to Set at Least 50 AI Standards by 2026, from Language Models to Semiconductors
• [News] China Targets Tech Leadership by 2035 in Six Areas, Including Semiconductors

Earlier on July 10^th, in the Galaxy Unpack 2024 event in Paris, Samsung introduced its AI smartphone Galaxy Z Fold6 and Galaxy Z Flip6, along with the “Google Gemini” app installed in the models. However, according to the reports by Reuters and Business Korea, these two tech giants may be facing the investigation of the European Union (EU) antitrust regulators, on whether the collaboration might impede market access for other AI developers or limit competition.

It has been a while since the two tech heavyweight started to team up on AI. Samsung’s first AI phone, Galaxy S24, released earlier this year, has featured its self-developed AI, Gauss, as well as Google’s Gemini Nano.

The EU has ramped up its market monitoring efforts following the implementation of the Digital Markets Act (DMA) in March, focusing on major global tech companies. The DMA identifies seven companies—Google, Amazon, Apple, Meta, Microsoft, Booking and ByteDance —as ‘gatekeepers’ and imposes specific regulations on them to ensure fair competition in the digital market, Business Korea noted.

Now the spotlight has been shifted to the AI sector. According to Reuters, EU antitrust regulators are inquiring whether Google’s multi-year generative AI deal with Samsung hampers rival chatbots on Samsung smartphones. The report noted that last month, the European Commission announced it would send requests for information to understand the impact of the deal, which involves Samsung embedding Google’s Gemini Nano in its Galaxy S24 series smartphones.

According to the Reuters report, regulators are investigating if the pre-installation of Gemini Nano limits the functionality of other chatbots and applications on Samsung smartphones. The EU also asked companies whether they had attempted to enter into pre-installation agreements with Samsung for their chatbots and, if so, requested explanations for any failures. Respondents are required to complete the urvey by this week.

If anti-competitive practices are confirmed, an antitrust investigation against Google and Samsung could be initiated, Reuters stated.

According to Business Korea, after the Galaxy Unpacked 2024 event, TM Roh, President of Samsung Electronics (Head of MX Business Division), addressed regulatory risks during a press conference, saying the company is having various discussions internally and externally regarding EU regulations.

Roh also emphasized Samsung’s commitment to data security, stating that sensitive information is processed on-device (without connecting to external servers), making it inaccessible even to the company,” and highlighted the company’s approach to giving consumers the choice of using AI functions on-device or via the cloud.

Read more

• [News] NVIDIA Faces Potential Antitrust Charges in France, U.S. and EU Close Behind
• [News] Samsung Rumored to Mass-Produce HBM4 with 4nm Process

(Photo credit: Samsung)

China aims to establish at least 50 AI standards by 2026, as outlined in a new draft policy from Beijing, according to a report by South China Morning Post. The draft policy, released on Tuesday by the Ministry of Industry and Information Technology (MIIT), will not only cover training for large language models (LLMs), but even semiconductors.

This initiative is part of China’s effort to catch up with the U.S. in AI development, the report noted. Earlier in April, Alibaba’s chairman, Joe Tsai, mentioned in an interview that China is at least two years behind its leading US counterparts, like OpenAI and Google, in the global AI race.

China’s proposed standards will cover training for large language models (LLMs), which are the foundation of generative AI services like ChatGPT. Additionally, they will address safety, governance, industrial applications, software, computing systems, data centers, and the technical requirements and testing methodologies for semiconductors.

According to MIIT, these standards are expected to apply to at least 1,000 Chinese technology companies. The document also states that China will participate in creating at least 20 international AI standards, the report said.

MIIT’s draft policy identifies 12 critical technologies in the AI supply chain, including LLMs, natural language processing, computer vision, and machine learning, which involves systems performing complex tasks akin to human problem-solving. The draft policy also identifies four layers that comprise China’s AI industry chain: the foundation (including the computing power, algorithms, and data needed to train LLMs), the framework, the model, and applications.

Citing an industrial expert, the report indicated that the latest draft policy, unlike the usual command-and-control regulations, has adopted a pro-market, soft-law approach to guide and promote China’s AI industry. This stance, which is comparatively innovation-oriented and market-friendly, will not only enable the establishment and development of an AI ecosystem, but benefit other industries as well.

China’s tech giants, led by Huawei, has been aggressively advancing in the AI arena. Previously, Huawei claimed its second-generation AI chip “Ascend 910B” could compete with NVIDIA’s A100 and was working to replace NVIDIA, which holds over 90% of the market share in China. However, according to ChosunBiz, the chip, being manufactured by China’s leading semiconductor foundry, SMIC, has been in mass production for over half a year, yet the yield rate remains around 20%.

On the other hand, in response to US export bans, NVIDIA has commenced to sell H20, its AI chip tailored for the Chinese market earlier this year.

Read more

• [News] Huawei Faces Production Challenges with 20% Yield Rate for AI Chip
• [News] NVIDIA Reportedly Facing Price Cut Pressure of H20 Chip in China Amid Competition with Huawei