AI chip, GPU, accelerator and data center news from NVIDIA, AMD, custom silicon labs and cloud infrastructure teams.
Daily brief at your local 8am — bilingual EN/中文, free.

Nvidia's Kyber NVL144 AI server rack has been delayed by over a year to 2028 due to PCB manufacturing issues, causing significant stock drops among Asian suppliers. Competitors like AMD and Google may gain ground as Nvidia's ambitious plans face setbacks.
Nvidia's Kyber NVL144 AI server rack has been delayed until 2028 due to manufacturing issues, which may allow competitors like AMD and Google to capture market share. Builders and PMs should reassess their hardware strategies, while investors may need to evaluate the long-term impact on Nvidia's market position and supply chain stability.

South Korea's semiconductor workers are now the most eligible bachelors due to substantial bonuses from AI chip profits, with SK Hynix employees receiving an extra $476,000 each. Meanwhile, researchers are developing a device to maintain and revive human eyeballs for potential whole-eye transplants, addressing previous challenges in eye surgery.
The substantial bonuses for SK Hynix semiconductor workers, amounting to $476,000 each, signal a lucrative trend in AI chip production, highlighting the growing demand for talent in this sector. Additionally, advancements in eye transplant technology could open new markets in healthcare, presenting opportunities for investors and product managers in medical tech innovation.

The AI chip boom is making SK Hynix workers the most desirable singles in South Korea, as they receive record bonuses of $476,000 each, leading to increased matchmaking interest and concerns over wealth disparity.
The record bonuses of $476,000 for SK Hynix chip workers signal a booming AI chip market, highlighting the growing demand for talent in this sector. Builders and PMs should consider the implications of talent attraction and retention strategies, while investors may see this as a sign of lucrative opportunities in AI chip manufacturing.
Hawk is a training-free framework that enhances NPU kernel generation accuracy from 49.4% to 80.0% and achieves up to 2.2x speedup over existing methods by leveraging hardware-aware knowledge through three innovative modules.
The development of Hawk, a training-free framework that boosts NPU kernel generation accuracy from 49.4% to 80.0% and offers a 2.2x speedup, is significant for builders and PMs focusing on optimizing AI hardware performance. Investors should note that this advancement could lead to more efficient AI applications and reduced operational costs, enhancing competitiveness in the AI market.

The DPU market is rapidly expanding as AI infrastructure shifts focus from GPU performance to network efficiency, with companies like Cloud Leopard achieving significant milestones in DPU development, including a 400Gbps product. This transition highlights the critical role of DPU in optimizing AI systems for high-frequency inference and resource scheduling.
The rapid expansion of the DPU market, exemplified by Cloud Leopard's 400Gbps product, signifies a shift in AI infrastructure priorities towards network efficiency. This development is crucial for builders and PMs as it enhances system performance for high-frequency inference, while investors should note the potential for significant returns in this emerging sector.

NVIDIA's Confidential Computing (CC) addresses AI adoption barriers by enhancing data privacy and security during model inference without compromising performance. This solution enables organizations to leverage AI innovations while ensuring data sovereignty and protection.
NVIDIA's Confidential Computing enhances AI security during model inference without sacrificing performance, which allows builders and PMs to integrate AI innovations while ensuring data privacy. For investors, this development signals a growing market for secure AI solutions, potentially leading to increased adoption and investment opportunities in AI-driven applications.

Anthropic is in early discussions with Samsung Electronics to manufacture a custom AI chip, aiming to reduce infrastructure costs. This move follows OpenAI's development of the 'Jalapeño' chip, highlighting a trend among major AI companies to explore chip production while still recognizing Nvidia's importance in the market.
Anthropic's discussions with Samsung to manufacture a custom AI chip signal a critical shift towards in-house chip production, which could lower operational costs for AI companies. This development emphasizes the growing trend of AI firms diversifying their hardware strategies while still relying on established players like Nvidia, indicating a competitive landscape for investors and builders in AI infrastructure.

Anthropic is in talks with Samsung to develop a custom AI chip, following OpenAI's recent announcement of its own custom chip in collaboration with Broadcom. This move highlights the growing competition in the AI hardware space as companies seek to enhance their computational capabilities.
Anthropic's discussions with Samsung to develop a custom AI chip signal an intensifying competition in AI hardware, following OpenAI's collaboration with Broadcom. For builders and PMs, this emphasizes the need to consider hardware capabilities in AI product development, while investors should note potential market shifts and the importance of strategic partnerships in the AI ecosystem.

Apple has partnered with Google Cloud to utilize Private Cloud Compute for the first time, leveraging NVIDIA Blackwell GPUs and Intel TDX, while maintaining an independent hardware ledger. Notably, AWS and Azure are excluded from this collaboration.
Apple's partnership with Google Cloud to utilize Private Cloud Compute with NVIDIA Blackwell GPUs marks a significant shift in cloud infrastructure dynamics, excluding AWS and Azure. This development signals a growing trend towards specialized cloud solutions, which could influence builders and PMs to consider alternative platforms for performance and security, while investors may see potential in diversifying cloud service offerings.
BaseRT is a native Metal inference runtime for large language models on Apple Silicon, achieving up to 1.56x higher decode throughput than llama.cpp and 1.35x higher than MLX. It supports various model families and quantization formats, establishing Apple Silicon as a leading platform for on-device inference, crucial for privacy and latency-sensitive applications.
The development of BaseRT, a native Metal inference runtime for large language models on Apple Silicon, significantly enhances capabilities by achieving superior decode throughput. This advancement is crucial for builders and PMs focusing on privacy-sensitive applications, as it allows for faster and more efficient model deployment on Apple devices, attracting investor interest in the growing AI hardware ecosystem.

Amazon Bedrock now supports OpenAI's open-weight GPT OSS models (120B, 20B) and NVIDIA's Nemotron models (Nano 9B v2, Nano 12B v2, Nano 30B, Super 120B) in AWS GovCloud (US), enhancing inference options and service tiers for users.
Amazon Bedrock's support for OpenAI's open-weight GPT OSS models and NVIDIA's Nemotron models in AWS GovCloud (US) expands the range of AI inference options available to builders and PMs, enabling more tailored solutions for government and regulated industries. This development signals increased accessibility to powerful AI tools, which can attract investment in compliant AI applications.
Shanghai-based AI chip startup Dongfang Suanxin has launched its official website and WeChat account, marking its entry into the high-performance AI chip market. The company has secured investments from major players like Meituan, Xiaomi, and JD.com, indicating strong confidence in its technology and potential.
The launch of Dongfang Suanxin's official website and WeChat account signifies its entry into the competitive AI chip market, backed by substantial investments from Meituan, Xiaomi, and JD.com. This development highlights a growing demand for high-performance AI chips, which may influence builders and PMs to consider new hardware partnerships and investors to evaluate opportunities in the AI infrastructure space.
NVIDIA reported a record revenue of $81.62 billion for Q1 FY2027, up 85% year-over-year, with net profit soaring 211% to $58.32 billion. The data center segment accounted for 92% of revenue, driven by a 77% increase in computing power sales, indicating strong growth in AI and hyperscale markets.
NVIDIA's Q1 FY2027 revenue of $81.62 billion, with 92% from data centers, signals a robust demand for AI infrastructure, indicating that builders and PMs should prioritize AI-driven projects. For investors, NVIDIA's performance highlights the potential for high returns in the AI and hyperscale computing sectors.

Reinforcement learning (RL) is crucial for aligning language models, evolving from RL with human feedback (RLHF) to RL with verifiable rewards (RLVR). This shift enables enterprises to develop more accurate AI agents tailored for specific workflows, enhancing performance in reasoning and agent tasks.
The shift from RLHF to RLVR in AI agent reinforcement learning enables builders to create more precise AI agents tailored to specific workflows, which can significantly enhance operational efficiency. For PMs and investors, this development signals a potential for higher ROI through improved task performance and alignment with business objectives.

Outpost VFX accelerated AI model training for face replacement by 8x using AWS P5 instances with NVIDIA H100 GPUs, overcoming single-GPU limitations. This transformation significantly reduced production delays and improved client deliverables across their studios in the UK, Canada, and India.
Outpost VFX's use of AWS P5 instances with NVIDIA H100 GPUs to accelerate AI model training for visual effects by 8x highlights the potential for cloud computing to overcome hardware limitations. This development signals to builders and PMs that leveraging advanced cloud infrastructure can significantly enhance productivity and reduce time-to-market for AI-driven projects, making it an attractive investment opportunity.

Wall Street is optimistic about Micron's potential to replicate Nvidia's success in the AI sector, driven by its advanced memory solutions. Investors believe that Micron's DRAM and NAND technologies will play a crucial role in AI applications, positioning the company as a key player in the burgeoning market. This shift could significantly enhance Micron's valuation and market presence, similar to Nvidia's trajectory.
Micron's advanced memory solutions, particularly in DRAM and NAND technologies, are being recognized as critical for AI applications, similar to Nvidia's role in the market. This development signals potential investment opportunities and strategic partnerships for builders and PMs looking to leverage AI capabilities, while investors may see a significant increase in Micron's valuation as demand for AI infrastructure grows.
The resurgence of Groq's LPU in NVIDIA's Vera Rubin platform marks a shift towards specialized chips for AI inference, with Groq's SRAM bandwidth reaching 150 TB/s, significantly outperforming traditional HBM solutions. As the industry embraces heterogeneous computing, the viability of LPU as a standalone business remains uncertain amid rising competition and evolving market demands.
The resurgence of Groq's LPU in NVIDIA's Vera Rubin platform highlights a significant shift towards specialized chips for AI inference, offering an impressive SRAM bandwidth of 150 TB/s. Builders and PMs should consider how this could impact their hardware choices, while investors need to assess the competitive landscape as the viability of LPU as a standalone business remains uncertain.

NVIDIA's NeMo AutoModel significantly accelerates the fine-tuning of Transformer models, enhancing performance benchmarks while reducing costs. This tool simplifies the process for developers, making it easier to deploy state-of-the-art models efficiently.
NVIDIA's NeMo AutoModel accelerates the fine-tuning of Transformer models, which allows builders and PMs to deploy advanced AI solutions more efficiently and at lower costs. This development signals a significant reduction in time and resources required for model optimization, making it an attractive proposition for investors looking to support scalable AI innovations.
OpenAI and Broadcom have launched Jalapeño, a custom AI chip designed specifically for LLM inference, enhancing performance and efficiency in AI systems. This chip aims to optimize scaling and operational capabilities, addressing the growing demands of large language models in various applications.
The launch of Jalapeño, a custom AI chip by OpenAI and Broadcom, signifies a major advancement in LLM inference capabilities, which could drastically reduce operational costs and improve performance for AI applications. Builders and PMs should consider how this chip can enhance their products, while investors may see it as a pivotal development in the AI hardware market.

ParallelKernelBench evaluates LLMs' ability to generate efficient multi-GPU CUDA kernels across 87 workloads. While the best model manages to solve less than a third of the tasks effectively, some generated kernels outperform existing public implementations, highlighting the potential for improvement in LLM capabilities.
The evaluation of LLMs in generating efficient multi-GPU CUDA kernels reveals that while current models struggle, some outputs show promise by outperforming existing implementations. This indicates a potential area for investment and development in AI-driven programming tools, which could significantly enhance productivity in high-performance computing applications.