重磅发布｜光羽芯辰全球首发端侧大算力3D近存算AI芯片TC1000系列

This chip offers a tenfold increase in equivalent bandwidth and operates at one-third the power consumption, achieving 300 tokens per second inference for a 3B model.

Key Points

• TC1000 series features 10x increase in equivalent bandwidth.
• Power consumption reduced to one-third of previous models.
• Achieves 300 tokens per second inference for 3B models.
• First chip of its kind to utilize 3D stacking technology.
• Targets advancements in edge AI applications.