Xiaomi Unveils Xuanjie O100 AI Chip with 1.22TB/s Bandwidth

Xiaomi has released the Xuanjie O100, its first high-bandwidth AI accelerator chip designed specifically for on-device large language models. The chip employs the industry's first 6nm wafer-level vertical stacking advanced packaging, utilizing hybrid bonding technology with a 1.4-micron bond pitch. It achieves a bandwidth of 1.22TB/s, which is 16 times that of traditional flagship smartphones, and supports on-device inference speeds of up to 330TPS.